Max level shown:
1 [ Dec 6 20:40:17 Enabled. ]
2 [ Dec 6 20:40:17 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Dec 6 20:40:17 Method "start" exited with status 0. ]
4 [ Dec 6 20:40:17 Rereading configuration. ]
5 [ Dec 6 20:40:17 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72024-12-06T20:40:17.378ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:113
82024-12-06T20:40:17.378ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92024-12-06T20:40:17.431ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102024-12-06T20:40:17.431ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112024-12-06T20:40:17.547ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122024-12-06T20:40:17.556ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132024-12-06T20:40:17.564ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142024-12-06T20:40:18.167ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:a02a::, width: 64 }
152024-12-06T20:40:18.308ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
162024-12-06T20:40:18.308ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
172024-12-06T20:40:18.309ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
182024-12-06T20:40:18.309ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192024-12-06T20:40:18.309ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:520
202024-12-06T20:40:18.309ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:717
212024-12-06T20:40:18.312ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "sock", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:624
222024-12-06T20:40:18.312ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:766
232024-12-06T20:40:18.312ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
242024-12-06T20:40:18.312ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:825
252024-12-06T20:40:18.312ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
262024-12-06T20:40:18.312ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272024-12-06T20:40:18.312ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
282024-12-06T20:40:18.312ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292024-12-06T20:40:18.312ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302024-12-06T20:40:18.324ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:367
312024-12-06T20:40:18.324ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = b9ab18cf-4dd7-46c3-920e-833f181cfe8b (zpool)
322024-12-06T20:40:18.430ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: b9ab18cf-4dd7-46c3-920e-833f181cfe8b (zpool), kind: Internal }
332024-12-06T20:40:18.909ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:603
342024-12-06T20:40:18.909ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
352024-12-06T20:40:18.909ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362024-12-06T20:40:18.909ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372024-12-06T20:40:18.909ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
382024-12-06T20:40:18.909ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392024-12-06T20:40:18.909ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402024-12-06T20:40:18.918ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:367
412024-12-06T20:40:18.918ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 5a719d2c-fbf6-41ef-af9f-e6b70820ebd4 (zpool)
422024-12-06T20:40:19.006ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 5a719d2c-fbf6-41ef-af9f-e6b70820ebd4 (zpool), kind: Internal }
432024-12-06T20:40:19.485ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
442024-12-06T20:40:19.485ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b9ab18cf-4dd7-46c3-920e-833f181cfe8b (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 5a719d2c-fbf6-41ef-af9f-e6b70820ebd4 (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
452024-12-06T20:40:19.485ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
462024-12-06T20:40:19.485ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
472024-12-06T20:40:19.485ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
482024-12-06T20:40:19.485ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
492024-12-06T20:40:19.485ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
502024-12-06T20:40:19.485ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b9ab18cf-4dd7-46c3-920e-833f181cfe8b (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 5a719d2c-fbf6-41ef-af9f-e6b70820ebd4 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
512024-12-06T20:40:19.485ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
522024-12-06T20:40:19.485ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
532024-12-06T20:40:19.485ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
542024-12-06T20:40:19.485ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
552024-12-06T20:40:19.485ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
562024-12-06T20:40:19.485ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
572024-12-06T20:40:19.485ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b9ab18cf-4dd7-46c3-920e-833f181cfe8b (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 5a719d2c-fbf6-41ef-af9f-e6b70820ebd4 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
582024-12-06T20:40:19.485ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
592024-12-06T20:40:19.485ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
602024-12-06T20:40:19.485ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
612024-12-06T20:40:19.485ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
622024-12-06T20:40:19.485ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b9ab18cf-4dd7-46c3-920e-833f181cfe8b (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 5a719d2c-fbf6-41ef-af9f-e6b70820ebd4 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
632024-12-06T20:40:19.485ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
642024-12-06T20:40:19.485ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
652024-12-06T20:40:19.485ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
662024-12-06T20:40:19.485ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
672024-12-06T20:40:19.485ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
682024-12-06T20:40:19.485ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b9ab18cf-4dd7-46c3-920e-833f181cfe8b (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 5a719d2c-fbf6-41ef-af9f-e6b70820ebd4 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
692024-12-06T20:40:19.485ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
702024-12-06T20:40:19.485ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
712024-12-06T20:40:19.485ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
722024-12-06T20:40:19.485ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
732024-12-06T20:40:19.485ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
742024-12-06T20:40:19.485ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b9ab18cf-4dd7-46c3-920e-833f181cfe8b (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 5a719d2c-fbf6-41ef-af9f-e6b70820ebd4 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
752024-12-06T20:40:19.485ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
762024-12-06T20:40:19.485ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
772024-12-06T20:40:19.485ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
782024-12-06T20:40:19.485ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
792024-12-06T20:40:19.485ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
802024-12-06T20:40:19.485ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
812024-12-06T20:40:19.485ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
822024-12-06T20:40:19.485ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b9ab18cf-4dd7-46c3-920e-833f181cfe8b (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 5a719d2c-fbf6-41ef-af9f-e6b70820ebd4 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
832024-12-06T20:40:19.486ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
842024-12-06T20:40:19.486ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
852024-12-06T20:40:19.486ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
862024-12-06T20:40:19.486ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
872024-12-06T20:40:19.486ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
882024-12-06T20:40:19.486ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b9ab18cf-4dd7-46c3-920e-833f181cfe8b (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 5a719d2c-fbf6-41ef-af9f-e6b70820ebd4 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
892024-12-06T20:40:19.486ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
902024-12-06T20:40:19.486ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
912024-12-06T20:40:19.486ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
922024-12-06T20:40:19.486ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
932024-12-06T20:40:19.486ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
942024-12-06T20:40:19.486ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b9ab18cf-4dd7-46c3-920e-833f181cfe8b (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 5a719d2c-fbf6-41ef-af9f-e6b70820ebd4 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
952024-12-06T20:40:19.486ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
962024-12-06T20:40:19.486ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
972024-12-06T20:40:19.486ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
982024-12-06T20:40:19.486ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
992024-12-06T20:40:19.486ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b9ab18cf-4dd7-46c3-920e-833f181cfe8b (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 5a719d2c-fbf6-41ef-af9f-e6b70820ebd4 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
1002024-12-06T20:40:19.486ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
1012024-12-06T20:40:19.486ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1022024-12-06T20:40:19.486ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1032024-12-06T20:40:19.486ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1042024-12-06T20:40:19.486ZINFOSledAgent (bootstore): No ledger in /pool/int/b9ab18cf-4dd7-46c3-920e-833f181cfe8b/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1052024-12-06T20:40:19.486ZINFOSledAgent (bootstore): No ledger in /pool/int/5a719d2c-fbf6-41ef-af9f-e6b70820ebd4/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1062024-12-06T20:40:19.486ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-sock-i86pc
1072024-12-06T20:40:19.486ZINFOSledAgent (bootstore): No ledger in /pool/int/b9ab18cf-4dd7-46c3-920e-833f181cfe8b/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1082024-12-06T20:40:19.486ZINFOSledAgent (bootstore): No ledger in /pool/int/5a719d2c-fbf6-41ef-af9f-e6b70820ebd4/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1092024-12-06T20:40:19.486ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-sock-i86pc
1102024-12-06T20:40:19.486ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1112024-12-06T20:40:19.486ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1122024-12-06T20:40:19.496ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:736
1132024-12-06T20:40:19.496ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 6549, tv_nsec: 645670218 } time_to_next_cleanup = 599.999930579s
1142024-12-06T20:40:19.496ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3947
1152024-12-06T20:40:19.496ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1162024-12-06T20:40:19.496ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/b9ab18cf-4dd7-46c3-920e-833f181cfe8b/config/sled-agent-request.json file = common/src/ledger.rs:188
1172024-12-06T20:40:19.499ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/5a719d2c-fbf6-41ef-af9f-e6b70820ebd4/config/sled-agent-request.json file = common/src/ledger.rs:188
1182024-12-06T20:40:19.499ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fdb0:18c0:4d0d:a02a::1]:80
1192024-12-06T20:40:19.501ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:a02a::1]:12346
1202024-12-06T20:40:19.501ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.2.164, last: 10.151.2.173, }, ), ], external_dns_ips: [ 10.151.2.164, 10.151.2.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1203
1212024-12-06T20:40:19.501ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1222024-12-06T20:40:19.502ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1232024-12-06T20:40:19.502ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1242024-12-06T20:40:19.502ZINFOSledAgent (RSS): No ledger in /pool/int/b9ab18cf-4dd7-46c3-920e-833f181cfe8b/config/rss-started.marker file = common/src/ledger.rs:188
1252024-12-06T20:40:19.502ZINFOSledAgent (RSS): No ledger in /pool/int/5a719d2c-fbf6-41ef-af9f-e6b70820ebd4/config/rss-started.marker file = common/src/ledger.rs:188
1262024-12-06T20:40:19.502ZINFOSledAgent (RSS): No ledger in /pool/int/b9ab18cf-4dd7-46c3-920e-833f181cfe8b/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1272024-12-06T20:40:19.502ZINFOSledAgent (RSS): No ledger in /pool/int/5a719d2c-fbf6-41ef-af9f-e6b70820ebd4/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1282024-12-06T20:40:19.502ZINFOSledAgent (RSS): RSS not previously run. Creating plans. file = sled-agent/src/rack_setup/service.rs:1252
1292024-12-06T20:40:19.502ZINFOSledAgent (RSS): Writing ledger to /pool/int/b9ab18cf-4dd7-46c3-920e-833f181cfe8b/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1302024-12-06T20:40:19.502ZINFOSledAgent (RSS): Writing ledger to /pool/int/5a719d2c-fbf6-41ef-af9f-e6b70820ebd4/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1312024-12-06T20:40:19.502ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1284
1322024-12-06T20:40:19.502ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:66
1332024-12-06T20:40:19.502ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:a02a::1 file = sled-agent/src/rack_setup/plan/sled.rs:39
1342024-12-06T20:40:19.502ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1316
1352024-12-06T20:40:19.502ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
1362024-12-06T20:40:19.502ZINFOSledAgent (bootstore): Writing ledger to /pool/int/b9ab18cf-4dd7-46c3-920e-833f181cfe8b/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1372024-12-06T20:40:19.502ZINFOSledAgent (bootstore): Writing ledger to /pool/int/5a719d2c-fbf6-41ef-af9f-e6b70820ebd4/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1382024-12-06T20:40:19.503ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
1392024-12-06T20:40:19.503ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 0a667526-2006-419e-9b68-c251fd138c06 (sled), rack_id: 06ed6b43-f7cd-4ed6-8c86-7494248aa355, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
1402024-12-06T20:40:19.503ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4244
1412024-12-06T20:40:19.503ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4644
1422024-12-06T20:40:19.508ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/client.rs:50
1432024-12-06T20:40:19.513ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1442024-12-06T20:40:19.513ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1452024-12-06T20:40:19.518ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1462024-12-06T20:40:19.518ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1472024-12-06T20:40:19.518ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:a02a::1]:36817
1482024-12-06T20:40:19.518ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 0a667526-2006-419e-9b68-c251fd138c06 (sled), rack_id: 06ed6b43-f7cd-4ed6-8c86-7494248aa355, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:362
1492024-12-06T20:40:19.518ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:377
1502024-12-06T20:40:19.519ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1512024-12-06T20:40:19.519ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1522024-12-06T20:40:19.519ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:603
1532024-12-06T20:40:19.519ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:809
1542024-12-06T20:40:19.519ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1552024-12-06T20:40:19.519ZINFOSledAgent (StorageManager): No ledger in /pool/int/b9ab18cf-4dd7-46c3-920e-833f181cfe8b/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1562024-12-06T20:40:19.519ZINFOSledAgent (StorageManager): No ledger in /pool/int/5a719d2c-fbf6-41ef-af9f-e6b70820ebd4/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1572024-12-06T20:40:19.519ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:798
1582024-12-06T20:40:19.519ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:826
1592024-12-06T20:40:19.519ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:592
1602024-12-06T20:40:19.519ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1612024-12-06T20:40:19.519ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:697 result = DisksManagementResult { status: [] }
1622024-12-06T20:40:19.535ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1632024-12-06T20:40:19.556ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:325
1642024-12-06T20:40:19.574ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:363
1652024-12-06T20:40:19.600ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:415 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
1662024-12-06T20:40:19.600ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1672024-12-06T20:40:19.600ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:427 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
1682024-12-06T20:40:19.600ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1692024-12-06T20:40:19.603ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 144.081154ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "142fbe95-c7b5-4a6c-93d5-a0c1afeff0ff", "content-length": "124", "date": "Fri, 06 Dec 2024 20:40:19 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "142fbe95-c7b5-4a6c-93d5-a0c1afeff0ff" } file = clients/ddm-admin-client/src/lib.rs:177
1702024-12-06T20:40:19.613ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_b9ab18cf-4dd7-46c3-920e-833f181cfe8b/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1712024-12-06T20:40:19.637ZINFOSledAgent: successfully created encrypted zvol: name="oxi_b9ab18cf-4dd7-46c3-920e-833f181cfe8b/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1722024-12-06T20:40:19.637ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_b9ab18cf-4dd7-46c3-920e-833f181cfe8b/swap" file = sled-agent/src/swap_device.rs:96
1732024-12-06T20:40:19.644ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:442 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
1742024-12-06T20:40:19.644ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:128
1752024-12-06T20:40:19.644ZINFOSledAgent (BackingFs): Ensuring dataset oxi_b9ab18cf-4dd7-46c3-920e-833f181cfe8b/backing/fmd file = sled-agent/src/backing_fs.rs:138
1762024-12-06T20:40:19.729ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:173
1772024-12-06T20:40:19.748ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1782024-12-06T20:40:19.749ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 175.292556ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "59495615-c6b8-404a-8c50-59e01fc44cc4", "content-length": "124", "date": "Fri, 06 Dec 2024 20:40:19 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "59495615-c6b8-404a-8c50-59e01fc44cc4" } file = clients/ddm-admin-client/src/lib.rs:177
1792024-12-06T20:40:19.926ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1802024-12-06T20:40:19.926ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 210.750024ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "52ec4073-6e5a-4a3a-8cf7-8d44df3158e3", "content-length": "124", "date": "Fri, 06 Dec 2024 20:40:19 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "52ec4073-6e5a-4a3a-8cf7-8d44df3158e3" } file = clients/ddm-admin-client/src/lib.rs:177
1812024-12-06T20:40:19.949ZINFOSledAgent (BackingFs): Mounting oxi_b9ab18cf-4dd7-46c3-920e-833f181cfe8b/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:181
1822024-12-06T20:40:19.962ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:189
1832024-12-06T20:40:19.962ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:189
1842024-12-06T20:40:19.962ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:189
1852024-12-06T20:40:19.962ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:195
1862024-12-06T20:40:20.138ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1872024-12-06T20:40:20.139ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 143.06043ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "a69bbe00-b3a4-479a-911b-1ad33e004965", "content-length": "124", "date": "Fri, 06 Dec 2024 20:40:19 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "a69bbe00-b3a4-479a-911b-1ad33e004965" } file = clients/ddm-admin-client/src/lib.rs:177
1882024-12-06T20:40:20.283ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1892024-12-06T20:40:20.283ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 281.743278ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "6a316590-0a17-4e32-aaf7-7cf6aa03f941", "content-length": "124", "date": "Fri, 06 Dec 2024 20:40:19 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "6a316590-0a17-4e32-aaf7-7cf6aa03f941" } file = clients/ddm-admin-client/src/lib.rs:177
1902024-12-06T20:40:20.566ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1912024-12-06T20:40:20.566ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 368.966949ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "45299297-5cc3-4805-89a1-fdd614addf6a", "content-length": "124", "date": "Fri, 06 Dec 2024 20:40:20 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "45299297-5cc3-4805-89a1-fdd614addf6a" } file = clients/ddm-admin-client/src/lib.rs:177
1922024-12-06T20:40:20.713ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:93 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
1932024-12-06T20:40:20.718ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:45033 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
1942024-12-06T20:40:20.718ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
1952024-12-06T20:40:20.718ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:45033 file = oximeter/producer/src/lib.rs:279 interval = 30s producer_id = 0a667526-2006-419e-9b68-c251fd138c06 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
1962024-12-06T20:40:20.719ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 131.368115ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
1972024-12-06T20:40:20.720ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
1982024-12-06T20:40:20.720ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
1992024-12-06T20:40:20.721ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:920 underlay_address = fd00:1122:3344:101::1
2002024-12-06T20:40:20.721ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
2012024-12-06T20:40:20.853ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 354.524921ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
2022024-12-06T20:40:20.936ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
2032024-12-06T20:40:21.209ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.171168182s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
2042024-12-06T20:40:22.382ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.310904903s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
2052024-12-06T20:40:23.300ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2668
2062024-12-06T20:40:23.300ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2913
2072024-12-06T20:40:23.300ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2538
2082024-12-06T20:40:23.300ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2585
2092024-12-06T20:40:23.300ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:2994
2102024-12-06T20:40:23.300ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3039
2112024-12-06T20:40:23.302ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2838
2122024-12-06T20:40:23.303ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2579
2132024-12-06T20:40:23.303ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='21d3884d-c425-422a-ae8e-bf5970acf94d'/> <propval type="astring" name="rack_id" value='06ed6b43-f7cd-4ed6-8c86-7494248aa355'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:a02a::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:feb9:1ddd'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:a02a::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"sock","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="rack_id" value='06ed6b43-f7cd-4ed6-8c86-7494248aa355'/> <propval type="astring" name="sled_id" value='0a667526-2006-419e-9b68-c251fd138c06'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='sock'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="host" value='[::1]'/> <propval type="astring" name="port" value='12224'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='sock'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='0a667526-2006-419e-9b68-c251fd138c06'/> <propval type="astring" name="rack_uuid" value='06ed6b43-f7cd-4ed6-8c86-7494248aa355'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='0a667526-2006-419e-9b68-c251fd138c06'/> <propval type="astring" name="rack_uuid" value='06ed6b43-f7cd-4ed6-8c86-7494248aa355'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2142024-12-06T20:40:23.303ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_switch
2152024-12-06T20:40:23.549ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 30.938325ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2162024-12-06T20:40:23.761ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 142.146141ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2172024-12-06T20:40:23.762ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 5.683314713s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
2182024-12-06T20:40:23.945ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 118.608704ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2192024-12-06T20:40:24.119ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 554.414905ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2202024-12-06T20:40:24.741ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 468.7292ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2212024-12-06T20:40:25.370ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.423577757s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2222024-12-06T20:40:26.917ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 594.528006ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2232024-12-06T20:40:27.635ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.468396803s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2242024-12-06T20:40:29.365ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/0a667526-2006-419e-9b68-c251fd138c06) file = sled-agent/src/nexus.rs:527 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
2252024-12-06T20:40:29.396ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2262024-12-06T20:40:29.396ZINFOSledAgent (dropshot (Repo Depot)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12348 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
2272024-12-06T20:40:29.397ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12345
2282024-12-06T20:40:29.397ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:432
2292024-12-06T20:40:29.397ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2302024-12-06T20:40:29.397ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/b9ab18cf-4dd7-46c3-920e-833f181cfe8b/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2312024-12-06T20:40:29.397ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/5a719d2c-fbf6-41ef-af9f-e6b70820ebd4/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2322024-12-06T20:40:29.397ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2332024-12-06T20:40:29.398ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some(None), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None }], bgp: [], bfd: [] })))
2342024-12-06T20:40:29.398ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3947
2352024-12-06T20:40:29.398ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:a02a::1]:36817
2362024-12-06T20:40:29.593ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:a02a::1]:12346
2372024-12-06T20:40:29.593ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
2382024-12-06T20:40:29.595ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 8.0599581s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
2392024-12-06T20:40:29.599ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4268 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2402024-12-06T20:40:29.599ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:4284
2412024-12-06T20:40:29.599ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:534 zone = oxz_switch
2422024-12-06T20:40:29.882ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35450
2432024-12-06T20:40:29.883ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2442024-12-06T20:40:29.883ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2452024-12-06T20:40:29.883ZINFOSledAgent (ServiceManager): No ledger in /pool/int/b9ab18cf-4dd7-46c3-920e-833f181cfe8b/config/omicron-zones.json file = common/src/ledger.rs:188
2462024-12-06T20:40:29.883ZINFOSledAgent (ServiceManager): No ledger in /pool/int/5a719d2c-fbf6-41ef-af9f-e6b70820ebd4/config/omicron-zones.json file = common/src/ledger.rs:188
2472024-12-06T20:40:29.883ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 339 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:35450 req_id = 559d8410-099f-46c5-808c-63775f9d3c61 response_code = 200 uri = /inventory
2482024-12-06T20:40:29.913ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64715
2492024-12-06T20:40:29.914ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:64715 req_id = 1713adbb-17ae-4134-a254-790b384ca936 response_code = 200 uri = /sled-role
2502024-12-06T20:40:29.943ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: d236b983-169b-44eb-a4f2-4fc126f8f053 (physical_disk), pool_id: 50f60e54-9000-4b4d-8705-841b133128b0 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 0451c56a-695e-410e-9960-3bbe8c1b260a (physical_disk), pool_id: 99dfd90b-ff92-45e8-a73e-ada9e3f552c8 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 26b8e1f7-2779-4216-9049-ff010ad58ccb (physical_disk), pool_id: 3b3acf4c-a316-45ce-a055-ef8d6c8acdff (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 4aa20bb0-d502-4454-9fb7-c82d173d0a6c (physical_disk), pool_id: 5f5a9c7a-eec2-4e86-a02e-9238700fe7ab (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: cdff61b0-6544-4273-8139-7fc4dd5aaf0e (physical_disk), pool_id: 8e389ddd-65e9-4954-ab37-e305d4d4e112 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 41e1d94e-be08-4bb6-9a0c-67b0c820e5a7 (physical_disk), pool_id: f3f86fa8-b3a1-409b-95c8-f426058deed7 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 918f4c0d-984b-41ef-a08d-808ad515ae42 (physical_disk), pool_id: 2f3ff39c-4b18-4b96-8fb8-fbd672d6202f (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 353de02f-86de-4a08-a570-116af83edf28 (physical_disk), pool_id: 33ce0168-de47-475b-9a15-5a0cd6252cb6 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: ea61dc73-59e3-4211-a59e-4b1eaece2025 (physical_disk), pool_id: 43474e0b-a6d6-4842-bf66-1060f52875b1 (zpool) }] } file = sled-agent/src/rack_setup/service.rs:385 sled_address = [fd00:1122:3344:101::1]:12345
2512024-12-06T20:40:29.944ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39553
2522024-12-06T20:40:29.944ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:896 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
2532024-12-06T20:40:29.944ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: d236b983-169b-44eb-a4f2-4fc126f8f053 (physical_disk), pool_id: 50f60e54-9000-4b4d-8705-841b133128b0 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 0451c56a-695e-410e-9960-3bbe8c1b260a (physical_disk), pool_id: 99dfd90b-ff92-45e8-a73e-ada9e3f552c8 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 26b8e1f7-2779-4216-9049-ff010ad58ccb (physical_disk), pool_id: 3b3acf4c-a316-45ce-a055-ef8d6c8acdff (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 4aa20bb0-d502-4454-9fb7-c82d173d0a6c (physical_disk), pool_id: 5f5a9c7a-eec2-4e86-a02e-9238700fe7ab (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: cdff61b0-6544-4273-8139-7fc4dd5aaf0e (physical_disk), pool_id: 8e389ddd-65e9-4954-ab37-e305d4d4e112 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 41e1d94e-be08-4bb6-9a0c-67b0c820e5a7 (physical_disk), pool_id: f3f86fa8-b3a1-409b-95c8-f426058deed7 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 918f4c0d-984b-41ef-a08d-808ad515ae42 (physical_disk), pool_id: 2f3ff39c-4b18-4b96-8fb8-fbd672d6202f (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 353de02f-86de-4a08-a570-116af83edf28 (physical_disk), pool_id: 33ce0168-de47-475b-9a15-5a0cd6252cb6 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: ea61dc73-59e3-4211-a59e-4b1eaece2025 (physical_disk), pool_id: 43474e0b-a6d6-4842-bf66-1060f52875b1 (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:603
2542024-12-06T20:40:29.944ZINFOSledAgent (StorageManager): No ledger in /pool/int/b9ab18cf-4dd7-46c3-920e-833f181cfe8b/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2552024-12-06T20:40:29.944ZINFOSledAgent (StorageManager): No ledger in /pool/int/5a719d2c-fbf6-41ef-af9f-e6b70820ebd4/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2562024-12-06T20:40:29.944ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:1171 request = omicron_physical_disks_ensure
2572024-12-06T20:40:29.944ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2582024-12-06T20:40:29.944ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2592024-12-06T20:40:29.944ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2602024-12-06T20:40:29.944ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2612024-12-06T20:40:30.084ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:367
2622024-12-06T20:40:30.084ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 50f60e54-9000-4b4d-8705-841b133128b0 (zpool)
2632024-12-06T20:40:30.526ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/0a667526-2006-419e-9b68-c251fd138c06) file = sled-agent/src/probe_manager.rs:231 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
2642024-12-06T20:40:30.743ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
2652024-12-06T20:40:30.744ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1717597047978050345 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
2662024-12-06T20:40:30.745ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13509151622581770401 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
2672024-12-06T20:40:30.793ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 50f60e54-9000-4b4d-8705-841b133128b0 (zpool), kind: External }
2682024-12-06T20:40:30.801ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:240
2692024-12-06T20:40:30.801ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:242
2702024-12-06T20:40:30.801ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:246
2712024-12-06T20:40:30.801ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:248
2722024-12-06T20:40:30.801ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2732024-12-06T20:40:30.801ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2742024-12-06T20:40:30.801ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
2752024-12-06T20:40:30.835ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2762024-12-06T20:40:30.843ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_50f60e54-9000-4b4d-8705-841b133128b0/crypt/zone file = sled-storage/src/dataset.rs:303
2772024-12-06T20:40:31.011ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_50f60e54-9000-4b4d-8705-841b133128b0 file = sled-storage/src/dataset.rs:389
2782024-12-06T20:40:31.019ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
2792024-12-06T20:40:31.019ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
2802024-12-06T20:40:31.019ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
2812024-12-06T20:40:31.019ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2822024-12-06T20:40:31.019ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2832024-12-06T20:40:31.029ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:367
2842024-12-06T20:40:31.029ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 99dfd90b-ff92-45e8-a73e-ada9e3f552c8 (zpool)
2852024-12-06T20:40:31.128ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 99dfd90b-ff92-45e8-a73e-ada9e3f552c8 (zpool), kind: External }
2862024-12-06T20:40:31.137ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:240
2872024-12-06T20:40:31.137ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:242
2882024-12-06T20:40:31.137ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:246
2892024-12-06T20:40:31.137ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:248
2902024-12-06T20:40:31.137ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2912024-12-06T20:40:31.137ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2922024-12-06T20:40:31.137ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
2932024-12-06T20:40:31.173ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2942024-12-06T20:40:31.182ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_99dfd90b-ff92-45e8-a73e-ada9e3f552c8/crypt/zone file = sled-storage/src/dataset.rs:303
2952024-12-06T20:40:31.357ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_99dfd90b-ff92-45e8-a73e-ada9e3f552c8 file = sled-storage/src/dataset.rs:389
2962024-12-06T20:40:31.365ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
2972024-12-06T20:40:31.365ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
2982024-12-06T20:40:31.365ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
2992024-12-06T20:40:31.365ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3002024-12-06T20:40:31.365ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3012024-12-06T20:40:31.375ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:367
3022024-12-06T20:40:31.375ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 3b3acf4c-a316-45ce-a055-ef8d6c8acdff (zpool)
3032024-12-06T20:40:31.467ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 3b3acf4c-a316-45ce-a055-ef8d6c8acdff (zpool), kind: External }
3042024-12-06T20:40:31.475ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:240
3052024-12-06T20:40:31.475ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:242
3062024-12-06T20:40:31.475ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:246
3072024-12-06T20:40:31.475ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:248
3082024-12-06T20:40:31.475ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3092024-12-06T20:40:31.475ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3102024-12-06T20:40:31.475ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3112024-12-06T20:40:31.510ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3122024-12-06T20:40:31.518ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_3b3acf4c-a316-45ce-a055-ef8d6c8acdff/crypt/zone file = sled-storage/src/dataset.rs:303
3132024-12-06T20:40:31.530ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/0a667526-2006-419e-9b68-c251fd138c06) file = sled-agent/src/probe_manager.rs:231 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
3142024-12-06T20:40:31.691ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_3b3acf4c-a316-45ce-a055-ef8d6c8acdff file = sled-storage/src/dataset.rs:389
3152024-12-06T20:40:31.698ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3162024-12-06T20:40:31.698ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3172024-12-06T20:40:31.698ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3182024-12-06T20:40:31.698ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3192024-12-06T20:40:31.699ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3202024-12-06T20:40:31.709ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:367
3212024-12-06T20:40:31.709ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 5f5a9c7a-eec2-4e86-a02e-9238700fe7ab (zpool)
3222024-12-06T20:40:31.803ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 5f5a9c7a-eec2-4e86-a02e-9238700fe7ab (zpool), kind: External }
3232024-12-06T20:40:31.811ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:240
3242024-12-06T20:40:31.811ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:242
3252024-12-06T20:40:31.811ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:246
3262024-12-06T20:40:31.811ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:248
3272024-12-06T20:40:31.811ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3282024-12-06T20:40:31.811ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3292024-12-06T20:40:31.811ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3302024-12-06T20:40:31.845ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3312024-12-06T20:40:31.853ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_5f5a9c7a-eec2-4e86-a02e-9238700fe7ab/crypt/zone file = sled-storage/src/dataset.rs:303
3322024-12-06T20:40:32.032ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_5f5a9c7a-eec2-4e86-a02e-9238700fe7ab file = sled-storage/src/dataset.rs:389
3332024-12-06T20:40:32.040ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3342024-12-06T20:40:32.040ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3352024-12-06T20:40:32.040ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3362024-12-06T20:40:32.040ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3372024-12-06T20:40:32.040ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3382024-12-06T20:40:32.049ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:367
3392024-12-06T20:40:32.050ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 8e389ddd-65e9-4954-ab37-e305d4d4e112 (zpool)
3402024-12-06T20:40:32.141ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 8e389ddd-65e9-4954-ab37-e305d4d4e112 (zpool), kind: External }
3412024-12-06T20:40:32.148ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:240
3422024-12-06T20:40:32.148ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:242
3432024-12-06T20:40:32.148ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:246
3442024-12-06T20:40:32.148ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:248
3452024-12-06T20:40:32.148ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3462024-12-06T20:40:32.148ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3472024-12-06T20:40:32.148ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3482024-12-06T20:40:32.182ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3492024-12-06T20:40:32.190ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_8e389ddd-65e9-4954-ab37-e305d4d4e112/crypt/zone file = sled-storage/src/dataset.rs:303
3502024-12-06T20:40:32.362ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_8e389ddd-65e9-4954-ab37-e305d4d4e112 file = sled-storage/src/dataset.rs:389
3512024-12-06T20:40:32.369ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3522024-12-06T20:40:32.369ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3532024-12-06T20:40:32.369ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3542024-12-06T20:40:32.369ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3552024-12-06T20:40:32.369ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3562024-12-06T20:40:32.380ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:367
3572024-12-06T20:40:32.380ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = f3f86fa8-b3a1-409b-95c8-f426058deed7 (zpool)
3582024-12-06T20:40:32.474ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: f3f86fa8-b3a1-409b-95c8-f426058deed7 (zpool), kind: External }
3592024-12-06T20:40:32.482ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:240
3602024-12-06T20:40:32.482ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:242
3612024-12-06T20:40:32.482ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:246
3622024-12-06T20:40:32.482ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:248
3632024-12-06T20:40:32.482ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3642024-12-06T20:40:32.483ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3652024-12-06T20:40:32.483ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3662024-12-06T20:40:32.517ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3672024-12-06T20:40:32.525ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_f3f86fa8-b3a1-409b-95c8-f426058deed7/crypt/zone file = sled-storage/src/dataset.rs:303
3682024-12-06T20:40:32.532ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/0a667526-2006-419e-9b68-c251fd138c06) file = sled-agent/src/probe_manager.rs:231 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
3692024-12-06T20:40:32.705ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_f3f86fa8-b3a1-409b-95c8-f426058deed7 file = sled-storage/src/dataset.rs:389
3702024-12-06T20:40:32.714ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3712024-12-06T20:40:32.714ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3722024-12-06T20:40:32.714ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3732024-12-06T20:40:32.714ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3742024-12-06T20:40:32.714ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3752024-12-06T20:40:32.725ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:367
3762024-12-06T20:40:32.725ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 2f3ff39c-4b18-4b96-8fb8-fbd672d6202f (zpool)
3772024-12-06T20:40:32.819ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 2f3ff39c-4b18-4b96-8fb8-fbd672d6202f (zpool), kind: External }
3782024-12-06T20:40:32.827ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:240
3792024-12-06T20:40:32.827ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:242
3802024-12-06T20:40:32.827ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:246
3812024-12-06T20:40:32.827ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:248
3822024-12-06T20:40:32.827ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3832024-12-06T20:40:32.828ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3842024-12-06T20:40:32.828ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3852024-12-06T20:40:32.862ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3862024-12-06T20:40:32.871ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_2f3ff39c-4b18-4b96-8fb8-fbd672d6202f/crypt/zone file = sled-storage/src/dataset.rs:303
3872024-12-06T20:40:33.048ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_2f3ff39c-4b18-4b96-8fb8-fbd672d6202f file = sled-storage/src/dataset.rs:389
3882024-12-06T20:40:33.058ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
3892024-12-06T20:40:33.058ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
3902024-12-06T20:40:33.058ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
3912024-12-06T20:40:33.058ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3922024-12-06T20:40:33.058ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
3932024-12-06T20:40:33.068ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:367
3942024-12-06T20:40:33.068ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 33ce0168-de47-475b-9a15-5a0cd6252cb6 (zpool)
3952024-12-06T20:40:33.163ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 33ce0168-de47-475b-9a15-5a0cd6252cb6 (zpool), kind: External }
3962024-12-06T20:40:33.171ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:240
3972024-12-06T20:40:33.171ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:242
3982024-12-06T20:40:33.171ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:246
3992024-12-06T20:40:33.171ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:248
4002024-12-06T20:40:33.171ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4012024-12-06T20:40:33.171ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4022024-12-06T20:40:33.171ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
4032024-12-06T20:40:33.207ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4042024-12-06T20:40:33.215ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_33ce0168-de47-475b-9a15-5a0cd6252cb6/crypt/zone file = sled-storage/src/dataset.rs:303
4052024-12-06T20:40:33.398ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_33ce0168-de47-475b-9a15-5a0cd6252cb6 file = sled-storage/src/dataset.rs:389
4062024-12-06T20:40:33.406ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
4072024-12-06T20:40:33.406ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4082024-12-06T20:40:33.406ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4092024-12-06T20:40:33.406ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4102024-12-06T20:40:33.406ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4112024-12-06T20:40:33.416ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:367
4122024-12-06T20:40:33.416ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 43474e0b-a6d6-4842-bf66-1060f52875b1 (zpool)
4132024-12-06T20:40:33.514ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 43474e0b-a6d6-4842-bf66-1060f52875b1 (zpool), kind: External }
4142024-12-06T20:40:33.522ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:240
4152024-12-06T20:40:33.522ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:242
4162024-12-06T20:40:33.522ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:246
4172024-12-06T20:40:33.522ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:248
4182024-12-06T20:40:33.522ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4192024-12-06T20:40:33.523ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4202024-12-06T20:40:33.523ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
4212024-12-06T20:40:33.534ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/0a667526-2006-419e-9b68-c251fd138c06) file = sled-agent/src/probe_manager.rs:231 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
4222024-12-06T20:40:33.558ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4232024-12-06T20:40:33.567ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_43474e0b-a6d6-4842-bf66-1060f52875b1/crypt/zone file = sled-storage/src/dataset.rs:303
4242024-12-06T20:40:33.741ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_43474e0b-a6d6-4842-bf66-1060f52875b1 file = sled-storage/src/dataset.rs:389
4252024-12-06T20:40:33.751ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4262024-12-06T20:40:33.751ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4272024-12-06T20:40:33.751ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/b9ab18cf-4dd7-46c3-920e-833f181cfe8b/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4282024-12-06T20:40:33.751ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(2), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b9ab18cf-4dd7-46c3-920e-833f181cfe8b (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 5a719d2c-fbf6-41ef-af9f-e6b70820ebd4 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 50f60e54-9000-4b4d-8705-841b133128b0 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 99dfd90b-ff92-45e8-a73e-ada9e3f552c8 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 3b3acf4c-a316-45ce-a055-ef8d6c8acdff (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 5f5a9c7a-eec2-4e86-a02e-9238700fe7ab (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8e389ddd-65e9-4954-ab37-e305d4d4e112 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f3f86fa8-b3a1-409b-95c8-f426058deed7 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 2f3ff39c-4b18-4b96-8fb8-fbd672d6202f (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 33ce0168-de47-475b-9a15-5a0cd6252cb6 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 43474e0b-a6d6-4842-bf66-1060f52875b1 (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4292024-12-06T20:40:33.751ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
4302024-12-06T20:40:33.751ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
4312024-12-06T20:40:33.751ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/5a719d2c-fbf6-41ef-af9f-e6b70820ebd4/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4322024-12-06T20:40:33.751ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:900 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
4332024-12-06T20:40:33.751ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
4342024-12-06T20:40:33.751ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:926 generation = Generation(2) sled_id = 0a667526-2006-419e-9b68-c251fd138c06
4352024-12-06T20:40:33.751ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:931 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
4362024-12-06T20:40:33.751ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:936 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
4372024-12-06T20:40:33.751ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:122 gen = Generation(2) sled_id = 0a667526-2006-419e-9b68-c251fd138c06
4382024-12-06T20:40:33.751ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:942 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
4392024-12-06T20:40:33.751ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(2)
4402024-12-06T20:40:33.751ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:947 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
4412024-12-06T20:40:33.752ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3807952 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:39553 req_id = 3287fb09-9104-4f38-86b8-d76d29978625 response_code = 200 uri = /omicron-physical-disks
4422024-12-06T20:40:33.783ZINFOSledAgent (RSS): attempting to set up sled's datasets: DatasetsConfig { generation: Generation(1), datasets: {059c36d9-8100-422b-bd52-7a69bcf065e7 (dataset): DatasetConfig { id: 059c36d9-8100-422b-bd52-7a69bcf065e7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8e389ddd-65e9-4954-ab37-e305d4d4e112 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_31a5acd7-f1f6-4683-a49e-44e34c5f6914" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 06a73711-f77c-4ea9-b417-1c1549dff17f (dataset): DatasetConfig { id: 06a73711-f77c-4ea9-b417-1c1549dff17f (dataset), name: DatasetName { pool_name: ZpoolName { id: 5f5a9c7a-eec2-4e86-a02e-9238700fe7ab (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0cfbd23e-030f-450b-afd3-7dda4ed4fa8a (dataset): DatasetConfig { id: 0cfbd23e-030f-450b-afd3-7dda4ed4fa8a (dataset), name: DatasetName { pool_name: ZpoolName { id: 99dfd90b-ff92-45e8-a73e-ada9e3f552c8 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0fd286ee-0d84-4cff-84ac-f6b4bca24884 (dataset): DatasetConfig { id: 0fd286ee-0d84-4cff-84ac-f6b4bca24884 (dataset), name: DatasetName { pool_name: ZpoolName { id: f3f86fa8-b3a1-409b-95c8-f426058deed7 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_17a27890-edd1-41a9-b5f3-c1b01576ff0e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 10aa68a3-d9ae-4c07-99ed-4af827b57c43 (dataset): DatasetConfig { id: 10aa68a3-d9ae-4c07-99ed-4af827b57c43 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5f5a9c7a-eec2-4e86-a02e-9238700fe7ab (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1b2c566e-5251-48cc-b8b1-2b2481f9c4e0 (dataset): DatasetConfig { id: 1b2c566e-5251-48cc-b8b1-2b2481f9c4e0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 50f60e54-9000-4b4d-8705-841b133128b0 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_0df5e14a-6e1e-4dcd-bf05-d67f92d30034" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2245ec88-39be-4c10-bcb0-dc5be8ce3703 (dataset): DatasetConfig { id: 2245ec88-39be-4c10-bcb0-dc5be8ce3703 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8e389ddd-65e9-4954-ab37-e305d4d4e112 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 25c91089-1823-4b57-87a1-5f9fe1f5708a (dataset): DatasetConfig { id: 25c91089-1823-4b57-87a1-5f9fe1f5708a (dataset), name: DatasetName { pool_name: ZpoolName { id: 99dfd90b-ff92-45e8-a73e-ada9e3f552c8 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_9d99eda0-389f-44c6-94ee-e9e7a03c9733" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2963cbd0-029d-4eda-b2aa-6186e4f414d8 (dataset): DatasetConfig { id: 2963cbd0-029d-4eda-b2aa-6186e4f414d8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 99dfd90b-ff92-45e8-a73e-ada9e3f552c8 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3042c7f0-26ac-4e37-aca8-de3eceebb505 (dataset): DatasetConfig { id: 3042c7f0-26ac-4e37-aca8-de3eceebb505 (dataset), name: DatasetName { pool_name: ZpoolName { id: 99dfd90b-ff92-45e8-a73e-ada9e3f552c8 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_196fdb83-e76c-47d9-a9ee-d0429aa71154" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 33345c01-02ce-4080-b9b0-7b369831e8ca (dataset): DatasetConfig { id: 33345c01-02ce-4080-b9b0-7b369831e8ca (dataset), name: DatasetName { pool_name: ZpoolName { id: 3b3acf4c-a316-45ce-a055-ef8d6c8acdff (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 38617dd4-e6dc-4a3c-82b3-0f7edb963638 (dataset): DatasetConfig { id: 38617dd4-e6dc-4a3c-82b3-0f7edb963638 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8e389ddd-65e9-4954-ab37-e305d4d4e112 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_27229a74-6d47-442c-a7ab-393b73cf74df" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3ac99213-a349-479d-bc4f-48b96f0652e8 (dataset): DatasetConfig { id: 3ac99213-a349-479d-bc4f-48b96f0652e8 (dataset), name: DatasetName { pool_name: ZpoolName { id: f3f86fa8-b3a1-409b-95c8-f426058deed7 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 3bc010e2-bf5e-48ee-8d9c-a5814955a89d (dataset): DatasetConfig { id: 3bc010e2-bf5e-48ee-8d9c-a5814955a89d (dataset), name: DatasetName { pool_name: ZpoolName { id: 3b3acf4c-a316-45ce-a055-ef8d6c8acdff (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_e9fe68b0-d53c-4161-a621-681677d5b0d6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3d68ccf6-5c67-4927-a5b8-969bd86c619e (dataset): DatasetConfig { id: 3d68ccf6-5c67-4927-a5b8-969bd86c619e (dataset), name: DatasetName { pool_name: ZpoolName { id: 99dfd90b-ff92-45e8-a73e-ada9e3f552c8 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 4086497c-78f7-481a-9fc9-542a4fd224b7 (dataset): DatasetConfig { id: 4086497c-78f7-481a-9fc9-542a4fd224b7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3b3acf4c-a316-45ce-a055-ef8d6c8acdff (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_3965e738-3305-4fcd-9da0-4c6e0ce7edc1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 486c0d02-343a-4568-b43c-849e61f45ce4 (dataset): DatasetConfig { id: 486c0d02-343a-4568-b43c-849e61f45ce4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5f5a9c7a-eec2-4e86-a02e-9238700fe7ab (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_bef145b4-2934-45c3-870a-63d45572bde4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4b52f012-e85b-43cb-b065-c70780747d99 (dataset): DatasetConfig { id: 4b52f012-e85b-43cb-b065-c70780747d99 (dataset), name: DatasetName { pool_name: ZpoolName { id: 50f60e54-9000-4b4d-8705-841b133128b0 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_44e0594e-e8fa-4a38-8f8c-bcb6ceccc555" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4e64f3c9-1029-4b99-89b4-294ac8baa81c (dataset): DatasetConfig { id: 4e64f3c9-1029-4b99-89b4-294ac8baa81c (dataset), name: DatasetName { pool_name: ZpoolName { id: 3b3acf4c-a316-45ce-a055-ef8d6c8acdff (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4f52bf89-d78d-43db-a8d8-2eeeac7fb1ed (dataset): DatasetConfig { id: 4f52bf89-d78d-43db-a8d8-2eeeac7fb1ed (dataset), name: DatasetName { pool_name: ZpoolName { id: 99dfd90b-ff92-45e8-a73e-ada9e3f552c8 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4f8678cd-53d2-4257-9925-97f0b3e7f85e (dataset): DatasetConfig { id: 4f8678cd-53d2-4257-9925-97f0b3e7f85e (dataset), name: DatasetName { pool_name: ZpoolName { id: 50f60e54-9000-4b4d-8705-841b133128b0 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_04023147-2580-4e6f-a338-23a2e1e895fc" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 51d348c9-ee4f-46f2-928b-35aa5474b1f7 (dataset): DatasetConfig { id: 51d348c9-ee4f-46f2-928b-35aa5474b1f7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8e389ddd-65e9-4954-ab37-e305d4d4e112 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5338feaa-afc0-4c20-95df-55bb8f76a8f0 (dataset): DatasetConfig { id: 5338feaa-afc0-4c20-95df-55bb8f76a8f0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 50f60e54-9000-4b4d-8705-841b133128b0 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 56f44c09-d495-4f0e-b996-cc2d5b63bf1f (dataset): DatasetConfig { id: 56f44c09-d495-4f0e-b996-cc2d5b63bf1f (dataset), name: DatasetName { pool_name: ZpoolName { id: 99dfd90b-ff92-45e8-a73e-ada9e3f552c8 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_0525204b-63bb-4f1b-be27-505477f54f5d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 594e2203-5a56-48b6-9652-0985d5d4ce6a (dataset): DatasetConfig { id: 594e2203-5a56-48b6-9652-0985d5d4ce6a (dataset), name: DatasetName { pool_name: ZpoolName { id: 50f60e54-9000-4b4d-8705-841b133128b0 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 68bb7f28-24ac-4636-ae85-b861449794b8 (dataset): DatasetConfig { id: 68bb7f28-24ac-4636-ae85-b861449794b8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2f3ff39c-4b18-4b96-8fb8-fbd672d6202f (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6da86879-563b-417e-8489-e35b55a9ab57 (dataset): DatasetConfig { id: 6da86879-563b-417e-8489-e35b55a9ab57 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3b3acf4c-a316-45ce-a055-ef8d6c8acdff (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 70e5ff0e-657d-4438-99c3-13748a227e5c (dataset): DatasetConfig { id: 70e5ff0e-657d-4438-99c3-13748a227e5c (dataset), name: DatasetName { pool_name: ZpoolName { id: 5f5a9c7a-eec2-4e86-a02e-9238700fe7ab (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 717f2e41-a56e-4115-aae4-4cf70d6e94b6 (dataset): DatasetConfig { id: 717f2e41-a56e-4115-aae4-4cf70d6e94b6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 50f60e54-9000-4b4d-8705-841b133128b0 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_4e6cf073-224e-417c-8875-16567605c2be" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 72945d39-1570-4b88-9991-d61e1367bfb9 (dataset): DatasetConfig { id: 72945d39-1570-4b88-9991-d61e1367bfb9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3b3acf4c-a316-45ce-a055-ef8d6c8acdff (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 745ef6e0-90bc-4aca-95cc-b9c3a6bace1a (dataset): DatasetConfig { id: 745ef6e0-90bc-4aca-95cc-b9c3a6bace1a (dataset), name: DatasetName { pool_name: ZpoolName { id: 43474e0b-a6d6-4842-bf66-1060f52875b1 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_2e418c90-5369-4643-83ad-18cceb9dcb5f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 76fc149b-bfe7-4928-9667-9d874014ab52 (dataset): DatasetConfig { id: 76fc149b-bfe7-4928-9667-9d874014ab52 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3b3acf4c-a316-45ce-a055-ef8d6c8acdff (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_eb71a443-d6ff-40d1-b0f6-d5e30927d1c2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7af3748f-3021-4893-9cef-48a39d685989 (dataset): DatasetConfig { id: 7af3748f-3021-4893-9cef-48a39d685989 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8e389ddd-65e9-4954-ab37-e305d4d4e112 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7f757ed2-653f-4630-81f9-5098ec6ad811 (dataset): DatasetConfig { id: 7f757ed2-653f-4630-81f9-5098ec6ad811 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3b3acf4c-a316-45ce-a055-ef8d6c8acdff (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8a115096-37ef-4e21-b9ae-8957f5935b0c (dataset): DatasetConfig { id: 8a115096-37ef-4e21-b9ae-8957f5935b0c (dataset), name: DatasetName { pool_name: ZpoolName { id: 33ce0168-de47-475b-9a15-5a0cd6252cb6 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8b1d124a-c129-4e48-8f02-ff8316ce8bd2 (dataset): DatasetConfig { id: 8b1d124a-c129-4e48-8f02-ff8316ce8bd2 (dataset), name: DatasetName { pool_name: ZpoolName { id: f3f86fa8-b3a1-409b-95c8-f426058deed7 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 95fb3e18-9a67-43a8-aa77-59173c616da2 (dataset): DatasetConfig { id: 95fb3e18-9a67-43a8-aa77-59173c616da2 (dataset), name: DatasetName { pool_name: ZpoolName { id: f3f86fa8-b3a1-409b-95c8-f426058deed7 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 98b6ab76-46ff-40fa-a380-e4ee89abe89c (dataset): DatasetConfig { id: 98b6ab76-46ff-40fa-a380-e4ee89abe89c (dataset), name: DatasetName { pool_name: ZpoolName { id: 2f3ff39c-4b18-4b96-8fb8-fbd672d6202f (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 99e9ed9c-3bea-49ba-ba81-148d24e28208 (dataset): DatasetConfig { id: 99e9ed9c-3bea-49ba-ba81-148d24e28208 (dataset), name: DatasetName { pool_name: ZpoolName { id: 50f60e54-9000-4b4d-8705-841b133128b0 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_fd12fb4f-e62d-4cab-a4bd-2024f2546d3b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9efcd235-af24-47cd-9d9d-da21357251e0 (dataset): DatasetConfig { id: 9efcd235-af24-47cd-9d9d-da21357251e0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5f5a9c7a-eec2-4e86-a02e-9238700fe7ab (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_c26c9d62-aefd-4ced-b0e7-da16bf299c4d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a4133a75-0a90-4597-99be-598e4f9c12e4 (dataset): DatasetConfig { id: a4133a75-0a90-4597-99be-598e4f9c12e4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 43474e0b-a6d6-4842-bf66-1060f52875b1 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, a62d4d01-ad77-467e-93ae-ad326209c378 (dataset): DatasetConfig { id: a62d4d01-ad77-467e-93ae-ad326209c378 (dataset), name: DatasetName { pool_name: ZpoolName { id: 33ce0168-de47-475b-9a15-5a0cd6252cb6 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a647ceb1-cdc7-4e5c-a77d-e272f3ee6923 (dataset): DatasetConfig { id: a647ceb1-cdc7-4e5c-a77d-e272f3ee6923 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3b3acf4c-a316-45ce-a055-ef8d6c8acdff (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_de82b1e5-5cfb-423c-b612-e6e5e77c021f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a96dbb37-9866-45be-8bf1-8aeafe78d35e (dataset): DatasetConfig { id: a96dbb37-9866-45be-8bf1-8aeafe78d35e (dataset), name: DatasetName { pool_name: ZpoolName { id: 43474e0b-a6d6-4842-bf66-1060f52875b1 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a9b68154-dcee-4138-84e8-74180d4f044f (dataset): DatasetConfig { id: a9b68154-dcee-4138-84e8-74180d4f044f (dataset), name: DatasetName { pool_name: ZpoolName { id: f3f86fa8-b3a1-409b-95c8-f426058deed7 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_1049fe89-11bc-49dd-aec6-8ba72a4bf488" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, aacbbc5e-7bde-4194-91cb-362b4cecd33d (dataset): DatasetConfig { id: aacbbc5e-7bde-4194-91cb-362b4cecd33d (dataset), name: DatasetName { pool_name: ZpoolName { id: 99dfd90b-ff92-45e8-a73e-ada9e3f552c8 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ab7a3fe0-0826-448e-8c92-71f37d886a12 (dataset): DatasetConfig { id: ab7a3fe0-0826-448e-8c92-71f37d886a12 (dataset), name: DatasetName { pool_name: ZpoolName { id: 99dfd90b-ff92-45e8-a73e-ada9e3f552c8 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_46c53ce3-fed2-4b43-8728-cae9919088d1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b5177748-b84b-46cf-b329-cfa54f72157f (dataset): DatasetConfig { id: b5177748-b84b-46cf-b329-cfa54f72157f (dataset), name: DatasetName { pool_name: ZpoolName { id: 43474e0b-a6d6-4842-bf66-1060f52875b1 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b6fc9ea5-820e-4c66-8508-d78a94466a10 (dataset): DatasetConfig { id: b6fc9ea5-820e-4c66-8508-d78a94466a10 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8e389ddd-65e9-4954-ab37-e305d4d4e112 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, bce75a20-4a7b-4847-bb75-d5ff15996295 (dataset): DatasetConfig { id: bce75a20-4a7b-4847-bb75-d5ff15996295 (dataset), name: DatasetName { pool_name: ZpoolName { id: 50f60e54-9000-4b4d-8705-841b133128b0 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c37be615-5791-4384-961c-7a1656e2baa2 (dataset): DatasetConfig { id: c37be615-5791-4384-961c-7a1656e2baa2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 99dfd90b-ff92-45e8-a73e-ada9e3f552c8 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d08074c5-2587-4bfb-aaab-091962539b60 (dataset): DatasetConfig { id: d08074c5-2587-4bfb-aaab-091962539b60 (dataset), name: DatasetName { pool_name: ZpoolName { id: 43474e0b-a6d6-4842-bf66-1060f52875b1 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_b2591895-3ac4-4a5b-8bab-97ad5b9d077c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d69453e7-a201-4c3e-a8f6-ede4936aebf7 (dataset): DatasetConfig { id: d69453e7-a201-4c3e-a8f6-ede4936aebf7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 50f60e54-9000-4b4d-8705-841b133128b0 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dbb1717e-00b8-42f8-8ccf-11bef6242771 (dataset): DatasetConfig { id: dbb1717e-00b8-42f8-8ccf-11bef6242771 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5f5a9c7a-eec2-4e86-a02e-9238700fe7ab (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_19f9def9-3a42-4f07-8788-385d13f17c0a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dc903df3-cb30-474c-bf59-47d681ed3c07 (dataset): DatasetConfig { id: dc903df3-cb30-474c-bf59-47d681ed3c07 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2f3ff39c-4b18-4b96-8fb8-fbd672d6202f (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_84c4aae6-8e5d-40c4-b5db-027cbd5c5b06" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e1c8ac2e-9115-4d86-9162-f15c14c522fc (dataset): DatasetConfig { id: e1c8ac2e-9115-4d86-9162-f15c14c522fc (dataset), name: DatasetName { pool_name: ZpoolName { id: 3b3acf4c-a316-45ce-a055-ef8d6c8acdff (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_ba33747a-8bf5-489f-aaf5-20508b581f0f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e245fd86-f686-4deb-bf5c-aacbee052ae4 (dataset): DatasetConfig { id: e245fd86-f686-4deb-bf5c-aacbee052ae4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5f5a9c7a-eec2-4e86-a02e-9238700fe7ab (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e2df87b4-06f4-475c-ad4b-5cb1acb559ab (dataset): DatasetConfig { id: e2df87b4-06f4-475c-ad4b-5cb1acb559ab (dataset), name: DatasetName { pool_name: ZpoolName { id: 2f3ff39c-4b18-4b96-8fb8-fbd672d6202f (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e3870899-b32f-487a-a272-262ea774e6d6 (dataset): DatasetConfig { id: e3870899-b32f-487a-a272-262ea774e6d6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 99dfd90b-ff92-45e8-a73e-ada9e3f552c8 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_f0d51dc5-eec8-4f23-825b-ece452653cf1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e6941c27-88f1-426c-9572-a2aac9f0d7e4 (dataset): DatasetConfig { id: e6941c27-88f1-426c-9572-a2aac9f0d7e4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 50f60e54-9000-4b4d-8705-841b133128b0 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ed4b52d2-4407-4f3c-a1be-8e295d468fcd (dataset): DatasetConfig { id: ed4b52d2-4407-4f3c-a1be-8e295d468fcd (dataset), name: DatasetName { pool_name: ZpoolName { id: 33ce0168-de47-475b-9a15-5a0cd6252cb6 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_ed55ef04-a7c0-4b4e-ac1e-21d76b03e495" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f42cc23b-244e-4eb1-ae1f-e0cc686628c2 (dataset): DatasetConfig { id: f42cc23b-244e-4eb1-ae1f-e0cc686628c2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 50f60e54-9000-4b4d-8705-841b133128b0 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f4a89e14-bd0b-4db4-af02-6ddd0d59bc08 (dataset): DatasetConfig { id: f4a89e14-bd0b-4db4-af02-6ddd0d59bc08 (dataset), name: DatasetName { pool_name: ZpoolName { id: 50f60e54-9000-4b4d-8705-841b133128b0 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fb2e9ab9-a572-4901-80f7-edd8fb48be91 (dataset): DatasetConfig { id: fb2e9ab9-a572-4901-80f7-edd8fb48be91 (dataset), name: DatasetName { pool_name: ZpoolName { id: 33ce0168-de47-475b-9a15-5a0cd6252cb6 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, fe0fb26f-7fef-4607-a4b5-d309313364e1 (dataset): DatasetConfig { id: fe0fb26f-7fef-4607-a4b5-d309313364e1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 50f60e54-9000-4b4d-8705-841b133128b0 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_59b92633-3550-4af1-b628-503b6bafd00d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fe4e8646-87bc-4168-9b28-ba530be8f8fe (dataset): DatasetConfig { id: fe4e8646-87bc-4168-9b28-ba530be8f8fe (dataset), name: DatasetName { pool_name: ZpoolName { id: 3b3acf4c-a316-45ce-a055-ef8d6c8acdff (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_2372a96e-6bc5-4e12-9310-7e2f7c4121e7" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} } file = sled-agent/src/rack_setup/service.rs:460 sled_address = [fd00:1122:3344:101::1]:12345
4432024-12-06T20:40:33.783ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64301
4442024-12-06T20:40:33.784ZINFOSledAgent: datasets ensure file = sled-agent/src/sled_agent.rs:862 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
4452024-12-06T20:40:33.784ZINFOSledAgent (StorageManager): Received DatasetsEnsure { config: DatasetsConfig { generation: Generation(1), datasets: {059c36d9-8100-422b-bd52-7a69bcf065e7 (dataset): DatasetConfig { id: 059c36d9-8100-422b-bd52-7a69bcf065e7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8e389ddd-65e9-4954-ab37-e305d4d4e112 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_31a5acd7-f1f6-4683-a49e-44e34c5f6914" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 06a73711-f77c-4ea9-b417-1c1549dff17f (dataset): DatasetConfig { id: 06a73711-f77c-4ea9-b417-1c1549dff17f (dataset), name: DatasetName { pool_name: ZpoolName { id: 5f5a9c7a-eec2-4e86-a02e-9238700fe7ab (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0cfbd23e-030f-450b-afd3-7dda4ed4fa8a (dataset): DatasetConfig { id: 0cfbd23e-030f-450b-afd3-7dda4ed4fa8a (dataset), name: DatasetName { pool_name: ZpoolName { id: 99dfd90b-ff92-45e8-a73e-ada9e3f552c8 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0fd286ee-0d84-4cff-84ac-f6b4bca24884 (dataset): DatasetConfig { id: 0fd286ee-0d84-4cff-84ac-f6b4bca24884 (dataset), name: DatasetName { pool_name: ZpoolName { id: f3f86fa8-b3a1-409b-95c8-f426058deed7 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_17a27890-edd1-41a9-b5f3-c1b01576ff0e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 10aa68a3-d9ae-4c07-99ed-4af827b57c43 (dataset): DatasetConfig { id: 10aa68a3-d9ae-4c07-99ed-4af827b57c43 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5f5a9c7a-eec2-4e86-a02e-9238700fe7ab (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1b2c566e-5251-48cc-b8b1-2b2481f9c4e0 (dataset): DatasetConfig { id: 1b2c566e-5251-48cc-b8b1-2b2481f9c4e0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 50f60e54-9000-4b4d-8705-841b133128b0 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_0df5e14a-6e1e-4dcd-bf05-d67f92d30034" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2245ec88-39be-4c10-bcb0-dc5be8ce3703 (dataset): DatasetConfig { id: 2245ec88-39be-4c10-bcb0-dc5be8ce3703 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8e389ddd-65e9-4954-ab37-e305d4d4e112 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 25c91089-1823-4b57-87a1-5f9fe1f5708a (dataset): DatasetConfig { id: 25c91089-1823-4b57-87a1-5f9fe1f5708a (dataset), name: DatasetName { pool_name: ZpoolName { id: 99dfd90b-ff92-45e8-a73e-ada9e3f552c8 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_9d99eda0-389f-44c6-94ee-e9e7a03c9733" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2963cbd0-029d-4eda-b2aa-6186e4f414d8 (dataset): DatasetConfig { id: 2963cbd0-029d-4eda-b2aa-6186e4f414d8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 99dfd90b-ff92-45e8-a73e-ada9e3f552c8 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3042c7f0-26ac-4e37-aca8-de3eceebb505 (dataset): DatasetConfig { id: 3042c7f0-26ac-4e37-aca8-de3eceebb505 (dataset), name: DatasetName { pool_name: ZpoolName { id: 99dfd90b-ff92-45e8-a73e-ada9e3f552c8 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_196fdb83-e76c-47d9-a9ee-d0429aa71154" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 33345c01-02ce-4080-b9b0-7b369831e8ca (dataset): DatasetConfig { id: 33345c01-02ce-4080-b9b0-7b369831e8ca (dataset), name: DatasetName { pool_name: ZpoolName { id: 3b3acf4c-a316-45ce-a055-ef8d6c8acdff (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 38617dd4-e6dc-4a3c-82b3-0f7edb963638 (dataset): DatasetConfig { id: 38617dd4-e6dc-4a3c-82b3-0f7edb963638 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8e389ddd-65e9-4954-ab37-e305d4d4e112 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_27229a74-6d47-442c-a7ab-393b73cf74df" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3ac99213-a349-479d-bc4f-48b96f0652e8 (dataset): DatasetConfig { id: 3ac99213-a349-479d-bc4f-48b96f0652e8 (dataset), name: DatasetName { pool_name: ZpoolName { id: f3f86fa8-b3a1-409b-95c8-f426058deed7 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 3bc010e2-bf5e-48ee-8d9c-a5814955a89d (dataset): DatasetConfig { id: 3bc010e2-bf5e-48ee-8d9c-a5814955a89d (dataset), name: DatasetName { pool_name: ZpoolName { id: 3b3acf4c-a316-45ce-a055-ef8d6c8acdff (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_e9fe68b0-d53c-4161-a621-681677d5b0d6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3d68ccf6-5c67-4927-a5b8-969bd86c619e (dataset): DatasetConfig { id: 3d68ccf6-5c67-4927-a5b8-969bd86c619e (dataset), name: DatasetName { pool_name: ZpoolName { id: 99dfd90b-ff92-45e8-a73e-ada9e3f552c8 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 4086497c-78f7-481a-9fc9-542a4fd224b7 (dataset): DatasetConfig { id: 4086497c-78f7-481a-9fc9-542a4fd224b7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3b3acf4c-a316-45ce-a055-ef8d6c8acdff (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_3965e738-3305-4fcd-9da0-4c6e0ce7edc1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 486c0d02-343a-4568-b43c-849e61f45ce4 (dataset): DatasetConfig { id: 486c0d02-343a-4568-b43c-849e61f45ce4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5f5a9c7a-eec2-4e86-a02e-9238700fe7ab (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_bef145b4-2934-45c3-870a-63d45572bde4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4b52f012-e85b-43cb-b065-c70780747d99 (dataset): DatasetConfig { id: 4b52f012-e85b-43cb-b065-c70780747d99 (dataset), name: DatasetName { pool_name: ZpoolName { id: 50f60e54-9000-4b4d-8705-841b133128b0 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_44e0594e-e8fa-4a38-8f8c-bcb6ceccc555" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4e64f3c9-1029-4b99-89b4-294ac8baa81c (dataset): DatasetConfig { id: 4e64f3c9-1029-4b99-89b4-294ac8baa81c (dataset), name: DatasetName { pool_name: ZpoolName { id: 3b3acf4c-a316-45ce-a055-ef8d6c8acdff (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4f52bf89-d78d-43db-a8d8-2eeeac7fb1ed (dataset): DatasetConfig { id: 4f52bf89-d78d-43db-a8d8-2eeeac7fb1ed (dataset), name: DatasetName { pool_name: ZpoolName { id: 99dfd90b-ff92-45e8-a73e-ada9e3f552c8 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4f8678cd-53d2-4257-9925-97f0b3e7f85e (dataset): DatasetConfig { id: 4f8678cd-53d2-4257-9925-97f0b3e7f85e (dataset), name: DatasetName { pool_name: ZpoolName { id: 50f60e54-9000-4b4d-8705-841b133128b0 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_04023147-2580-4e6f-a338-23a2e1e895fc" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 51d348c9-ee4f-46f2-928b-35aa5474b1f7 (dataset): DatasetConfig { id: 51d348c9-ee4f-46f2-928b-35aa5474b1f7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8e389ddd-65e9-4954-ab37-e305d4d4e112 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5338feaa-afc0-4c20-95df-55bb8f76a8f0 (dataset): DatasetConfig { id: 5338feaa-afc0-4c20-95df-55bb8f76a8f0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 50f60e54-9000-4b4d-8705-841b133128b0 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 56f44c09-d495-4f0e-b996-cc2d5b63bf1f (dataset): DatasetConfig { id: 56f44c09-d495-4f0e-b996-cc2d5b63bf1f (dataset), name: DatasetName { pool_name: ZpoolName { id: 99dfd90b-ff92-45e8-a73e-ada9e3f552c8 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_0525204b-63bb-4f1b-be27-505477f54f5d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 594e2203-5a56-48b6-9652-0985d5d4ce6a (dataset): DatasetConfig { id: 594e2203-5a56-48b6-9652-0985d5d4ce6a (dataset), name: DatasetName { pool_name: ZpoolName { id: 50f60e54-9000-4b4d-8705-841b133128b0 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 68bb7f28-24ac-4636-ae85-b861449794b8 (dataset): DatasetConfig { id: 68bb7f28-24ac-4636-ae85-b861449794b8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2f3ff39c-4b18-4b96-8fb8-fbd672d6202f (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6da86879-563b-417e-8489-e35b55a9ab57 (dataset): DatasetConfig { id: 6da86879-563b-417e-8489-e35b55a9ab57 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3b3acf4c-a316-45ce-a055-ef8d6c8acdff (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 70e5ff0e-657d-4438-99c3-13748a227e5c (dataset): DatasetConfig { id: 70e5ff0e-657d-4438-99c3-13748a227e5c (dataset), name: DatasetName { pool_name: ZpoolName { id: 5f5a9c7a-eec2-4e86-a02e-9238700fe7ab (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 717f2e41-a56e-4115-aae4-4cf70d6e94b6 (dataset): DatasetConfig { id: 717f2e41-a56e-4115-aae4-4cf70d6e94b6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 50f60e54-9000-4b4d-8705-841b133128b0 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_4e6cf073-224e-417c-8875-16567605c2be" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 72945d39-1570-4b88-9991-d61e1367bfb9 (dataset): DatasetConfig { id: 72945d39-1570-4b88-9991-d61e1367bfb9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3b3acf4c-a316-45ce-a055-ef8d6c8acdff (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 745ef6e0-90bc-4aca-95cc-b9c3a6bace1a (dataset): DatasetConfig { id: 745ef6e0-90bc-4aca-95cc-b9c3a6bace1a (dataset), name: DatasetName { pool_name: ZpoolName { id: 43474e0b-a6d6-4842-bf66-1060f52875b1 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_2e418c90-5369-4643-83ad-18cceb9dcb5f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 76fc149b-bfe7-4928-9667-9d874014ab52 (dataset): DatasetConfig { id: 76fc149b-bfe7-4928-9667-9d874014ab52 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3b3acf4c-a316-45ce-a055-ef8d6c8acdff (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_eb71a443-d6ff-40d1-b0f6-d5e30927d1c2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7af3748f-3021-4893-9cef-48a39d685989 (dataset): DatasetConfig { id: 7af3748f-3021-4893-9cef-48a39d685989 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8e389ddd-65e9-4954-ab37-e305d4d4e112 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7f757ed2-653f-4630-81f9-5098ec6ad811 (dataset): DatasetConfig { id: 7f757ed2-653f-4630-81f9-5098ec6ad811 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3b3acf4c-a316-45ce-a055-ef8d6c8acdff (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8a115096-37ef-4e21-b9ae-8957f5935b0c (dataset): DatasetConfig { id: 8a115096-37ef-4e21-b9ae-8957f5935b0c (dataset), name: DatasetName { pool_name: ZpoolName { id: 33ce0168-de47-475b-9a15-5a0cd6252cb6 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8b1d124a-c129-4e48-8f02-ff8316ce8bd2 (dataset): DatasetConfig { id: 8b1d124a-c129-4e48-8f02-ff8316ce8bd2 (dataset), name: DatasetName { pool_name: ZpoolName { id: f3f86fa8-b3a1-409b-95c8-f426058deed7 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 95fb3e18-9a67-43a8-aa77-59173c616da2 (dataset): DatasetConfig { id: 95fb3e18-9a67-43a8-aa77-59173c616da2 (dataset), name: DatasetName { pool_name: ZpoolName { id: f3f86fa8-b3a1-409b-95c8-f426058deed7 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 98b6ab76-46ff-40fa-a380-e4ee89abe89c (dataset): DatasetConfig { id: 98b6ab76-46ff-40fa-a380-e4ee89abe89c (dataset), name: DatasetName { pool_name: ZpoolName { id: 2f3ff39c-4b18-4b96-8fb8-fbd672d6202f (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 99e9ed9c-3bea-49ba-ba81-148d24e28208 (dataset): DatasetConfig { id: 99e9ed9c-3bea-49ba-ba81-148d24e28208 (dataset), name: DatasetName { pool_name: ZpoolName { id: 50f60e54-9000-4b4d-8705-841b133128b0 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_fd12fb4f-e62d-4cab-a4bd-2024f2546d3b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9efcd235-af24-47cd-9d9d-da21357251e0 (dataset): DatasetConfig { id: 9efcd235-af24-47cd-9d9d-da21357251e0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5f5a9c7a-eec2-4e86-a02e-9238700fe7ab (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_c26c9d62-aefd-4ced-b0e7-da16bf299c4d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a4133a75-0a90-4597-99be-598e4f9c12e4 (dataset): DatasetConfig { id: a4133a75-0a90-4597-99be-598e4f9c12e4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 43474e0b-a6d6-4842-bf66-1060f52875b1 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, a62d4d01-ad77-467e-93ae-ad326209c378 (dataset): DatasetConfig { id: a62d4d01-ad77-467e-93ae-ad326209c378 (dataset), name: DatasetName { pool_name: ZpoolName { id: 33ce0168-de47-475b-9a15-5a0cd6252cb6 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a647ceb1-cdc7-4e5c-a77d-e272f3ee6923 (dataset): DatasetConfig { id: a647ceb1-cdc7-4e5c-a77d-e272f3ee6923 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3b3acf4c-a316-45ce-a055-ef8d6c8acdff (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_de82b1e5-5cfb-423c-b612-e6e5e77c021f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a96dbb37-9866-45be-8bf1-8aeafe78d35e (dataset): DatasetConfig { id: a96dbb37-9866-45be-8bf1-8aeafe78d35e (dataset), name: DatasetName { pool_name: ZpoolName { id: 43474e0b-a6d6-4842-bf66-1060f52875b1 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a9b68154-dcee-4138-84e8-74180d4f044f (dataset): DatasetConfig { id: a9b68154-dcee-4138-84e8-74180d4f044f (dataset), name: DatasetName { pool_name: ZpoolName { id: f3f86fa8-b3a1-409b-95c8-f426058deed7 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_1049fe89-11bc-49dd-aec6-8ba72a4bf488" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, aacbbc5e-7bde-4194-91cb-362b4cecd33d (dataset): DatasetConfig { id: aacbbc5e-7bde-4194-91cb-362b4cecd33d (dataset), name: DatasetName { pool_name: ZpoolName { id: 99dfd90b-ff92-45e8-a73e-ada9e3f552c8 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ab7a3fe0-0826-448e-8c92-71f37d886a12 (dataset): DatasetConfig { id: ab7a3fe0-0826-448e-8c92-71f37d886a12 (dataset), name: DatasetName { pool_name: ZpoolName { id: 99dfd90b-ff92-45e8-a73e-ada9e3f552c8 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_46c53ce3-fed2-4b43-8728-cae9919088d1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b5177748-b84b-46cf-b329-cfa54f72157f (dataset): DatasetConfig { id: b5177748-b84b-46cf-b329-cfa54f72157f (dataset), name: DatasetName { pool_name: ZpoolName { id: 43474e0b-a6d6-4842-bf66-1060f52875b1 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b6fc9ea5-820e-4c66-8508-d78a94466a10 (dataset): DatasetConfig { id: b6fc9ea5-820e-4c66-8508-d78a94466a10 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8e389ddd-65e9-4954-ab37-e305d4d4e112 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, bce75a20-4a7b-4847-bb75-d5ff15996295 (dataset): DatasetConfig { id: bce75a20-4a7b-4847-bb75-d5ff15996295 (dataset), name: DatasetName { pool_name: ZpoolName { id: 50f60e54-9000-4b4d-8705-841b133128b0 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c37be615-5791-4384-961c-7a1656e2baa2 (dataset): DatasetConfig { id: c37be615-5791-4384-961c-7a1656e2baa2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 99dfd90b-ff92-45e8-a73e-ada9e3f552c8 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d08074c5-2587-4bfb-aaab-091962539b60 (dataset): DatasetConfig { id: d08074c5-2587-4bfb-aaab-091962539b60 (dataset), name: DatasetName { pool_name: ZpoolName { id: 43474e0b-a6d6-4842-bf66-1060f52875b1 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_b2591895-3ac4-4a5b-8bab-97ad5b9d077c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d69453e7-a201-4c3e-a8f6-ede4936aebf7 (dataset): DatasetConfig { id: d69453e7-a201-4c3e-a8f6-ede4936aebf7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 50f60e54-9000-4b4d-8705-841b133128b0 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dbb1717e-00b8-42f8-8ccf-11bef6242771 (dataset): DatasetConfig { id: dbb1717e-00b8-42f8-8ccf-11bef6242771 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5f5a9c7a-eec2-4e86-a02e-9238700fe7ab (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_19f9def9-3a42-4f07-8788-385d13f17c0a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dc903df3-cb30-474c-bf59-47d681ed3c07 (dataset): DatasetConfig { id: dc903df3-cb30-474c-bf59-47d681ed3c07 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2f3ff39c-4b18-4b96-8fb8-fbd672d6202f (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_84c4aae6-8e5d-40c4-b5db-027cbd5c5b06" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e1c8ac2e-9115-4d86-9162-f15c14c522fc (dataset): DatasetConfig { id: e1c8ac2e-9115-4d86-9162-f15c14c522fc (dataset), name: DatasetName { pool_name: ZpoolName { id: 3b3acf4c-a316-45ce-a055-ef8d6c8acdff (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_ba33747a-8bf5-489f-aaf5-20508b581f0f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e245fd86-f686-4deb-bf5c-aacbee052ae4 (dataset): DatasetConfig { id: e245fd86-f686-4deb-bf5c-aacbee052ae4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5f5a9c7a-eec2-4e86-a02e-9238700fe7ab (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e2df87b4-06f4-475c-ad4b-5cb1acb559ab (dataset): DatasetConfig { id: e2df87b4-06f4-475c-ad4b-5cb1acb559ab (dataset), name: DatasetName { pool_name: ZpoolName { id: 2f3ff39c-4b18-4b96-8fb8-fbd672d6202f (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e3870899-b32f-487a-a272-262ea774e6d6 (dataset): DatasetConfig { id: e3870899-b32f-487a-a272-262ea774e6d6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 99dfd90b-ff92-45e8-a73e-ada9e3f552c8 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_f0d51dc5-eec8-4f23-825b-ece452653cf1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e6941c27-88f1-426c-9572-a2aac9f0d7e4 (dataset): DatasetConfig { id: e6941c27-88f1-426c-9572-a2aac9f0d7e4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 50f60e54-9000-4b4d-8705-841b133128b0 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ed4b52d2-4407-4f3c-a1be-8e295d468fcd (dataset): DatasetConfig { id: ed4b52d2-4407-4f3c-a1be-8e295d468fcd (dataset), name: DatasetName { pool_name: ZpoolName { id: 33ce0168-de47-475b-9a15-5a0cd6252cb6 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_ed55ef04-a7c0-4b4e-ac1e-21d76b03e495" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f42cc23b-244e-4eb1-ae1f-e0cc686628c2 (dataset): DatasetConfig { id: f42cc23b-244e-4eb1-ae1f-e0cc686628c2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 50f60e54-9000-4b4d-8705-841b133128b0 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f4a89e14-bd0b-4db4-af02-6ddd0d59bc08 (dataset): DatasetConfig { id: f4a89e14-bd0b-4db4-af02-6ddd0d59bc08 (dataset), name: DatasetName { pool_name: ZpoolName { id: 50f60e54-9000-4b4d-8705-841b133128b0 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fb2e9ab9-a572-4901-80f7-edd8fb48be91 (dataset): DatasetConfig { id: fb2e9ab9-a572-4901-80f7-edd8fb48be91 (dataset), name: DatasetName { pool_name: ZpoolName { id: 33ce0168-de47-475b-9a15-5a0cd6252cb6 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, fe0fb26f-7fef-4607-a4b5-d309313364e1 (dataset): DatasetConfig { id: fe0fb26f-7fef-4607-a4b5-d309313364e1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 50f60e54-9000-4b4d-8705-841b133128b0 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_59b92633-3550-4af1-b628-503b6bafd00d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fe4e8646-87bc-4168-9b28-ba530be8f8fe (dataset): DatasetConfig { id: fe4e8646-87bc-4168-9b28-ba530be8f8fe (dataset), name: DatasetName { pool_name: ZpoolName { id: 3b3acf4c-a316-45ce-a055-ef8d6c8acdff (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_2372a96e-6bc5-4e12-9310-7e2f7c4121e7" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} }, tx: ... } file = sled-storage/src/manager.rs:603
4462024-12-06T20:40:33.784ZINFOSledAgent (StorageManager): No ledger in /pool/int/b9ab18cf-4dd7-46c3-920e-833f181cfe8b/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4472024-12-06T20:40:33.784ZINFOSledAgent (StorageManager): No ledger in /pool/int/5a719d2c-fbf6-41ef-af9f-e6b70820ebd4/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4482024-12-06T20:40:33.784ZINFOSledAgent (StorageManager): No previously-stored 'requested datasets', creating new ledger file = sled-storage/src/manager.rs:905 request = datasets_ensure
4492024-12-06T20:40:33.784ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4502024-12-06T20:40:33.784ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8e389ddd-65e9-4954-ab37-e305d4d4e112/crypt/zone/oxz_crucible_31a5acd7-f1f6-4683-a49e-44e34c5f6914"), full_name: "oxp_8e389ddd-65e9-4954-ab37-e305d4d4e112/crypt/zone/oxz_crucible_31a5acd7-f1f6-4683-a49e-44e34c5f6914" } file = sled-storage/src/manager.rs:1331
4512024-12-06T20:40:33.887ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4522024-12-06T20:40:33.887ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5f5a9c7a-eec2-4e86-a02e-9238700fe7ab/crypt/zone"), full_name: "oxp_5f5a9c7a-eec2-4e86-a02e-9238700fe7ab/crypt/zone" } file = sled-storage/src/manager.rs:1331
4532024-12-06T20:40:33.955ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4542024-12-06T20:40:33.955ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_99dfd90b-ff92-45e8-a73e-ada9e3f552c8/crucible" } file = sled-storage/src/manager.rs:1331
4552024-12-06T20:40:34.044ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4562024-12-06T20:40:34.044ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f3f86fa8-b3a1-409b-95c8-f426058deed7/crypt/zone/oxz_crucible_17a27890-edd1-41a9-b5f3-c1b01576ff0e"), full_name: "oxp_f3f86fa8-b3a1-409b-95c8-f426058deed7/crypt/zone/oxz_crucible_17a27890-edd1-41a9-b5f3-c1b01576ff0e" } file = sled-storage/src/manager.rs:1331
4572024-12-06T20:40:34.147ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4582024-12-06T20:40:34.147ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_5f5a9c7a-eec2-4e86-a02e-9238700fe7ab/crucible" } file = sled-storage/src/manager.rs:1331
4592024-12-06T20:40:34.235ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4602024-12-06T20:40:34.235ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/50f60e54-9000-4b4d-8705-841b133128b0/crypt/zone/oxz_internal_dns_0df5e14a-6e1e-4dcd-bf05-d67f92d30034"), full_name: "oxp_50f60e54-9000-4b4d-8705-841b133128b0/crypt/zone/oxz_internal_dns_0df5e14a-6e1e-4dcd-bf05-d67f92d30034" } file = sled-storage/src/manager.rs:1331
4612024-12-06T20:40:34.334ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4622024-12-06T20:40:34.334ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_8e389ddd-65e9-4954-ab37-e305d4d4e112/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
4632024-12-06T20:40:34.426ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4642024-12-06T20:40:34.426ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/99dfd90b-ff92-45e8-a73e-ada9e3f552c8/crypt/zone/oxz_external_dns_9d99eda0-389f-44c6-94ee-e9e7a03c9733"), full_name: "oxp_99dfd90b-ff92-45e8-a73e-ada9e3f552c8/crypt/zone/oxz_external_dns_9d99eda0-389f-44c6-94ee-e9e7a03c9733" } file = sled-storage/src/manager.rs:1331
4652024-12-06T20:40:34.523ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4662024-12-06T20:40:34.523ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_99dfd90b-ff92-45e8-a73e-ada9e3f552c8/crypt/internal_dns" } file = sled-storage/src/manager.rs:1331
4672024-12-06T20:40:34.537ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/0a667526-2006-419e-9b68-c251fd138c06) file = sled-agent/src/probe_manager.rs:231 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
4682024-12-06T20:40:34.612ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4692024-12-06T20:40:34.612ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/99dfd90b-ff92-45e8-a73e-ada9e3f552c8/crypt/zone/oxz_cockroachdb_196fdb83-e76c-47d9-a9ee-d0429aa71154"), full_name: "oxp_99dfd90b-ff92-45e8-a73e-ada9e3f552c8/crypt/zone/oxz_cockroachdb_196fdb83-e76c-47d9-a9ee-d0429aa71154" } file = sled-storage/src/manager.rs:1331
4702024-12-06T20:40:34.712ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4712024-12-06T20:40:34.712ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3b3acf4c-a316-45ce-a055-ef8d6c8acdff/crypt/zone"), full_name: "oxp_3b3acf4c-a316-45ce-a055-ef8d6c8acdff/crypt/zone" } file = sled-storage/src/manager.rs:1331
4722024-12-06T20:40:34.781ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4732024-12-06T20:40:34.781ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8e389ddd-65e9-4954-ab37-e305d4d4e112/crypt/zone/oxz_cockroachdb_27229a74-6d47-442c-a7ab-393b73cf74df"), full_name: "oxp_8e389ddd-65e9-4954-ab37-e305d4d4e112/crypt/zone/oxz_cockroachdb_27229a74-6d47-442c-a7ab-393b73cf74df" } file = sled-storage/src/manager.rs:1331
4742024-12-06T20:40:34.880ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4752024-12-06T20:40:34.880ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f3f86fa8-b3a1-409b-95c8-f426058deed7/crypt/debug"), full_name: "oxp_f3f86fa8-b3a1-409b-95c8-f426058deed7/crypt/debug" } file = sled-storage/src/manager.rs:1331
4762024-12-06T20:40:34.949ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4772024-12-06T20:40:34.949ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3b3acf4c-a316-45ce-a055-ef8d6c8acdff/crypt/zone/oxz_nexus_e9fe68b0-d53c-4161-a621-681677d5b0d6"), full_name: "oxp_3b3acf4c-a316-45ce-a055-ef8d6c8acdff/crypt/zone/oxz_nexus_e9fe68b0-d53c-4161-a621-681677d5b0d6" } file = sled-storage/src/manager.rs:1331
4782024-12-06T20:40:35.046ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4792024-12-06T20:40:35.046ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/99dfd90b-ff92-45e8-a73e-ada9e3f552c8/crypt/debug"), full_name: "oxp_99dfd90b-ff92-45e8-a73e-ada9e3f552c8/crypt/debug" } file = sled-storage/src/manager.rs:1331
4802024-12-06T20:40:35.119ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4812024-12-06T20:40:35.119ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3b3acf4c-a316-45ce-a055-ef8d6c8acdff/crypt/zone/oxz_nexus_3965e738-3305-4fcd-9da0-4c6e0ce7edc1"), full_name: "oxp_3b3acf4c-a316-45ce-a055-ef8d6c8acdff/crypt/zone/oxz_nexus_3965e738-3305-4fcd-9da0-4c6e0ce7edc1" } file = sled-storage/src/manager.rs:1331
4822024-12-06T20:40:35.221ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4832024-12-06T20:40:35.221ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5f5a9c7a-eec2-4e86-a02e-9238700fe7ab/crypt/zone/oxz_oximeter_bef145b4-2934-45c3-870a-63d45572bde4"), full_name: "oxp_5f5a9c7a-eec2-4e86-a02e-9238700fe7ab/crypt/zone/oxz_oximeter_bef145b4-2934-45c3-870a-63d45572bde4" } file = sled-storage/src/manager.rs:1331
4842024-12-06T20:40:35.320ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4852024-12-06T20:40:35.320ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/50f60e54-9000-4b4d-8705-841b133128b0/crypt/zone/oxz_clickhouse_44e0594e-e8fa-4a38-8f8c-bcb6ceccc555"), full_name: "oxp_50f60e54-9000-4b4d-8705-841b133128b0/crypt/zone/oxz_clickhouse_44e0594e-e8fa-4a38-8f8c-bcb6ceccc555" } file = sled-storage/src/manager.rs:1331
4862024-12-06T20:40:35.421ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4872024-12-06T20:40:35.421ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_3b3acf4c-a316-45ce-a055-ef8d6c8acdff/crypt/internal_dns" } file = sled-storage/src/manager.rs:1331
4882024-12-06T20:40:35.513ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4892024-12-06T20:40:35.513ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_99dfd90b-ff92-45e8-a73e-ada9e3f552c8/crypt/external_dns" } file = sled-storage/src/manager.rs:1331
4902024-12-06T20:40:35.539ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/0a667526-2006-419e-9b68-c251fd138c06) file = sled-agent/src/probe_manager.rs:231 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
4912024-12-06T20:40:35.604ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4922024-12-06T20:40:35.604ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/50f60e54-9000-4b4d-8705-841b133128b0/crypt/zone/oxz_crucible_04023147-2580-4e6f-a338-23a2e1e895fc"), full_name: "oxp_50f60e54-9000-4b4d-8705-841b133128b0/crypt/zone/oxz_crucible_04023147-2580-4e6f-a338-23a2e1e895fc" } file = sled-storage/src/manager.rs:1331
4932024-12-06T20:40:35.704ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4942024-12-06T20:40:35.704ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8e389ddd-65e9-4954-ab37-e305d4d4e112/crypt/zone"), full_name: "oxp_8e389ddd-65e9-4954-ab37-e305d4d4e112/crypt/zone" } file = sled-storage/src/manager.rs:1331
4952024-12-06T20:40:35.772ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4962024-12-06T20:40:35.773ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/50f60e54-9000-4b4d-8705-841b133128b0/crypt/debug"), full_name: "oxp_50f60e54-9000-4b4d-8705-841b133128b0/crypt/debug" } file = sled-storage/src/manager.rs:1331
4972024-12-06T20:40:35.844ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4982024-12-06T20:40:35.844ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/99dfd90b-ff92-45e8-a73e-ada9e3f552c8/crypt/zone/oxz_crucible_0525204b-63bb-4f1b-be27-505477f54f5d"), full_name: "oxp_99dfd90b-ff92-45e8-a73e-ada9e3f552c8/crypt/zone/oxz_crucible_0525204b-63bb-4f1b-be27-505477f54f5d" } file = sled-storage/src/manager.rs:1331
4992024-12-06T20:40:35.945ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5002024-12-06T20:40:35.945ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_50f60e54-9000-4b4d-8705-841b133128b0/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
5012024-12-06T20:40:36.038ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5022024-12-06T20:40:36.038ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2f3ff39c-4b18-4b96-8fb8-fbd672d6202f/crypt/zone"), full_name: "oxp_2f3ff39c-4b18-4b96-8fb8-fbd672d6202f/crypt/zone" } file = sled-storage/src/manager.rs:1331
5032024-12-06T20:40:36.106ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5042024-12-06T20:40:36.106ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3b3acf4c-a316-45ce-a055-ef8d6c8acdff/crypt/debug"), full_name: "oxp_3b3acf4c-a316-45ce-a055-ef8d6c8acdff/crypt/debug" } file = sled-storage/src/manager.rs:1331
5052024-12-06T20:40:36.174ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5062024-12-06T20:40:36.174ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5f5a9c7a-eec2-4e86-a02e-9238700fe7ab/crypt/debug"), full_name: "oxp_5f5a9c7a-eec2-4e86-a02e-9238700fe7ab/crypt/debug" } file = sled-storage/src/manager.rs:1331
5072024-12-06T20:40:36.242ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5082024-12-06T20:40:36.242ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/50f60e54-9000-4b4d-8705-841b133128b0/crypt/zone/oxz_cockroachdb_4e6cf073-224e-417c-8875-16567605c2be"), full_name: "oxp_50f60e54-9000-4b4d-8705-841b133128b0/crypt/zone/oxz_cockroachdb_4e6cf073-224e-417c-8875-16567605c2be" } file = sled-storage/src/manager.rs:1331
5092024-12-06T20:40:36.343ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5102024-12-06T20:40:36.343ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_3b3acf4c-a316-45ce-a055-ef8d6c8acdff/crucible" } file = sled-storage/src/manager.rs:1331
5112024-12-06T20:40:36.431ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5122024-12-06T20:40:36.431ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/43474e0b-a6d6-4842-bf66-1060f52875b1/crypt/zone/oxz_ntp_2e418c90-5369-4643-83ad-18cceb9dcb5f"), full_name: "oxp_43474e0b-a6d6-4842-bf66-1060f52875b1/crypt/zone/oxz_ntp_2e418c90-5369-4643-83ad-18cceb9dcb5f" } file = sled-storage/src/manager.rs:1331
5132024-12-06T20:40:36.531ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5142024-12-06T20:40:36.531ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3b3acf4c-a316-45ce-a055-ef8d6c8acdff/crypt/zone/oxz_cockroachdb_eb71a443-d6ff-40d1-b0f6-d5e30927d1c2"), full_name: "oxp_3b3acf4c-a316-45ce-a055-ef8d6c8acdff/crypt/zone/oxz_cockroachdb_eb71a443-d6ff-40d1-b0f6-d5e30927d1c2" } file = sled-storage/src/manager.rs:1331
5152024-12-06T20:40:36.542ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/0a667526-2006-419e-9b68-c251fd138c06) file = sled-agent/src/probe_manager.rs:231 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
5162024-12-06T20:40:36.632ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5172024-12-06T20:40:36.632ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_8e389ddd-65e9-4954-ab37-e305d4d4e112/crucible" } file = sled-storage/src/manager.rs:1331
5182024-12-06T20:40:36.724ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5192024-12-06T20:40:36.724ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_3b3acf4c-a316-45ce-a055-ef8d6c8acdff/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
5202024-12-06T20:40:36.817ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5212024-12-06T20:40:36.817ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/33ce0168-de47-475b-9a15-5a0cd6252cb6/crypt/zone"), full_name: "oxp_33ce0168-de47-475b-9a15-5a0cd6252cb6/crypt/zone" } file = sled-storage/src/manager.rs:1331
5222024-12-06T20:40:36.886ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5232024-12-06T20:40:36.886ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f3f86fa8-b3a1-409b-95c8-f426058deed7/crypt/zone"), full_name: "oxp_f3f86fa8-b3a1-409b-95c8-f426058deed7/crypt/zone" } file = sled-storage/src/manager.rs:1331
5242024-12-06T20:40:36.956ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5252024-12-06T20:40:36.956ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_f3f86fa8-b3a1-409b-95c8-f426058deed7/crucible" } file = sled-storage/src/manager.rs:1331
5262024-12-06T20:40:37.049ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5272024-12-06T20:40:37.049ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2f3ff39c-4b18-4b96-8fb8-fbd672d6202f/crypt/debug"), full_name: "oxp_2f3ff39c-4b18-4b96-8fb8-fbd672d6202f/crypt/debug" } file = sled-storage/src/manager.rs:1331
5282024-12-06T20:40:37.121ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5292024-12-06T20:40:37.121ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/50f60e54-9000-4b4d-8705-841b133128b0/crypt/zone/oxz_nexus_fd12fb4f-e62d-4cab-a4bd-2024f2546d3b"), full_name: "oxp_50f60e54-9000-4b4d-8705-841b133128b0/crypt/zone/oxz_nexus_fd12fb4f-e62d-4cab-a4bd-2024f2546d3b" } file = sled-storage/src/manager.rs:1331
5302024-12-06T20:40:37.219ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5312024-12-06T20:40:37.219ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5f5a9c7a-eec2-4e86-a02e-9238700fe7ab/crypt/zone/oxz_cockroachdb_c26c9d62-aefd-4ced-b0e7-da16bf299c4d"), full_name: "oxp_5f5a9c7a-eec2-4e86-a02e-9238700fe7ab/crypt/zone/oxz_cockroachdb_c26c9d62-aefd-4ced-b0e7-da16bf299c4d" } file = sled-storage/src/manager.rs:1331
5322024-12-06T20:40:37.316ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5332024-12-06T20:40:37.316ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/43474e0b-a6d6-4842-bf66-1060f52875b1/crypt/debug"), full_name: "oxp_43474e0b-a6d6-4842-bf66-1060f52875b1/crypt/debug" } file = sled-storage/src/manager.rs:1331
5342024-12-06T20:40:37.383ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5352024-12-06T20:40:37.383ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_33ce0168-de47-475b-9a15-5a0cd6252cb6/crucible" } file = sled-storage/src/manager.rs:1331
5362024-12-06T20:40:37.469ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5372024-12-06T20:40:37.469ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3b3acf4c-a316-45ce-a055-ef8d6c8acdff/crypt/zone/oxz_crucible_de82b1e5-5cfb-423c-b612-e6e5e77c021f"), full_name: "oxp_3b3acf4c-a316-45ce-a055-ef8d6c8acdff/crypt/zone/oxz_crucible_de82b1e5-5cfb-423c-b612-e6e5e77c021f" } file = sled-storage/src/manager.rs:1331
5382024-12-06T20:40:37.545ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/0a667526-2006-419e-9b68-c251fd138c06) file = sled-agent/src/probe_manager.rs:231 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
5392024-12-06T20:40:37.568ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5402024-12-06T20:40:37.568ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_43474e0b-a6d6-4842-bf66-1060f52875b1/crucible" } file = sled-storage/src/manager.rs:1331
5412024-12-06T20:40:37.656ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5422024-12-06T20:40:37.656ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f3f86fa8-b3a1-409b-95c8-f426058deed7/crypt/zone/oxz_crucible_pantry_1049fe89-11bc-49dd-aec6-8ba72a4bf488"), full_name: "oxp_f3f86fa8-b3a1-409b-95c8-f426058deed7/crypt/zone/oxz_crucible_pantry_1049fe89-11bc-49dd-aec6-8ba72a4bf488" } file = sled-storage/src/manager.rs:1331
5432024-12-06T20:40:37.659ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 12.343663523s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
5442024-12-06T20:40:37.757ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5452024-12-06T20:40:37.757ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_99dfd90b-ff92-45e8-a73e-ada9e3f552c8/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
5462024-12-06T20:40:37.847ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5472024-12-06T20:40:37.847ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/99dfd90b-ff92-45e8-a73e-ada9e3f552c8/crypt/zone/oxz_crucible_pantry_46c53ce3-fed2-4b43-8728-cae9919088d1"), full_name: "oxp_99dfd90b-ff92-45e8-a73e-ada9e3f552c8/crypt/zone/oxz_crucible_pantry_46c53ce3-fed2-4b43-8728-cae9919088d1" } file = sled-storage/src/manager.rs:1331
5482024-12-06T20:40:37.944ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5492024-12-06T20:40:37.944ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/43474e0b-a6d6-4842-bf66-1060f52875b1/crypt/zone"), full_name: "oxp_43474e0b-a6d6-4842-bf66-1060f52875b1/crypt/zone" } file = sled-storage/src/manager.rs:1331
5502024-12-06T20:40:38.014ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5512024-12-06T20:40:38.014ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8e389ddd-65e9-4954-ab37-e305d4d4e112/crypt/debug"), full_name: "oxp_8e389ddd-65e9-4954-ab37-e305d4d4e112/crypt/debug" } file = sled-storage/src/manager.rs:1331
5522024-12-06T20:40:38.081ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5532024-12-06T20:40:38.081ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_50f60e54-9000-4b4d-8705-841b133128b0/crypt/external_dns" } file = sled-storage/src/manager.rs:1331
5542024-12-06T20:40:38.171ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5552024-12-06T20:40:38.171ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/99dfd90b-ff92-45e8-a73e-ada9e3f552c8/crypt/zone"), full_name: "oxp_99dfd90b-ff92-45e8-a73e-ada9e3f552c8/crypt/zone" } file = sled-storage/src/manager.rs:1331
5562024-12-06T20:40:38.240ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5572024-12-06T20:40:38.240ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/43474e0b-a6d6-4842-bf66-1060f52875b1/crypt/zone/oxz_crucible_b2591895-3ac4-4a5b-8bab-97ad5b9d077c"), full_name: "oxp_43474e0b-a6d6-4842-bf66-1060f52875b1/crypt/zone/oxz_crucible_b2591895-3ac4-4a5b-8bab-97ad5b9d077c" } file = sled-storage/src/manager.rs:1331
5582024-12-06T20:40:38.339ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5592024-12-06T20:40:38.339ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_50f60e54-9000-4b4d-8705-841b133128b0/crypt/internal_dns" } file = sled-storage/src/manager.rs:1331
5602024-12-06T20:40:38.453ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5612024-12-06T20:40:38.453ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5f5a9c7a-eec2-4e86-a02e-9238700fe7ab/crypt/zone/oxz_crucible_19f9def9-3a42-4f07-8788-385d13f17c0a"), full_name: "oxp_5f5a9c7a-eec2-4e86-a02e-9238700fe7ab/crypt/zone/oxz_crucible_19f9def9-3a42-4f07-8788-385d13f17c0a" } file = sled-storage/src/manager.rs:1331
5622024-12-06T20:40:38.548ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/0a667526-2006-419e-9b68-c251fd138c06) file = sled-agent/src/probe_manager.rs:231 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
5632024-12-06T20:40:38.553ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5642024-12-06T20:40:38.553ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2f3ff39c-4b18-4b96-8fb8-fbd672d6202f/crypt/zone/oxz_crucible_84c4aae6-8e5d-40c4-b5db-027cbd5c5b06"), full_name: "oxp_2f3ff39c-4b18-4b96-8fb8-fbd672d6202f/crypt/zone/oxz_crucible_84c4aae6-8e5d-40c4-b5db-027cbd5c5b06" } file = sled-storage/src/manager.rs:1331
5652024-12-06T20:40:38.658ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5662024-12-06T20:40:38.658ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3b3acf4c-a316-45ce-a055-ef8d6c8acdff/crypt/zone/oxz_crucible_pantry_ba33747a-8bf5-489f-aaf5-20508b581f0f"), full_name: "oxp_3b3acf4c-a316-45ce-a055-ef8d6c8acdff/crypt/zone/oxz_crucible_pantry_ba33747a-8bf5-489f-aaf5-20508b581f0f" } file = sled-storage/src/manager.rs:1331
5672024-12-06T20:40:38.759ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5682024-12-06T20:40:38.759ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_5f5a9c7a-eec2-4e86-a02e-9238700fe7ab/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
5692024-12-06T20:40:38.848ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5702024-12-06T20:40:38.848ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_2f3ff39c-4b18-4b96-8fb8-fbd672d6202f/crucible" } file = sled-storage/src/manager.rs:1331
5712024-12-06T20:40:38.935ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5722024-12-06T20:40:38.935ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/99dfd90b-ff92-45e8-a73e-ada9e3f552c8/crypt/zone/oxz_internal_dns_f0d51dc5-eec8-4f23-825b-ece452653cf1"), full_name: "oxp_99dfd90b-ff92-45e8-a73e-ada9e3f552c8/crypt/zone/oxz_internal_dns_f0d51dc5-eec8-4f23-825b-ece452653cf1" } file = sled-storage/src/manager.rs:1331
5732024-12-06T20:40:39.033ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5742024-12-06T20:40:39.033ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/50f60e54-9000-4b4d-8705-841b133128b0/crypt/zone"), full_name: "oxp_50f60e54-9000-4b4d-8705-841b133128b0/crypt/zone" } file = sled-storage/src/manager.rs:1331
5752024-12-06T20:40:39.108ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5762024-12-06T20:40:39.108ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/33ce0168-de47-475b-9a15-5a0cd6252cb6/crypt/zone/oxz_crucible_ed55ef04-a7c0-4b4e-ac1e-21d76b03e495"), full_name: "oxp_33ce0168-de47-475b-9a15-5a0cd6252cb6/crypt/zone/oxz_crucible_ed55ef04-a7c0-4b4e-ac1e-21d76b03e495" } file = sled-storage/src/manager.rs:1331
5772024-12-06T20:40:39.216ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5782024-12-06T20:40:39.217ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_50f60e54-9000-4b4d-8705-841b133128b0/crucible" } file = sled-storage/src/manager.rs:1331
5792024-12-06T20:40:39.306ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5802024-12-06T20:40:39.306ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_50f60e54-9000-4b4d-8705-841b133128b0/crypt/clickhouse" } file = sled-storage/src/manager.rs:1331
5812024-12-06T20:40:39.367ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13603920217495633252 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
5822024-12-06T20:40:39.367ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7059390950470138893 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
5832024-12-06T20:40:39.394ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5842024-12-06T20:40:39.394ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/33ce0168-de47-475b-9a15-5a0cd6252cb6/crypt/debug"), full_name: "oxp_33ce0168-de47-475b-9a15-5a0cd6252cb6/crypt/debug" } file = sled-storage/src/manager.rs:1331
5852024-12-06T20:40:39.461ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5862024-12-06T20:40:39.461ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/50f60e54-9000-4b4d-8705-841b133128b0/crypt/zone/oxz_external_dns_59b92633-3550-4af1-b628-503b6bafd00d"), full_name: "oxp_50f60e54-9000-4b4d-8705-841b133128b0/crypt/zone/oxz_external_dns_59b92633-3550-4af1-b628-503b6bafd00d" } file = sled-storage/src/manager.rs:1331
5872024-12-06T20:40:39.551ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/0a667526-2006-419e-9b68-c251fd138c06) file = sled-agent/src/probe_manager.rs:231 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
5882024-12-06T20:40:39.559ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5892024-12-06T20:40:39.559ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3b3acf4c-a316-45ce-a055-ef8d6c8acdff/crypt/zone/oxz_internal_dns_2372a96e-6bc5-4e12-9310-7e2f7c4121e7"), full_name: "oxp_3b3acf4c-a316-45ce-a055-ef8d6c8acdff/crypt/zone/oxz_internal_dns_2372a96e-6bc5-4e12-9310-7e2f7c4121e7" } file = sled-storage/src/manager.rs:1331
5902024-12-06T20:40:39.582ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:4292
5912024-12-06T20:40:39.582ZINFOSledAgent (ServiceManager): Ensuring there is a default route file = sled-agent/src/services.rs:4302 gateway = fd00:1122:3344:101::1
5922024-12-06T20:40:39.588ZINFOSledAgent (ServiceManager): Default route already exists file = sled-agent/src/services.rs:4316 gateway = fd00:1122:3344:101::1
5932024-12-06T20:40:39.588ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4381
5942024-12-06T20:40:39.675ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/b9ab18cf-4dd7-46c3-920e-833f181cfe8b/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
5952024-12-06T20:40:39.678ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/5a719d2c-fbf6-41ef-af9f-e6b70820ebd4/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
5962024-12-06T20:40:39.678ZINFOSledAgent: datasets ensure: Updated storage file = sled-agent/src/sled_agent.rs:864 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
5972024-12-06T20:40:39.679ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5895023 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:64301 req_id = 75928432-cee0-46be-aacc-03edda760cce response_code = 200 uri = /datasets
5982024-12-06T20:40:39.724ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: 0df5e14a-6e1e-4dcd-bf05-d67f92d30034 (service), filesystem_pool: Some(ZpoolName { id: 50f60e54-9000-4b4d-8705-841b133128b0 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 50f60e54-9000-4b4d-8705-841b133128b0 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: f0d51dc5-eec8-4f23-825b-ece452653cf1 (service), filesystem_pool: Some(ZpoolName { id: 99dfd90b-ff92-45e8-a73e-ada9e3f552c8 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 99dfd90b-ff92-45e8-a73e-ada9e3f552c8 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 2372a96e-6bc5-4e12-9310-7e2f7c4121e7 (service), filesystem_pool: Some(ZpoolName { id: 3b3acf4c-a316-45ce-a055-ef8d6c8acdff (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3b3acf4c-a316-45ce-a055-ef8d6c8acdff (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
5992024-12-06T20:40:39.724ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41434
6002024-12-06T20:40:39.725ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 0df5e14a-6e1e-4dcd-bf05-d67f92d30034, dataset_name: DatasetName { pool_name: ZpoolName { id: 50f60e54-9000-4b4d-8705-841b133128b0 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
6012024-12-06T20:40:39.725ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 0df5e14a-6e1e-4dcd-bf05-d67f92d30034, dataset_name: DatasetName { pool_name: ZpoolName { id: 50f60e54-9000-4b4d-8705-841b133128b0 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6022024-12-06T20:40:39.742ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4447
6032024-12-06T20:40:39.742ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4474
6042024-12-06T20:40:39.760ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: f0d51dc5-eec8-4f23-825b-ece452653cf1, dataset_name: DatasetName { pool_name: ZpoolName { id: 99dfd90b-ff92-45e8-a73e-ada9e3f552c8 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
6052024-12-06T20:40:39.760ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: f0d51dc5-eec8-4f23-825b-ece452653cf1, dataset_name: DatasetName { pool_name: ZpoolName { id: 99dfd90b-ff92-45e8-a73e-ada9e3f552c8 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6062024-12-06T20:40:39.785ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4487
6072024-12-06T20:40:39.785ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4333
6082024-12-06T20:40:39.796ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 2372a96e-6bc5-4e12-9310-7e2f7c4121e7, dataset_name: DatasetName { pool_name: ZpoolName { id: 3b3acf4c-a316-45ce-a055-ef8d6c8acdff (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
6092024-12-06T20:40:39.799ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 2372a96e-6bc5-4e12-9310-7e2f7c4121e7, dataset_name: DatasetName { pool_name: ZpoolName { id: 3b3acf4c-a316-45ce-a055-ef8d6c8acdff (zpool), kind: External }, kind: InternalDns }, responder: ... }
6102024-12-06T20:40:39.833ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6112024-12-06T20:40:39.833ZINFOSledAgent (ServiceManager): No ledger in /pool/int/b9ab18cf-4dd7-46c3-920e-833f181cfe8b/config/omicron-zones.json file = common/src/ledger.rs:188
6122024-12-06T20:40:39.833ZINFOSledAgent (ServiceManager): No ledger in /pool/int/5a719d2c-fbf6-41ef-af9f-e6b70820ebd4/config/omicron-zones.json file = common/src/ledger.rs:188
6132024-12-06T20:40:39.833ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6142024-12-06T20:40:39.836ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4375
6152024-12-06T20:40:39.836ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4454 rack_subnet = fd00:1122:3344::
6162024-12-06T20:40:39.860ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4465
6172024-12-06T20:40:39.860ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4507
6182024-12-06T20:40:39.886ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6192024-12-06T20:40:39.886ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6202024-12-06T20:40:39.886ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6212024-12-06T20:40:39.938ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4539
6222024-12-06T20:40:39.938ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4545
6232024-12-06T20:40:39.945ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_2372a96e-6bc5-4e12-9310-7e2f7c4121e7 file = illumos-utils/src/zone.rs:325
6242024-12-06T20:40:39.951ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_0df5e14a-6e1e-4dcd-bf05-d67f92d30034 file = illumos-utils/src/zone.rs:325
6252024-12-06T20:40:39.956ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_f0d51dc5-eec8-4f23-825b-ece452653cf1 file = illumos-utils/src/zone.rs:325
6262024-12-06T20:40:39.967ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_2372a96e-6bc5-4e12-9310-7e2f7c4121e7 file = illumos-utils/src/zone.rs:363
6272024-12-06T20:40:39.974ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_0df5e14a-6e1e-4dcd-bf05-d67f92d30034 file = illumos-utils/src/zone.rs:363
6282024-12-06T20:40:39.979ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_f0d51dc5-eec8-4f23-825b-ece452653cf1 file = illumos-utils/src/zone.rs:363
6292024-12-06T20:40:40.040ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4586
6302024-12-06T20:40:40.040ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:370
6312024-12-06T20:40:40.080ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:420
6322024-12-06T20:40:40.080ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/0a667526-2006-419e-9b68-c251fd138c06) file = sled-agent/src/nexus.rs:527 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
6332024-12-06T20:40:40.117ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:717
6342024-12-06T20:40:40.117ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:762
6352024-12-06T20:40:40.117ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:765 uptime = 1
6362024-12-06T20:40:40.117ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.2.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: Some(\n None,\n ),\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n tx_eq: None,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:444
6372024-12-06T20:40:40.161ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
6382024-12-06T20:40:40.230ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:603
6392024-12-06T20:40:40.231ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
6402024-12-06T20:40:40.231ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
6412024-12-06T20:40:40.231ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
6422024-12-06T20:40:40.231ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
6432024-12-06T20:40:40.231ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
6442024-12-06T20:40:40.231ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
6452024-12-06T20:40:40.231ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
6462024-12-06T20:40:40.231ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
6472024-12-06T20:40:40.231ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
6482024-12-06T20:40:40.231ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
6492024-12-06T20:40:40.231ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
6502024-12-06T20:40:40.231ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
6512024-12-06T20:40:40.231ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
6522024-12-06T20:40:40.231ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
6532024-12-06T20:40:40.231ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
6542024-12-06T20:40:40.231ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
6552024-12-06T20:40:40.231ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
6562024-12-06T20:40:40.231ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
6572024-12-06T20:40:40.231ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
6582024-12-06T20:40:40.231ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
6592024-12-06T20:40:40.231ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
6602024-12-06T20:40:40.231ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
6612024-12-06T20:40:40.552ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/0a667526-2006-419e-9b68-c251fd138c06) file = sled-agent/src/probe_manager.rs:231 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
6622024-12-06T20:40:40.747ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1717597047978050345 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
6632024-12-06T20:40:40.747ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13509151622581770401 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
6642024-12-06T20:40:41.572ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_f0d51dc5-eec8-4f23-825b-ece452653cf1: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6652024-12-06T20:40:41.572ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
6662024-12-06T20:40:42.051ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_2372a96e-6bc5-4e12-9310-7e2f7c4121e7: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6672024-12-06T20:40:42.529ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
6682024-12-06T20:40:42.529ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_0df5e14a-6e1e-4dcd-bf05-d67f92d30034: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6692024-12-06T20:40:42.529ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_f0d51dc5-eec8-4f23-825b-ece452653cf1 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_f0d51dc5-eec8-4f23-825b-ece452653cf1
6702024-12-06T20:40:42.533ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
6712024-12-06T20:40:42.533ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_2372a96e-6bc5-4e12-9310-7e2f7c4121e7 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_2372a96e-6bc5-4e12-9310-7e2f7c4121e7
6722024-12-06T20:40:42.538ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_0df5e14a-6e1e-4dcd-bf05-d67f92d30034 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_0df5e14a-6e1e-4dcd-bf05-d67f92d30034
6732024-12-06T20:40:42.666ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f0d51dc5-eec8-4f23-825b-ece452653cf1") failed: Property not found. retry in 65.80533ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_f0d51dc5-eec8-4f23-825b-ece452653cf1
6742024-12-06T20:40:42.673ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_2372a96e-6bc5-4e12-9310-7e2f7c4121e7") failed: Property not found. retry in 39.089818ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_2372a96e-6bc5-4e12-9310-7e2f7c4121e7
6752024-12-06T20:40:42.680ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0df5e14a-6e1e-4dcd-bf05-d67f92d30034") failed: Property not found. retry in 40.460381ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0df5e14a-6e1e-4dcd-bf05-d67f92d30034
6762024-12-06T20:40:42.719ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_2372a96e-6bc5-4e12-9310-7e2f7c4121e7") failed: Property not found. retry in 66.664594ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_2372a96e-6bc5-4e12-9310-7e2f7c4121e7
6772024-12-06T20:40:42.728ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0df5e14a-6e1e-4dcd-bf05-d67f92d30034") failed: Property not found. retry in 83.389304ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0df5e14a-6e1e-4dcd-bf05-d67f92d30034
6782024-12-06T20:40:42.821ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f0d51dc5-eec8-4f23-825b-ece452653cf1") failed: Property not found. retry in 115.699574ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_f0d51dc5-eec8-4f23-825b-ece452653cf1
6792024-12-06T20:40:42.876ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_2372a96e-6bc5-4e12-9310-7e2f7c4121e7") failed: Property not found. retry in 257.597838ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_2372a96e-6bc5-4e12-9310-7e2f7c4121e7
6802024-12-06T20:40:42.886ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0df5e14a-6e1e-4dcd-bf05-d67f92d30034") failed: Property not found. retry in 279.755721ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0df5e14a-6e1e-4dcd-bf05-d67f92d30034
6812024-12-06T20:40:42.962ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f0d51dc5-eec8-4f23-825b-ece452653cf1") failed: Property not found. retry in 155.923067ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_f0d51dc5-eec8-4f23-825b-ece452653cf1
6822024-12-06T20:40:43.156ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_2372a96e-6bc5-4e12-9310-7e2f7c4121e7") failed: Property not found. retry in 223.444955ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_2372a96e-6bc5-4e12-9310-7e2f7c4121e7
6832024-12-06T20:40:43.179ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f0d51dc5-eec8-4f23-825b-ece452653cf1") failed: Property not found. retry in 295.666508ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_f0d51dc5-eec8-4f23-825b-ece452653cf1
6842024-12-06T20:40:43.211ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0df5e14a-6e1e-4dcd-bf05-d67f92d30034") failed: Property not found. retry in 482.83259ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0df5e14a-6e1e-4dcd-bf05-d67f92d30034
6852024-12-06T20:40:43.395ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_2372a96e-6bc5-4e12-9310-7e2f7c4121e7") failed: Property not found. retry in 1.088563966s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_2372a96e-6bc5-4e12-9310-7e2f7c4121e7
6862024-12-06T20:40:43.486ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f0d51dc5-eec8-4f23-825b-ece452653cf1") failed: Property not found. retry in 1.002396322s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_f0d51dc5-eec8-4f23-825b-ece452653cf1
6872024-12-06T20:40:43.704ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0df5e14a-6e1e-4dcd-bf05-d67f92d30034") failed: Property not found. retry in 482.241369ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0df5e14a-6e1e-4dcd-bf05-d67f92d30034
6882024-12-06T20:40:44.197ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0df5e14a-6e1e-4dcd-bf05-d67f92d30034") failed: Property not found. retry in 911.360908ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0df5e14a-6e1e-4dcd-bf05-d67f92d30034
6892024-12-06T20:40:44.495ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_2372a96e-6bc5-4e12-9310-7e2f7c4121e7") failed: Property not found. retry in 505.992519ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_2372a96e-6bc5-4e12-9310-7e2f7c4121e7
6902024-12-06T20:40:44.504ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f0d51dc5-eec8-4f23-825b-ece452653cf1") failed: Property not found. retry in 1.213350979s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_f0d51dc5-eec8-4f23-825b-ece452653cf1
6912024-12-06T20:40:45.010ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_2372a96e-6bc5-4e12-9310-7e2f7c4121e7") failed: Property not found. retry in 662.843776ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_2372a96e-6bc5-4e12-9310-7e2f7c4121e7
6922024-12-06T20:40:45.119ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0df5e14a-6e1e-4dcd-bf05-d67f92d30034") failed: Property not found. retry in 774.150534ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0df5e14a-6e1e-4dcd-bf05-d67f92d30034
6932024-12-06T20:40:45.681ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_2372a96e-6bc5-4e12-9310-7e2f7c4121e7") failed: Property not found. retry in 1.434315398s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_2372a96e-6bc5-4e12-9310-7e2f7c4121e7
6942024-12-06T20:40:45.726ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f0d51dc5-eec8-4f23-825b-ece452653cf1") failed: Property not found. retry in 1.192041614s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_f0d51dc5-eec8-4f23-825b-ece452653cf1
6952024-12-06T20:40:45.900ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0df5e14a-6e1e-4dcd-bf05-d67f92d30034") failed: Property not found. retry in 1.453193673s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0df5e14a-6e1e-4dcd-bf05-d67f92d30034
6962024-12-06T20:40:46.928ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f0d51dc5-eec8-4f23-825b-ece452653cf1") failed: Property not found. retry in 1.497660437s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_f0d51dc5-eec8-4f23-825b-ece452653cf1
6972024-12-06T20:40:47.125ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_2372a96e-6bc5-4e12-9310-7e2f7c4121e7") failed: Property not found. retry in 1.383331609s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_2372a96e-6bc5-4e12-9310-7e2f7c4121e7
6982024-12-06T20:40:47.363ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0df5e14a-6e1e-4dcd-bf05-d67f92d30034") failed: Property not found. retry in 733.343862ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0df5e14a-6e1e-4dcd-bf05-d67f92d30034
6992024-12-06T20:40:48.525ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_internal_dns_2372a96e-6bc5-4e12-9310-7e2f7c4121e7
7002024-12-06T20:40:48.525ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_internal_dns_0df5e14a-6e1e-4dcd-bf05-d67f92d30034
7012024-12-06T20:40:48.525ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_internal_dns_f0d51dc5-eec8-4f23-825b-ece452653cf1
7022024-12-06T20:40:48.525ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/b9ab18cf-4dd7-46c3-920e-833f181cfe8b/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7032024-12-06T20:40:48.526ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/5a719d2c-fbf6-41ef-af9f-e6b70820ebd4/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7042024-12-06T20:40:48.526ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8801439 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:41434 req_id = ae2976eb-fcac-40d8-8a75-2285b996d7b6 response_code = 204 uri = /omicron-zones
7052024-12-06T20:40:48.528ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7062024-12-06T20:40:48.606ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 92.086671ms) dns_config_addr = [fd00:1122:3344:1::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:1::1]:5353/config) file = sled-agent/src/rack_setup/service.rs:678
7072024-12-06T20:40:48.718ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7082024-12-06T20:40:48.748ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 92.82641ms) dns_config_addr = [fd00:1122:3344:2::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:2::1]:5353/config) file = sled-agent/src/rack_setup/service.rs:678
7092024-12-06T20:40:48.860ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7102024-12-06T20:40:48.908ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:694
7112024-12-06T20:40:48.908ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7122024-12-06T20:40:48.940ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7132024-12-06T20:40:48.941ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7142024-12-06T20:40:48.941ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7152024-12-06T20:40:48.971ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: 0df5e14a-6e1e-4dcd-bf05-d67f92d30034 (service), filesystem_pool: Some(ZpoolName { id: 50f60e54-9000-4b4d-8705-841b133128b0 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 50f60e54-9000-4b4d-8705-841b133128b0 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: f0d51dc5-eec8-4f23-825b-ece452653cf1 (service), filesystem_pool: Some(ZpoolName { id: 99dfd90b-ff92-45e8-a73e-ada9e3f552c8 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 99dfd90b-ff92-45e8-a73e-ada9e3f552c8 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 2372a96e-6bc5-4e12-9310-7e2f7c4121e7 (service), filesystem_pool: Some(ZpoolName { id: 3b3acf4c-a316-45ce-a055-ef8d6c8acdff (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3b3acf4c-a316-45ce-a055-ef8d6c8acdff (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 2e418c90-5369-4643-83ad-18cceb9dcb5f (service), filesystem_pool: Some(ZpoolName { id: 43474e0b-a6d6-4842-bf66-1060f52875b1 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 432ee6c5-0cf5-4762-8cf1-d37791f3534b, kind: Service { id: 2e418c90-5369-4643-83ad-18cceb9dcb5f }, name: Name("ntp-2e418c90-5369-4643-83ad-18cceb9dcb5f"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 206, 90])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
7162024-12-06T20:40:48.971ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37727
7172024-12-06T20:40:48.971ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 0df5e14a-6e1e-4dcd-bf05-d67f92d30034, dataset_name: DatasetName { pool_name: ZpoolName { id: 50f60e54-9000-4b4d-8705-841b133128b0 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
7182024-12-06T20:40:48.971ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 0df5e14a-6e1e-4dcd-bf05-d67f92d30034, dataset_name: DatasetName { pool_name: ZpoolName { id: 50f60e54-9000-4b4d-8705-841b133128b0 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7192024-12-06T20:40:49.009ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: f0d51dc5-eec8-4f23-825b-ece452653cf1, dataset_name: DatasetName { pool_name: ZpoolName { id: 99dfd90b-ff92-45e8-a73e-ada9e3f552c8 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
7202024-12-06T20:40:49.010ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: f0d51dc5-eec8-4f23-825b-ece452653cf1, dataset_name: DatasetName { pool_name: ZpoolName { id: 99dfd90b-ff92-45e8-a73e-ada9e3f552c8 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7212024-12-06T20:40:49.048ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 2372a96e-6bc5-4e12-9310-7e2f7c4121e7, dataset_name: DatasetName { pool_name: ZpoolName { id: 3b3acf4c-a316-45ce-a055-ef8d6c8acdff (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
7222024-12-06T20:40:49.048ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 2372a96e-6bc5-4e12-9310-7e2f7c4121e7, dataset_name: DatasetName { pool_name: ZpoolName { id: 3b3acf4c-a316-45ce-a055-ef8d6c8acdff (zpool), kind: External }, kind: InternalDns }, responder: ... }
7232024-12-06T20:40:49.086ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7242024-12-06T20:40:49.086ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b9ab18cf-4dd7-46c3-920e-833f181cfe8b/config/omicron-zones.json file = common/src/ledger.rs:177
7252024-12-06T20:40:49.086ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/5a719d2c-fbf6-41ef-af9f-e6b70820ebd4/config/omicron-zones.json file = common/src/ledger.rs:177
7262024-12-06T20:40:49.086ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7272024-12-06T20:40:49.097ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7282024-12-06T20:40:49.130ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7292024-12-06T20:40:49.131ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7302024-12-06T20:40:49.131ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7312024-12-06T20:40:49.161ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 206, 90]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
7322024-12-06T20:40:49.161ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1263 zone_type = boundary_ntp
7332024-12-06T20:40:49.161ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:83
7342024-12-06T20:40:49.161ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:90
7352024-12-06T20:40:49.161ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:118
7362024-12-06T20:40:49.162ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7372024-12-06T20:40:49.186ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_2e418c90-5369-4643-83ad-18cceb9dcb5f file = illumos-utils/src/zone.rs:325
7382024-12-06T20:40:49.205ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_2e418c90-5369-4643-83ad-18cceb9dcb5f file = illumos-utils/src/zone.rs:363
7392024-12-06T20:40:49.370ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13603920217495633252 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
7402024-12-06T20:40:49.370ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7059390950470138893 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
7412024-12-06T20:40:49.821ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_2e418c90-5369-4643-83ad-18cceb9dcb5f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7422024-12-06T20:40:49.821ZINFOSledAgent (ServiceManager): Booting oxz_ntp_2e418c90-5369-4643-83ad-18cceb9dcb5f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_ntp_2e418c90-5369-4643-83ad-18cceb9dcb5f
7432024-12-06T20:40:49.958ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_2e418c90-5369-4643-83ad-18cceb9dcb5f") failed: Property not found. retry in 28.943321ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_2e418c90-5369-4643-83ad-18cceb9dcb5f
7442024-12-06T20:40:49.995ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_2e418c90-5369-4643-83ad-18cceb9dcb5f") failed: Property not found. retry in 148.094538ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_2e418c90-5369-4643-83ad-18cceb9dcb5f
7452024-12-06T20:40:50.155ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_2e418c90-5369-4643-83ad-18cceb9dcb5f") failed: Property not found. retry in 151.516927ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_2e418c90-5369-4643-83ad-18cceb9dcb5f
7462024-12-06T20:40:50.318ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_2e418c90-5369-4643-83ad-18cceb9dcb5f") failed: Property not found. retry in 457.903658ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_2e418c90-5369-4643-83ad-18cceb9dcb5f
7472024-12-06T20:40:50.749ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1717597047978050345 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
7482024-12-06T20:40:50.749ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13509151622581770401 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
7492024-12-06T20:40:50.786ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_2e418c90-5369-4643-83ad-18cceb9dcb5f") failed: Property not found. retry in 665.551685ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_2e418c90-5369-4643-83ad-18cceb9dcb5f
7502024-12-06T20:40:51.461ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_2e418c90-5369-4643-83ad-18cceb9dcb5f") failed: Property not found. retry in 1.10873047s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_2e418c90-5369-4643-83ad-18cceb9dcb5f
7512024-12-06T20:40:52.580ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_2e418c90-5369-4643-83ad-18cceb9dcb5f") failed: Property not found. retry in 1.398653655s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_2e418c90-5369-4643-83ad-18cceb9dcb5f
7522024-12-06T20:40:53.987ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_2e418c90-5369-4643-83ad-18cceb9dcb5f") failed: Property not found. retry in 830.388704ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_2e418c90-5369-4643-83ad-18cceb9dcb5f
7532024-12-06T20:40:54.840ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_ntp_2e418c90-5369-4643-83ad-18cceb9dcb5f
7542024-12-06T20:40:54.840ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/b9ab18cf-4dd7-46c3-920e-833f181cfe8b/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7552024-12-06T20:40:54.841ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/5a719d2c-fbf6-41ef-af9f-e6b70820ebd4/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7562024-12-06T20:40:54.841ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5869881 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:37727 req_id = 81fd7d02-c8a8-429e-a9fa-039e8d2adf5b response_code = 204 uri = /omicron-zones
7572024-12-06T20:40:54.844ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:735
7582024-12-06T20:40:54.874ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
7592024-12-06T20:40:54.874ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63577
7602024-12-06T20:40:54.884ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_2e418c90-5369-4643-83ad-18cceb9dcb5f': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
7612024-12-06T20:40:54.884ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 10285 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:63577 req_id = 7adcc753-82ef-4985-a080-5c65b12de391 response_code = 500 uri = /timesync
7622024-12-06T20:40:54.887ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
7632024-12-06T20:40:54.991ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
7642024-12-06T20:40:54.991ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58311
7652024-12-06T20:40:58.122ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2858702383074311651 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
7662024-12-06T20:40:58.447ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3632607179920883977 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
7672024-12-06T20:40:58.528ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6976710072287266719 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
7682024-12-06T20:40:59.000ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_2e418c90-5369-4643-83ad-18cceb9dcb5f': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
7692024-12-06T20:40:59.000ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 4008424 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:58311 req_id = e3daba08-5e3c-4765-8a08-30b5938a51df response_code = 500 uri = /timesync
7702024-12-06T20:40:59.002ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
7712024-12-06T20:40:59.194ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
7722024-12-06T20:40:59.194ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56312
7732024-12-06T20:40:59.202ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_2e418c90-5369-4643-83ad-18cceb9dcb5f': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
7742024-12-06T20:40:59.202ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 8391 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:56312 req_id = 8e674ad4-b194-4614-bcd9-4d2980fc9114 response_code = 500 uri = /timesync
7752024-12-06T20:40:59.205ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
7762024-12-06T20:40:59.372ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13603920217495633252 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
7772024-12-06T20:40:59.372ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7059390950470138893 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
7782024-12-06T20:40:59.423ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
7792024-12-06T20:40:59.423ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47602
7802024-12-06T20:40:59.431ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_2e418c90-5369-4643-83ad-18cceb9dcb5f': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
7812024-12-06T20:40:59.431ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 8214 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:47602 req_id = e1b43f58-def4-4cc5-ad03-b3828d880ed9 response_code = 500 uri = /timesync
7822024-12-06T20:40:59.433ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
7832024-12-06T20:40:59.689ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
7842024-12-06T20:40:59.690ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40984
7852024-12-06T20:41:00.751ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1717597047978050345 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
7862024-12-06T20:41:00.752ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13509151622581770401 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
7872024-12-06T20:41:03.834ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4009230 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:40984 req_id = cc47a31c-04de-4916-b9c4-a1d687aaa5d5 response_code = 200 uri = /timesync
7882024-12-06T20:41:03.836ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.321416378 } file = sled-agent/src/rack_setup/service.rs:743
7892024-12-06T20:41:03.836ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
7902024-12-06T20:41:04.010ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
7912024-12-06T20:41:04.010ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40107
7922024-12-06T20:41:04.019ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8488 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:40107 req_id = 55c1617a-85e2-43fd-b0a5-b82b4fb99454 response_code = 200 uri = /timesync
7932024-12-06T20:41:04.022ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.32246086 } file = sled-agent/src/rack_setup/service.rs:743
7942024-12-06T20:41:04.022ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
7952024-12-06T20:41:04.387ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
7962024-12-06T20:41:04.387ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64434
7972024-12-06T20:41:04.395ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8328 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:64434 req_id = e9855b85-2897-4c18-9394-8aee02843a70 response_code = 200 uri = /timesync
7982024-12-06T20:41:04.398ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.321439177 } file = sled-agent/src/rack_setup/service.rs:743
7992024-12-06T20:41:04.398ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8002024-12-06T20:41:04.872ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8012024-12-06T20:41:04.872ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34639
8022024-12-06T20:41:04.880ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7533 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:34639 req_id = a16b8691-77e1-4b40-9661-a526913df8dc response_code = 200 uri = /timesync
8032024-12-06T20:41:04.883ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.318921268 } file = sled-agent/src/rack_setup/service.rs:743
8042024-12-06T20:41:04.883ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8052024-12-06T20:41:04.976ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2555974512672074546 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
8062024-12-06T20:41:04.976ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12460408404197926133 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
8072024-12-06T20:41:05.155ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8082024-12-06T20:41:05.155ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64363
8092024-12-06T20:41:05.163ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7910 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:64363 req_id = f2d6d21d-9ae5-4c1f-99fa-3e961576dd67 response_code = 200 uri = /timesync
8102024-12-06T20:41:05.167ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.318150997 } file = sled-agent/src/rack_setup/service.rs:743
8112024-12-06T20:41:05.167ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8122024-12-06T20:41:05.193ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 173.577626ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
8132024-12-06T20:41:05.691ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8142024-12-06T20:41:05.692ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52170
8152024-12-06T20:41:05.700ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8227 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:52170 req_id = e8081489-0978-4a82-bd08-7d1351d8e6ff response_code = 200 uri = /timesync
8162024-12-06T20:41:05.702ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.316865116 } file = sled-agent/src/rack_setup/service.rs:743
8172024-12-06T20:41:05.703ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8182024-12-06T20:41:06.168ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8192024-12-06T20:41:06.168ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51575
8202024-12-06T20:41:06.176ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8058 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:51575 req_id = d23e334c-07de-4731-988d-ecd1132c8f5e response_code = 200 uri = /timesync
8212024-12-06T20:41:06.179ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.315571368 } file = sled-agent/src/rack_setup/service.rs:743
8222024-12-06T20:41:06.179ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8232024-12-06T20:41:06.970ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8242024-12-06T20:41:06.970ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58726
8252024-12-06T20:41:06.979ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8702 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:58726 req_id = 2e7c66d3-b836-4305-a427-c340b3735f5b response_code = 200 uri = /timesync
8262024-12-06T20:41:06.981ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2501691571, ip_addr: 149.28.200.179, stratum: 3, ref_time: 1733517666.325102, correction: -0.313169628 } file = sled-agent/src/rack_setup/service.rs:743
8272024-12-06T20:41:06.981ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8282024-12-06T20:41:07.679ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8292024-12-06T20:41:07.679ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52343
8302024-12-06T20:41:07.688ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8370 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:52343 req_id = e62db700-9f76-47df-b2b5-54faa9de12d0 response_code = 200 uri = /timesync
8312024-12-06T20:41:07.691ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1733517664.9299402, correction: -0.311242074 } file = sled-agent/src/rack_setup/service.rs:743
8322024-12-06T20:41:07.691ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8332024-12-06T20:41:08.181ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8342024-12-06T20:41:08.181ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46262
8352024-12-06T20:41:08.188ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7386 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:46262 req_id = 54de2ba2-24c9-4924-8d31-2098792dbc23 response_code = 200 uri = /timesync
8362024-12-06T20:41:08.192ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2501691571, ip_addr: 149.28.200.179, stratum: 3, ref_time: 1733517666.8579023, correction: -0.309801459 } file = sled-agent/src/rack_setup/service.rs:743
8372024-12-06T20:41:08.192ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8382024-12-06T20:41:08.248ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2858702383074311651 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
8392024-12-06T20:41:08.571ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3632607179920883977 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
8402024-12-06T20:41:08.651ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6976710072287266719 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
8412024-12-06T20:41:09.011ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8422024-12-06T20:41:09.011ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48676
8432024-12-06T20:41:09.019ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7337 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:48676 req_id = d83a8283-8e1b-4f24-b477-49f59998bdc1 response_code = 200 uri = /timesync
8442024-12-06T20:41:09.022ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2501691571, ip_addr: 149.28.200.179, stratum: 3, ref_time: 1733517668.1191075, correction: -0.307311684 } file = sled-agent/src/rack_setup/service.rs:743
8452024-12-06T20:41:09.022ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8462024-12-06T20:41:09.494ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13603920217495633252 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
8472024-12-06T20:41:09.495ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7059390950470138893 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
8482024-12-06T20:41:09.773ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8492024-12-06T20:41:09.773ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45744
8502024-12-06T20:41:09.780ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7444 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:45744 req_id = 1c3ce18b-6e39-4785-b48e-a7ec69c61b15 response_code = 200 uri = /timesync
8512024-12-06T20:41:09.783ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1757546723, ip_addr: 104.194.8.227, stratum: 3, ref_time: 1733517668.6683922, correction: -0.305126041 } file = sled-agent/src/rack_setup/service.rs:743
8522024-12-06T20:41:09.783ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8532024-12-06T20:41:09.884ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:47134
8542024-12-06T20:41:09.884ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:47134 req_id = 82a77374-cca8-4b34-98b1-5f40d7523866 response_code = 200 uri = /baseboard
8552024-12-06T20:41:10.870ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1717597047978050345 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
8562024-12-06T20:41:10.870ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13509151622581770401 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
8572024-12-06T20:41:11.482ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8582024-12-06T20:41:11.482ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48228
8592024-12-06T20:41:11.489ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7601 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:48228 req_id = fa37cdfa-ff85-4e38-8973-224190135512 response_code = 200 uri = /timesync
8602024-12-06T20:41:11.493ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1757546723, ip_addr: 104.194.8.227, stratum: 3, ref_time: 1733517669.988826, correction: -0.30045104 } file = sled-agent/src/rack_setup/service.rs:743
8612024-12-06T20:41:11.493ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8622024-12-06T20:41:14.125ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8632024-12-06T20:41:14.125ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56266
8642024-12-06T20:41:14.133ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8415 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:56266 req_id = f6f8fa04-83f3-45ec-9a87-d41986641243 response_code = 200 uri = /timesync
8652024-12-06T20:41:14.137ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1757546723, ip_addr: 104.194.8.227, stratum: 3, ref_time: 1733517673.2567997, correction: -0.293120265 } file = sled-agent/src/rack_setup/service.rs:743
8662024-12-06T20:41:14.137ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8672024-12-06T20:41:14.951ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2555974512672074546 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
8682024-12-06T20:41:14.951ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12460408404197926133 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
8692024-12-06T20:41:16.360ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8702024-12-06T20:41:16.360ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42332
8712024-12-06T20:41:16.370ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9446 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42332 req_id = 0c3bcaee-0217-4992-8f93-c1a4060de42e response_code = 200 uri = /timesync
8722024-12-06T20:41:16.374ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1757546723, ip_addr: 104.194.8.227, stratum: 3, ref_time: 1733517675.248371, correction: -0.287084579 } file = sled-agent/src/rack_setup/service.rs:743
8732024-12-06T20:41:16.374ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8742024-12-06T20:41:18.224ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2858702383074311651 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
8752024-12-06T20:41:18.545ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3632607179920883977 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
8762024-12-06T20:41:18.625ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6976710072287266719 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
8772024-12-06T20:41:19.335ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8782024-12-06T20:41:19.335ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43069
8792024-12-06T20:41:19.344ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8753 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:43069 req_id = 8d020b63-6c7d-4f4f-ba51-ada63de10f46 response_code = 200 uri = /timesync
8802024-12-06T20:41:19.347ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1757546723, ip_addr: 104.194.8.227, stratum: 3, ref_time: 1733517678.3613026, correction: -0.279047877 } file = sled-agent/src/rack_setup/service.rs:743
8812024-12-06T20:41:19.347ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8822024-12-06T20:41:19.470ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13603920217495633252 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
8832024-12-06T20:41:19.470ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7059390950470138893 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
8842024-12-06T20:41:20.360ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 453.000915ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
8852024-12-06T20:41:20.844ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1717597047978050345 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
8862024-12-06T20:41:20.845ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13509151622581770401 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
8872024-12-06T20:41:22.843ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8882024-12-06T20:41:22.843ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57174
8892024-12-06T20:41:22.852ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8436 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:57174 req_id = 3fc9d07a-1d43-4eda-b973-41cea296a24e response_code = 200 uri = /timesync
8902024-12-06T20:41:22.856ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1757546723, ip_addr: 104.194.8.227, stratum: 3, ref_time: 1733517681.1921017, correction: -0.269544184 } file = sled-agent/src/rack_setup/service.rs:743
8912024-12-06T20:41:22.856ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8922024-12-06T20:41:24.926ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2555974512672074546 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
8932024-12-06T20:41:24.926ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12460408404197926133 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
8942024-12-06T20:41:27.182ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8952024-12-06T20:41:27.182ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37330
8962024-12-06T20:41:27.191ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8452 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:37330 req_id = b210516d-1f7d-4c87-82bf-83a18f4a8b64 response_code = 200 uri = /timesync
8972024-12-06T20:41:27.195ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1757546723, ip_addr: 104.194.8.227, stratum: 3, ref_time: 1733517685.8285992, correction: -0.257754624 } file = sled-agent/src/rack_setup/service.rs:743
8982024-12-06T20:41:27.195ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8992024-12-06T20:41:28.200ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2858702383074311651 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
9002024-12-06T20:41:28.518ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3632607179920883977 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
9012024-12-06T20:41:28.599ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6976710072287266719 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
9022024-12-06T20:41:29.444ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 13603920217495633252 reason = Duration(60s) sled_id = 0a667526-2006-419e-9b68-c251fd138c06
9032024-12-06T20:41:29.445ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 7059390950470138893 reason = Duration(60s) sled_id = 0a667526-2006-419e-9b68-c251fd138c06
9042024-12-06T20:41:29.847ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9052024-12-06T20:41:29.847ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61294
9062024-12-06T20:41:29.856ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8687 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:61294 req_id = 3bbbe9e0-b440-404e-95fb-9d4248883aab response_code = 200 uri = /timesync
9072024-12-06T20:41:29.858ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1757546723, ip_addr: 104.194.8.227, stratum: 3, ref_time: 1733517688.2976997, correction: -0.250516802 } file = sled-agent/src/rack_setup/service.rs:743
9082024-12-06T20:41:29.858ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9092024-12-06T20:41:30.819ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1717597047978050345 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
9102024-12-06T20:41:30.820ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13509151622581770401 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
9112024-12-06T20:41:34.900ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2555974512672074546 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
9122024-12-06T20:41:34.901ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12460408404197926133 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
9132024-12-06T20:41:35.807ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.416200883s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
9142024-12-06T20:41:36.890ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9152024-12-06T20:41:36.890ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:36257
9162024-12-06T20:41:36.898ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:36257 req_id = 7dca800d-32b0-418f-806d-c2674862e938 response_code = 200 uri = /timesync
9172024-12-06T20:41:36.900ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1757546723, ip_addr: 104.194.8.227, stratum: 3, ref_time: 1733517694.8509924, correction: -0.231361076 } file = sled-agent/src/rack_setup/service.rs:743
9182024-12-06T20:41:36.900ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9192024-12-06T20:41:38.176ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2858702383074311651 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
9202024-12-06T20:41:38.492ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3632607179920883977 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
9212024-12-06T20:41:38.573ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6976710072287266719 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
9222024-12-06T20:41:39.837ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:54253
9232024-12-06T20:41:39.837ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:54253 req_id = 8d2dbc41-4183-4954-873d-6b0ca93099bd response_code = 200 uri = /baseboard
9242024-12-06T20:41:40.795ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1717597047978050345 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
9252024-12-06T20:41:40.795ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13509151622581770401 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
9262024-12-06T20:41:41.569ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9272024-12-06T20:41:41.570ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62886
9282024-12-06T20:41:41.578ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8573 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:62886 req_id = c161fc60-ae1a-413a-8027-404f03d4505f response_code = 200 uri = /timesync
9292024-12-06T20:41:41.582ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1757546723, ip_addr: 104.194.8.227, stratum: 3, ref_time: 1733517699.0043662, correction: -0.218686774 } file = sled-agent/src/rack_setup/service.rs:743
9302024-12-06T20:41:41.582ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9312024-12-06T20:41:44.876ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2555974512672074546 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
9322024-12-06T20:41:44.876ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12460408404197926133 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
9332024-12-06T20:41:48.151ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 2858702383074311651 reason = Duration(60s) sled_id = 0a667526-2006-419e-9b68-c251fd138c06
9342024-12-06T20:41:48.466ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 3632607179920883977 reason = Duration(60s) sled_id = 0a667526-2006-419e-9b68-c251fd138c06
9352024-12-06T20:41:48.547ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 6976710072287266719 reason = Duration(60s) sled_id = 0a667526-2006-419e-9b68-c251fd138c06
9362024-12-06T20:41:50.769ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1717597047978050345 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
9372024-12-06T20:41:50.769ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13509151622581770401 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
9382024-12-06T20:41:51.846ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9392024-12-06T20:41:51.846ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46079
9402024-12-06T20:41:51.854ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7902 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:46079 req_id = 61f3396b-6864-4945-9805-b57b64262805 response_code = 200 uri = /timesync
9412024-12-06T20:41:51.858ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1757546723, ip_addr: 104.194.8.227, stratum: 3, ref_time: 1733517710.9393184, correction: -0.190757141 } file = sled-agent/src/rack_setup/service.rs:743
9422024-12-06T20:41:51.858ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9432024-12-06T20:41:52.214ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 2.97096716s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
9442024-12-06T20:41:54.851ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 2555974512672074546 reason = Duration(60s) sled_id = 0a667526-2006-419e-9b68-c251fd138c06
9452024-12-06T20:41:54.851ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 12460408404197926133 reason = Duration(60s) sled_id = 0a667526-2006-419e-9b68-c251fd138c06
9462024-12-06T20:41:59.590ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9472024-12-06T20:41:59.590ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61160
9482024-12-06T20:41:59.599ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9150 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:61160 req_id = 0857f4a7-15d7-461b-9ea7-f6df224db5fc response_code = 200 uri = /timesync
9492024-12-06T20:41:59.603ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1757546723, ip_addr: 104.194.8.227, stratum: 3, ref_time: 1733517715.1045096, correction: -0.169716388 } file = sled-agent/src/rack_setup/service.rs:743
9502024-12-06T20:41:59.603ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9512024-12-06T20:42:00.744ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1717597047978050345 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
9522024-12-06T20:42:00.744ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13509151622581770401 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
9532024-12-06T20:42:09.274ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9542024-12-06T20:42:09.274ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56319
9552024-12-06T20:42:09.284ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9364 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:56319 req_id = 7825b028-74d4-40bc-98c7-54d9005c9fe2 response_code = 200 uri = /timesync
9562024-12-06T20:42:09.286ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1757546723, ip_addr: 104.194.8.227, stratum: 3, ref_time: 1733517722.800934, correction: -0.143421531 } file = sled-agent/src/rack_setup/service.rs:743
9572024-12-06T20:42:09.286ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9582024-12-06T20:42:09.789ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:58299
9592024-12-06T20:42:09.789ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 27 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:58299 req_id = 459012f0-34a1-4820-8b68-4f328bf76f3c response_code = 200 uri = /baseboard
9602024-12-06T20:42:10.172ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 2.410690515s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
9612024-12-06T20:42:10.718ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1717597047978050345 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
9622024-12-06T20:42:10.718ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13509151622581770401 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
9632024-12-06T20:42:20.694ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1717597047978050345 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
9642024-12-06T20:42:20.694ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13509151622581770401 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
9652024-12-06T20:42:25.475ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9662024-12-06T20:42:25.475ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57643
9672024-12-06T20:42:25.484ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8901 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:57643 req_id = 3e2e9404-5dbf-4d15-9e71-6d7e8b3b52d0 response_code = 200 uri = /timesync
9682024-12-06T20:42:25.488ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1757546723, ip_addr: 104.194.8.227, stratum: 3, ref_time: 1733517739.0811267, correction: -0.099385075 } file = sled-agent/src/rack_setup/service.rs:743
9692024-12-06T20:42:25.488ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9702024-12-06T20:42:27.572ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 7.488945331s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
9712024-12-06T20:42:30.668ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1717597047978050345 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
9722024-12-06T20:42:30.668ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13509151622581770401 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
9732024-12-06T20:42:35.695ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9742024-12-06T20:42:35.695ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35622
9752024-12-06T20:42:35.704ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8816 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:35622 req_id = ae5be007-9873-44ad-a713-c5faf592258e response_code = 200 uri = /timesync
9762024-12-06T20:42:35.706ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1757546723, ip_addr: 104.194.8.227, stratum: 3, ref_time: 1733517747.2857244, correction: -0.071650289 } file = sled-agent/src/rack_setup/service.rs:743
9772024-12-06T20:42:35.706ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9782024-12-06T20:42:39.743ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:38235
9792024-12-06T20:42:39.743ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:38235 req_id = 8323bd25-967b-431e-930d-606ac303fa57 response_code = 200 uri = /baseboard
9802024-12-06T20:42:40.643ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1717597047978050345 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
9812024-12-06T20:42:40.643ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13509151622581770401 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
9822024-12-06T20:42:50.035ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 11.391810232s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
9832024-12-06T20:42:50.618ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1717597047978050345 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
9842024-12-06T20:42:50.618ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13509151622581770401 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
9852024-12-06T20:42:58.595ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9862024-12-06T20:42:58.595ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56316
9872024-12-06T20:42:58.616ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 21570 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:56316 req_id = d1100711-6e5f-45af-889a-c56bfeeca67f response_code = 200 uri = /timesync
9882024-12-06T20:42:58.616ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-12-06T20:41:54.851267925Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 2555974512672074546 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
9892024-12-06T20:42:58.618ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-12-06T20:41:29.444627615Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 13603920217495633252 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
9902024-12-06T20:42:58.618ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-12-06T20:41:48.466284707Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 3632607179920883977 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
9912024-12-06T20:42:58.618ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-12-06T20:41:48.151220603Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 2858702383074311651 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
9922024-12-06T20:42:58.619ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-12-06T20:41:54.851569538Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 12460408404197926133 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
9932024-12-06T20:42:58.619ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-12-06T20:41:48.547533878Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 6976710072287266719 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
9942024-12-06T20:42:58.619ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-12-06T20:41:29.445164428Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 7059390950470138893 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
9952024-12-06T20:42:58.620ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 1757546723, ip_addr: 104.194.8.227, stratum: 3, ref_time: 1733517771.6668494, correction: -0.009453209 } file = sled-agent/src/rack_setup/service.rs:743
9962024-12-06T20:42:58.620ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1392
9972024-12-06T20:42:58.649ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 0df5e14a-6e1e-4dcd-bf05-d67f92d30034 (service), filesystem_pool: Some(ZpoolName { id: 50f60e54-9000-4b4d-8705-841b133128b0 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 50f60e54-9000-4b4d-8705-841b133128b0 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: f0d51dc5-eec8-4f23-825b-ece452653cf1 (service), filesystem_pool: Some(ZpoolName { id: 99dfd90b-ff92-45e8-a73e-ada9e3f552c8 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 99dfd90b-ff92-45e8-a73e-ada9e3f552c8 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 2372a96e-6bc5-4e12-9310-7e2f7c4121e7 (service), filesystem_pool: Some(ZpoolName { id: 3b3acf4c-a316-45ce-a055-ef8d6c8acdff (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3b3acf4c-a316-45ce-a055-ef8d6c8acdff (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 2e418c90-5369-4643-83ad-18cceb9dcb5f (service), filesystem_pool: Some(ZpoolName { id: 43474e0b-a6d6-4842-bf66-1060f52875b1 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 432ee6c5-0cf5-4762-8cf1-d37791f3534b, kind: Service { id: 2e418c90-5369-4643-83ad-18cceb9dcb5f }, name: Name("ntp-2e418c90-5369-4643-83ad-18cceb9dcb5f"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 206, 90])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 4e6cf073-224e-417c-8875-16567605c2be (service), filesystem_pool: Some(ZpoolName { id: 50f60e54-9000-4b4d-8705-841b133128b0 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 50f60e54-9000-4b4d-8705-841b133128b0 (zpool), kind: External } } } }, OmicronZoneConfig { id: 196fdb83-e76c-47d9-a9ee-d0429aa71154 (service), filesystem_pool: Some(ZpoolName { id: 99dfd90b-ff92-45e8-a73e-ada9e3f552c8 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 99dfd90b-ff92-45e8-a73e-ada9e3f552c8 (zpool), kind: External } } } }, OmicronZoneConfig { id: eb71a443-d6ff-40d1-b0f6-d5e30927d1c2 (service), filesystem_pool: Some(ZpoolName { id: 3b3acf4c-a316-45ce-a055-ef8d6c8acdff (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3b3acf4c-a316-45ce-a055-ef8d6c8acdff (zpool), kind: External } } } }, OmicronZoneConfig { id: c26c9d62-aefd-4ced-b0e7-da16bf299c4d (service), filesystem_pool: Some(ZpoolName { id: 5f5a9c7a-eec2-4e86-a02e-9238700fe7ab (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5f5a9c7a-eec2-4e86-a02e-9238700fe7ab (zpool), kind: External } } } }, OmicronZoneConfig { id: 27229a74-6d47-442c-a7ab-393b73cf74df (service), filesystem_pool: Some(ZpoolName { id: 8e389ddd-65e9-4954-ab37-e305d4d4e112 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8e389ddd-65e9-4954-ab37-e305d4d4e112 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
9982024-12-06T20:42:58.649ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59268
9992024-12-06T20:42:58.650ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 0df5e14a-6e1e-4dcd-bf05-d67f92d30034, dataset_name: DatasetName { pool_name: ZpoolName { id: 50f60e54-9000-4b4d-8705-841b133128b0 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
10002024-12-06T20:42:58.650ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 0df5e14a-6e1e-4dcd-bf05-d67f92d30034, dataset_name: DatasetName { pool_name: ZpoolName { id: 50f60e54-9000-4b4d-8705-841b133128b0 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10012024-12-06T20:42:58.685ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: f0d51dc5-eec8-4f23-825b-ece452653cf1, dataset_name: DatasetName { pool_name: ZpoolName { id: 99dfd90b-ff92-45e8-a73e-ada9e3f552c8 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
10022024-12-06T20:42:58.685ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: f0d51dc5-eec8-4f23-825b-ece452653cf1, dataset_name: DatasetName { pool_name: ZpoolName { id: 99dfd90b-ff92-45e8-a73e-ada9e3f552c8 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10032024-12-06T20:42:58.717ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 2372a96e-6bc5-4e12-9310-7e2f7c4121e7, dataset_name: DatasetName { pool_name: ZpoolName { id: 3b3acf4c-a316-45ce-a055-ef8d6c8acdff (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
10042024-12-06T20:42:58.717ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 2372a96e-6bc5-4e12-9310-7e2f7c4121e7, dataset_name: DatasetName { pool_name: ZpoolName { id: 3b3acf4c-a316-45ce-a055-ef8d6c8acdff (zpool), kind: External }, kind: InternalDns }, responder: ... }
10052024-12-06T20:42:58.746ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 4e6cf073-224e-417c-8875-16567605c2be, dataset_name: DatasetName { pool_name: ZpoolName { id: 50f60e54-9000-4b4d-8705-841b133128b0 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10062024-12-06T20:42:58.746ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 4e6cf073-224e-417c-8875-16567605c2be, dataset_name: DatasetName { pool_name: ZpoolName { id: 50f60e54-9000-4b4d-8705-841b133128b0 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10072024-12-06T20:42:58.776ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 196fdb83-e76c-47d9-a9ee-d0429aa71154, dataset_name: DatasetName { pool_name: ZpoolName { id: 99dfd90b-ff92-45e8-a73e-ada9e3f552c8 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10082024-12-06T20:42:58.776ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 196fdb83-e76c-47d9-a9ee-d0429aa71154, dataset_name: DatasetName { pool_name: ZpoolName { id: 99dfd90b-ff92-45e8-a73e-ada9e3f552c8 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10092024-12-06T20:42:58.805ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: eb71a443-d6ff-40d1-b0f6-d5e30927d1c2, dataset_name: DatasetName { pool_name: ZpoolName { id: 3b3acf4c-a316-45ce-a055-ef8d6c8acdff (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10102024-12-06T20:42:58.805ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: eb71a443-d6ff-40d1-b0f6-d5e30927d1c2, dataset_name: DatasetName { pool_name: ZpoolName { id: 3b3acf4c-a316-45ce-a055-ef8d6c8acdff (zpool), kind: External }, kind: Cockroach }, responder: ... }
10112024-12-06T20:42:58.836ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: c26c9d62-aefd-4ced-b0e7-da16bf299c4d, dataset_name: DatasetName { pool_name: ZpoolName { id: 5f5a9c7a-eec2-4e86-a02e-9238700fe7ab (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10122024-12-06T20:42:58.836ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: c26c9d62-aefd-4ced-b0e7-da16bf299c4d, dataset_name: DatasetName { pool_name: ZpoolName { id: 5f5a9c7a-eec2-4e86-a02e-9238700fe7ab (zpool), kind: External }, kind: Cockroach }, responder: ... }
10132024-12-06T20:42:58.864ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 27229a74-6d47-442c-a7ab-393b73cf74df, dataset_name: DatasetName { pool_name: ZpoolName { id: 8e389ddd-65e9-4954-ab37-e305d4d4e112 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10142024-12-06T20:42:58.865ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 27229a74-6d47-442c-a7ab-393b73cf74df, dataset_name: DatasetName { pool_name: ZpoolName { id: 8e389ddd-65e9-4954-ab37-e305d4d4e112 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10152024-12-06T20:42:58.895ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10162024-12-06T20:42:58.895ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b9ab18cf-4dd7-46c3-920e-833f181cfe8b/config/omicron-zones.json file = common/src/ledger.rs:177
10172024-12-06T20:42:58.895ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/5a719d2c-fbf6-41ef-af9f-e6b70820ebd4/config/omicron-zones.json file = common/src/ledger.rs:177
10182024-12-06T20:42:58.896ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10192024-12-06T20:42:58.976ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10202024-12-06T20:42:58.976ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10212024-12-06T20:42:58.976ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10222024-12-06T20:42:58.976ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10232024-12-06T20:42:58.976ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10242024-12-06T20:42:59.068ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_4e6cf073-224e-417c-8875-16567605c2be file = illumos-utils/src/zone.rs:325
10252024-12-06T20:42:59.072ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_196fdb83-e76c-47d9-a9ee-d0429aa71154 file = illumos-utils/src/zone.rs:325
10262024-12-06T20:42:59.076ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_eb71a443-d6ff-40d1-b0f6-d5e30927d1c2 file = illumos-utils/src/zone.rs:325
10272024-12-06T20:42:59.080ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_c26c9d62-aefd-4ced-b0e7-da16bf299c4d file = illumos-utils/src/zone.rs:325
10282024-12-06T20:42:59.085ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_27229a74-6d47-442c-a7ab-393b73cf74df file = illumos-utils/src/zone.rs:325
10292024-12-06T20:42:59.090ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_4e6cf073-224e-417c-8875-16567605c2be file = illumos-utils/src/zone.rs:363
10302024-12-06T20:42:59.094ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_196fdb83-e76c-47d9-a9ee-d0429aa71154 file = illumos-utils/src/zone.rs:363
10312024-12-06T20:42:59.099ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_eb71a443-d6ff-40d1-b0f6-d5e30927d1c2 file = illumos-utils/src/zone.rs:363
10322024-12-06T20:42:59.103ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_c26c9d62-aefd-4ced-b0e7-da16bf299c4d file = illumos-utils/src/zone.rs:363
10332024-12-06T20:42:59.108ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_27229a74-6d47-442c-a7ab-393b73cf74df file = illumos-utils/src/zone.rs:363
10342024-12-06T20:43:02.019ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_4e6cf073-224e-417c-8875-16567605c2be: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='4e6cf073-224e-417c-8875-16567605c2be'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10352024-12-06T20:43:02.019ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_4e6cf073-224e-417c-8875-16567605c2be zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_4e6cf073-224e-417c-8875-16567605c2be
10362024-12-06T20:43:02.065ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_eb71a443-d6ff-40d1-b0f6-d5e30927d1c2: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='eb71a443-d6ff-40d1-b0f6-d5e30927d1c2'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10372024-12-06T20:43:02.066ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_eb71a443-d6ff-40d1-b0f6-d5e30927d1c2 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_eb71a443-d6ff-40d1-b0f6-d5e30927d1c2
10382024-12-06T20:43:02.072ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_c26c9d62-aefd-4ced-b0e7-da16bf299c4d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='c26c9d62-aefd-4ced-b0e7-da16bf299c4d'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10392024-12-06T20:43:02.072ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_196fdb83-e76c-47d9-a9ee-d0429aa71154: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='196fdb83-e76c-47d9-a9ee-d0429aa71154'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10402024-12-06T20:43:02.072ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_c26c9d62-aefd-4ced-b0e7-da16bf299c4d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_c26c9d62-aefd-4ced-b0e7-da16bf299c4d
10412024-12-06T20:43:02.076ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_196fdb83-e76c-47d9-a9ee-d0429aa71154 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_196fdb83-e76c-47d9-a9ee-d0429aa71154
10422024-12-06T20:43:02.088ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_27229a74-6d47-442c-a7ab-393b73cf74df: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='27229a74-6d47-442c-a7ab-393b73cf74df'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10432024-12-06T20:43:02.089ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_27229a74-6d47-442c-a7ab-393b73cf74df zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_27229a74-6d47-442c-a7ab-393b73cf74df
10442024-12-06T20:43:02.180ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4e6cf073-224e-417c-8875-16567605c2be") failed: Property not found. retry in 25.622943ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4e6cf073-224e-417c-8875-16567605c2be
10452024-12-06T20:43:02.210ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c26c9d62-aefd-4ced-b0e7-da16bf299c4d") failed: Property not found. retry in 65.891588ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c26c9d62-aefd-4ced-b0e7-da16bf299c4d
10462024-12-06T20:43:02.217ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4e6cf073-224e-417c-8875-16567605c2be") failed: Property not found. retry in 101.544068ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4e6cf073-224e-417c-8875-16567605c2be
10472024-12-06T20:43:02.225ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_196fdb83-e76c-47d9-a9ee-d0429aa71154") failed: Property not found. retry in 31.509917ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_196fdb83-e76c-47d9-a9ee-d0429aa71154
10482024-12-06T20:43:02.232ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_eb71a443-d6ff-40d1-b0f6-d5e30927d1c2") failed: Property not found. retry in 68.072169ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_eb71a443-d6ff-40d1-b0f6-d5e30927d1c2
10492024-12-06T20:43:02.239ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_27229a74-6d47-442c-a7ab-393b73cf74df") failed: Property not found. retry in 40.592596ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_27229a74-6d47-442c-a7ab-393b73cf74df
10502024-12-06T20:43:02.366ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_196fdb83-e76c-47d9-a9ee-d0429aa71154") failed: Property not found. retry in 66.542357ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_196fdb83-e76c-47d9-a9ee-d0429aa71154
10512024-12-06T20:43:02.603ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c26c9d62-aefd-4ced-b0e7-da16bf299c4d") failed: Property not found. retry in 85.035409ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c26c9d62-aefd-4ced-b0e7-da16bf299c4d
10522024-12-06T20:43:02.610ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_27229a74-6d47-442c-a7ab-393b73cf74df") failed: Property not found. retry in 118.717132ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_27229a74-6d47-442c-a7ab-393b73cf74df
10532024-12-06T20:43:02.700ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4e6cf073-224e-417c-8875-16567605c2be") failed: Property not found. retry in 186.971702ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4e6cf073-224e-417c-8875-16567605c2be
10542024-12-06T20:43:02.847ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_196fdb83-e76c-47d9-a9ee-d0429aa71154") failed: Property not found. retry in 192.523998ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_196fdb83-e76c-47d9-a9ee-d0429aa71154
10552024-12-06T20:43:02.862ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_eb71a443-d6ff-40d1-b0f6-d5e30927d1c2") failed: Property not found. retry in 65.01689ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_eb71a443-d6ff-40d1-b0f6-d5e30927d1c2
10562024-12-06T20:43:02.903ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c26c9d62-aefd-4ced-b0e7-da16bf299c4d") failed: Property not found. retry in 210.594899ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c26c9d62-aefd-4ced-b0e7-da16bf299c4d
10572024-12-06T20:43:02.943ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_27229a74-6d47-442c-a7ab-393b73cf74df") failed: Property not found. retry in 103.563925ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_27229a74-6d47-442c-a7ab-393b73cf74df
10582024-12-06T20:43:02.973ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4e6cf073-224e-417c-8875-16567605c2be") failed: Property not found. retry in 456.630546ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4e6cf073-224e-417c-8875-16567605c2be
10592024-12-06T20:43:03.010ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_196fdb83-e76c-47d9-a9ee-d0429aa71154") failed: Property not found. retry in 499.585878ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_196fdb83-e76c-47d9-a9ee-d0429aa71154
10602024-12-06T20:43:03.046ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_eb71a443-d6ff-40d1-b0f6-d5e30927d1c2") failed: Property not found. retry in 259.660853ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_eb71a443-d6ff-40d1-b0f6-d5e30927d1c2
10612024-12-06T20:43:03.074ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_27229a74-6d47-442c-a7ab-393b73cf74df") failed: Property not found. retry in 513.555367ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_27229a74-6d47-442c-a7ab-393b73cf74df
10622024-12-06T20:43:03.153ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c26c9d62-aefd-4ced-b0e7-da16bf299c4d") failed: Property not found. retry in 554.189091ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c26c9d62-aefd-4ced-b0e7-da16bf299c4d
10632024-12-06T20:43:03.445ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_eb71a443-d6ff-40d1-b0f6-d5e30927d1c2") failed: Property not found. retry in 223.143321ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_eb71a443-d6ff-40d1-b0f6-d5e30927d1c2
10642024-12-06T20:43:03.594ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4e6cf073-224e-417c-8875-16567605c2be") failed: Property not found. retry in 647.414033ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4e6cf073-224e-417c-8875-16567605c2be
10652024-12-06T20:43:03.825ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_196fdb83-e76c-47d9-a9ee-d0429aa71154") failed: Property not found. retry in 1.114963381s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_196fdb83-e76c-47d9-a9ee-d0429aa71154
10662024-12-06T20:43:03.907ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_eb71a443-d6ff-40d1-b0f6-d5e30927d1c2") failed: Property not found. retry in 1.150872368s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_eb71a443-d6ff-40d1-b0f6-d5e30927d1c2
10672024-12-06T20:43:04.132ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c26c9d62-aefd-4ced-b0e7-da16bf299c4d") failed: Property not found. retry in 777.713173ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c26c9d62-aefd-4ced-b0e7-da16bf299c4d
10682024-12-06T20:43:04.172ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_27229a74-6d47-442c-a7ab-393b73cf74df") failed: Property not found. retry in 684.29269ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_27229a74-6d47-442c-a7ab-393b73cf74df
10692024-12-06T20:43:04.271ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4e6cf073-224e-417c-8875-16567605c2be") failed: Property not found. retry in 660.90193ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4e6cf073-224e-417c-8875-16567605c2be
10702024-12-06T20:43:04.866ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_27229a74-6d47-442c-a7ab-393b73cf74df") failed: Property not found. retry in 1.446987816s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_27229a74-6d47-442c-a7ab-393b73cf74df
10712024-12-06T20:43:04.891ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c26c9d62-aefd-4ced-b0e7-da16bf299c4d") failed: Property not found. retry in 1.362851216s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c26c9d62-aefd-4ced-b0e7-da16bf299c4d
10722024-12-06T20:43:04.943ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4e6cf073-224e-417c-8875-16567605c2be") failed: Property not found. retry in 1.281349778s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4e6cf073-224e-417c-8875-16567605c2be
10732024-12-06T20:43:04.952ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_196fdb83-e76c-47d9-a9ee-d0429aa71154") failed: Property not found. retry in 1.212142856s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_196fdb83-e76c-47d9-a9ee-d0429aa71154
10742024-12-06T20:43:05.068ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_eb71a443-d6ff-40d1-b0f6-d5e30927d1c2") failed: Property not found. retry in 544.858433ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_eb71a443-d6ff-40d1-b0f6-d5e30927d1c2
10752024-12-06T20:43:05.622ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_eb71a443-d6ff-40d1-b0f6-d5e30927d1c2") failed: Property not found. retry in 629.378004ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_eb71a443-d6ff-40d1-b0f6-d5e30927d1c2
10762024-12-06T20:43:06.174ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_196fdb83-e76c-47d9-a9ee-d0429aa71154") failed: Property not found. retry in 1.268111446s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_196fdb83-e76c-47d9-a9ee-d0429aa71154
10772024-12-06T20:43:06.233ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4e6cf073-224e-417c-8875-16567605c2be") failed: Property not found. retry in 1.294980929s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4e6cf073-224e-417c-8875-16567605c2be
10782024-12-06T20:43:06.258ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_eb71a443-d6ff-40d1-b0f6-d5e30927d1c2") failed: Property not found. retry in 1.300051712s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_eb71a443-d6ff-40d1-b0f6-d5e30927d1c2
10792024-12-06T20:43:06.266ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c26c9d62-aefd-4ced-b0e7-da16bf299c4d") failed: Property not found. retry in 1.495834074s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c26c9d62-aefd-4ced-b0e7-da16bf299c4d
10802024-12-06T20:43:06.323ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_27229a74-6d47-442c-a7ab-393b73cf74df") failed: Property not found. retry in 547.952204ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_27229a74-6d47-442c-a7ab-393b73cf74df
10812024-12-06T20:43:06.880ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_27229a74-6d47-442c-a7ab-393b73cf74df") failed: Property not found. retry in 667.798607ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_27229a74-6d47-442c-a7ab-393b73cf74df
10822024-12-06T20:43:07.450ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_196fdb83-e76c-47d9-a9ee-d0429aa71154") failed: Property not found. retry in 1.3417733s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_196fdb83-e76c-47d9-a9ee-d0429aa71154
10832024-12-06T20:43:07.536ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4e6cf073-224e-417c-8875-16567605c2be") failed: Property not found. retry in 662.040857ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4e6cf073-224e-417c-8875-16567605c2be
10842024-12-06T20:43:07.557ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_27229a74-6d47-442c-a7ab-393b73cf74df") failed: Property not found. retry in 1.124222228s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_27229a74-6d47-442c-a7ab-393b73cf74df
10852024-12-06T20:43:07.566ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_eb71a443-d6ff-40d1-b0f6-d5e30927d1c2") failed: Property not found. retry in 1.225853027s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_eb71a443-d6ff-40d1-b0f6-d5e30927d1c2
10862024-12-06T20:43:07.771ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c26c9d62-aefd-4ced-b0e7-da16bf299c4d") failed: Property not found. retry in 1.119474875s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c26c9d62-aefd-4ced-b0e7-da16bf299c4d
10872024-12-06T20:43:08.207ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4e6cf073-224e-417c-8875-16567605c2be") failed: Property not found. retry in 1.333804266s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4e6cf073-224e-417c-8875-16567605c2be
10882024-12-06T20:43:08.691ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_27229a74-6d47-442c-a7ab-393b73cf74df") failed: Property not found. retry in 1.159535986s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_27229a74-6d47-442c-a7ab-393b73cf74df
10892024-12-06T20:43:08.800ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_196fdb83-e76c-47d9-a9ee-d0429aa71154") failed: Property not found. retry in 587.468788ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_196fdb83-e76c-47d9-a9ee-d0429aa71154
10902024-12-06T20:43:08.808ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_eb71a443-d6ff-40d1-b0f6-d5e30927d1c2") failed: Property not found. retry in 1.163292422s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_eb71a443-d6ff-40d1-b0f6-d5e30927d1c2
10912024-12-06T20:43:08.898ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c26c9d62-aefd-4ced-b0e7-da16bf299c4d") failed: Property not found. retry in 969.137553ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c26c9d62-aefd-4ced-b0e7-da16bf299c4d
10922024-12-06T20:43:09.396ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_196fdb83-e76c-47d9-a9ee-d0429aa71154") failed: Property not found. retry in 1.325396512s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_196fdb83-e76c-47d9-a9ee-d0429aa71154
10932024-12-06T20:43:09.549ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4e6cf073-224e-417c-8875-16567605c2be") failed: Property not found. retry in 969.254869ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4e6cf073-224e-417c-8875-16567605c2be
10942024-12-06T20:43:09.712ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:34039
10952024-12-06T20:43:09.712ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:34039 req_id = a9bf1722-2fe4-432b-9e8d-57f2169e27b4 response_code = 200 uri = /baseboard
10962024-12-06T20:43:09.860ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_27229a74-6d47-442c-a7ab-393b73cf74df") failed: Property not found. retry in 1.26059896s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_27229a74-6d47-442c-a7ab-393b73cf74df
10972024-12-06T20:43:09.876ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c26c9d62-aefd-4ced-b0e7-da16bf299c4d") failed: Property not found. retry in 1.298168976s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c26c9d62-aefd-4ced-b0e7-da16bf299c4d
10982024-12-06T20:43:09.980ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_eb71a443-d6ff-40d1-b0f6-d5e30927d1c2") failed: Property not found. retry in 948.477345ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_eb71a443-d6ff-40d1-b0f6-d5e30927d1c2
10992024-12-06T20:43:10.528ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4e6cf073-224e-417c-8875-16567605c2be") failed: Property not found. retry in 598.489525ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4e6cf073-224e-417c-8875-16567605c2be
11002024-12-06T20:43:10.731ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_196fdb83-e76c-47d9-a9ee-d0429aa71154") failed: Property not found. retry in 1.306336344s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_196fdb83-e76c-47d9-a9ee-d0429aa71154
11012024-12-06T20:43:10.937ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_eb71a443-d6ff-40d1-b0f6-d5e30927d1c2") failed: Property not found. retry in 728.16123ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_eb71a443-d6ff-40d1-b0f6-d5e30927d1c2
11022024-12-06T20:43:11.129ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_27229a74-6d47-442c-a7ab-393b73cf74df") failed: Property not found. retry in 1.233345685s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_27229a74-6d47-442c-a7ab-393b73cf74df
11032024-12-06T20:43:11.137ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4e6cf073-224e-417c-8875-16567605c2be") failed: Property not found. retry in 884.437028ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4e6cf073-224e-417c-8875-16567605c2be
11042024-12-06T20:43:11.183ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c26c9d62-aefd-4ced-b0e7-da16bf299c4d") failed: Property not found. retry in 873.652906ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c26c9d62-aefd-4ced-b0e7-da16bf299c4d
11052024-12-06T20:43:11.676ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_eb71a443-d6ff-40d1-b0f6-d5e30927d1c2") failed: Property not found. retry in 798.352727ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_eb71a443-d6ff-40d1-b0f6-d5e30927d1c2
11062024-12-06T20:43:12.033ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4e6cf073-224e-417c-8875-16567605c2be") failed: Property not found. retry in 1.217869738s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4e6cf073-224e-417c-8875-16567605c2be
11072024-12-06T20:43:12.049ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_196fdb83-e76c-47d9-a9ee-d0429aa71154") failed: Property not found. retry in 888.640057ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_196fdb83-e76c-47d9-a9ee-d0429aa71154
11082024-12-06T20:43:12.065ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c26c9d62-aefd-4ced-b0e7-da16bf299c4d") failed: Property not found. retry in 1.370302784s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c26c9d62-aefd-4ced-b0e7-da16bf299c4d
11092024-12-06T20:43:12.373ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_27229a74-6d47-442c-a7ab-393b73cf74df") failed: Property not found. retry in 1.493219964s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_27229a74-6d47-442c-a7ab-393b73cf74df
11102024-12-06T20:43:12.484ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_eb71a443-d6ff-40d1-b0f6-d5e30927d1c2") failed: Property not found. retry in 528.659456ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_eb71a443-d6ff-40d1-b0f6-d5e30927d1c2
11112024-12-06T20:43:12.951ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_196fdb83-e76c-47d9-a9ee-d0429aa71154") failed: Property not found. retry in 1.050767686s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_196fdb83-e76c-47d9-a9ee-d0429aa71154
11122024-12-06T20:43:13.024ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_eb71a443-d6ff-40d1-b0f6-d5e30927d1c2") failed: Property not found. retry in 629.170126ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_eb71a443-d6ff-40d1-b0f6-d5e30927d1c2
11132024-12-06T20:43:13.262ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4e6cf073-224e-417c-8875-16567605c2be") failed: Property not found. retry in 1.160705434s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4e6cf073-224e-417c-8875-16567605c2be
11142024-12-06T20:43:13.447ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c26c9d62-aefd-4ced-b0e7-da16bf299c4d") failed: Property not found. retry in 789.791575ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c26c9d62-aefd-4ced-b0e7-da16bf299c4d
11152024-12-06T20:43:13.663ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_eb71a443-d6ff-40d1-b0f6-d5e30927d1c2") failed: Property not found. retry in 1.308133704s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_eb71a443-d6ff-40d1-b0f6-d5e30927d1c2
11162024-12-06T20:43:13.876ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_27229a74-6d47-442c-a7ab-393b73cf74df") failed: Property not found. retry in 848.776226ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_27229a74-6d47-442c-a7ab-393b73cf74df
11172024-12-06T20:43:14.010ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_196fdb83-e76c-47d9-a9ee-d0429aa71154") failed: Property not found. retry in 1.328959437s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_196fdb83-e76c-47d9-a9ee-d0429aa71154
11182024-12-06T20:43:14.244ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c26c9d62-aefd-4ced-b0e7-da16bf299c4d") failed: Property not found. retry in 1.456573318s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c26c9d62-aefd-4ced-b0e7-da16bf299c4d
11192024-12-06T20:43:14.431ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4e6cf073-224e-417c-8875-16567605c2be") failed: Property not found. retry in 1.246504711s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4e6cf073-224e-417c-8875-16567605c2be
11202024-12-06T20:43:14.733ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_27229a74-6d47-442c-a7ab-393b73cf74df") failed: Property not found. retry in 978.72174ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_27229a74-6d47-442c-a7ab-393b73cf74df
11212024-12-06T20:43:14.980ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_eb71a443-d6ff-40d1-b0f6-d5e30927d1c2") failed: Property not found. retry in 875.321868ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_eb71a443-d6ff-40d1-b0f6-d5e30927d1c2
11222024-12-06T20:43:15.349ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_196fdb83-e76c-47d9-a9ee-d0429aa71154") failed: Property not found. retry in 686.247809ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_196fdb83-e76c-47d9-a9ee-d0429aa71154
11232024-12-06T20:43:15.686ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4e6cf073-224e-417c-8875-16567605c2be") failed: Property not found. retry in 703.772689ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4e6cf073-224e-417c-8875-16567605c2be
11242024-12-06T20:43:15.710ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c26c9d62-aefd-4ced-b0e7-da16bf299c4d") failed: Property not found. retry in 649.389069ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c26c9d62-aefd-4ced-b0e7-da16bf299c4d
11252024-12-06T20:43:15.722ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_27229a74-6d47-442c-a7ab-393b73cf74df") failed: Property not found. retry in 783.504356ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_27229a74-6d47-442c-a7ab-393b73cf74df
11262024-12-06T20:43:15.865ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_eb71a443-d6ff-40d1-b0f6-d5e30927d1c2") failed: Property not found. retry in 817.964497ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_eb71a443-d6ff-40d1-b0f6-d5e30927d1c2
11272024-12-06T20:43:16.046ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_196fdb83-e76c-47d9-a9ee-d0429aa71154") failed: Property not found. retry in 1.317745735s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_196fdb83-e76c-47d9-a9ee-d0429aa71154
11282024-12-06T20:43:16.370ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c26c9d62-aefd-4ced-b0e7-da16bf299c4d") failed: Property not found. retry in 1.372623469s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c26c9d62-aefd-4ced-b0e7-da16bf299c4d
11292024-12-06T20:43:16.401ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4e6cf073-224e-417c-8875-16567605c2be") failed: Property not found. retry in 810.879709ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4e6cf073-224e-417c-8875-16567605c2be
11302024-12-06T20:43:16.432ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 44.829028358s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
11312024-12-06T20:43:17.765ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_4e6cf073-224e-417c-8875-16567605c2be
11322024-12-06T20:43:17.765ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_196fdb83-e76c-47d9-a9ee-d0429aa71154
11332024-12-06T20:43:17.765ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_eb71a443-d6ff-40d1-b0f6-d5e30927d1c2
11342024-12-06T20:43:17.765ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_c26c9d62-aefd-4ced-b0e7-da16bf299c4d
11352024-12-06T20:43:17.765ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_27229a74-6d47-442c-a7ab-393b73cf74df
11362024-12-06T20:43:17.765ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/b9ab18cf-4dd7-46c3-920e-833f181cfe8b/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
11372024-12-06T20:43:17.765ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/5a719d2c-fbf6-41ef-af9f-e6b70820ebd4/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
11382024-12-06T20:43:17.765ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 19126034 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:59268 req_id = b862cb67-3414-433c-ba16-7d2978615a51 response_code = 204 uri = /omicron-zones
11392024-12-06T20:43:17.799ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48439
11402024-12-06T20:43:17.828ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_196fdb83-e76c-47d9-a9ee-d0429aa71154: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_196fdb83-e76c-47d9-a9ee-d0429aa71154 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 28955 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:48439 req_id = f456aaeb-7cd0-42f1-b5c8-9b71cbcc4562 response_code = 500 uri = /cockroachdb
11412024-12-06T20:43:17.828ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "f456aaeb-7cd0-42f1-b5c8-9b71cbcc4562", "content-length": "124", "date": "Fri, 06 Dec 2024 20:43:17 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "f456aaeb-7cd0-42f1-b5c8-9b71cbcc4562" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 59.75675ms
11422024-12-06T20:43:17.917ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_196fdb83-e76c-47d9-a9ee-d0429aa71154: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_196fdb83-e76c-47d9-a9ee-d0429aa71154 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 27319 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:48439 req_id = 3e4e9865-ec85-434e-b871-5377294c9d46 response_code = 500 uri = /cockroachdb
11432024-12-06T20:43:17.917ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "3e4e9865-ec85-434e-b871-5377294c9d46", "content-length": "124", "date": "Fri, 06 Dec 2024 20:43:17 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "3e4e9865-ec85-434e-b871-5377294c9d46" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 85.326854ms
11442024-12-06T20:43:18.031ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_196fdb83-e76c-47d9-a9ee-d0429aa71154: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_196fdb83-e76c-47d9-a9ee-d0429aa71154 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 26586 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:48439 req_id = 7cb53ae1-3603-4441-be29-6028cdb763b4 response_code = 500 uri = /cockroachdb
11452024-12-06T20:43:18.031ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "7cb53ae1-3603-4441-be29-6028cdb763b4", "content-length": "124", "date": "Fri, 06 Dec 2024 20:43:17 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "7cb53ae1-3603-4441-be29-6028cdb763b4" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 176.867732ms
11462024-12-06T20:43:18.236ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_196fdb83-e76c-47d9-a9ee-d0429aa71154: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_196fdb83-e76c-47d9-a9ee-d0429aa71154 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 26780 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:48439 req_id = 50bd5ff5-16c2-4d63-b517-50cd0328a6ca response_code = 500 uri = /cockroachdb
11472024-12-06T20:43:18.236ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "50bd5ff5-16c2-4d63-b517-50cd0328a6ca", "content-length": "124", "date": "Fri, 06 Dec 2024 20:43:17 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "50bd5ff5-16c2-4d63-b517-50cd0328a6ca" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 176.345626ms
11482024-12-06T20:43:18.445ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_196fdb83-e76c-47d9-a9ee-d0429aa71154: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_196fdb83-e76c-47d9-a9ee-d0429aa71154 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 31725 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:48439 req_id = 00edeb38-92d0-410f-b668-29354dd876c0 response_code = 500 uri = /cockroachdb
11492024-12-06T20:43:18.446ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "00edeb38-92d0-410f-b668-29354dd876c0", "content-length": "124", "date": "Fri, 06 Dec 2024 20:43:17 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "00edeb38-92d0-410f-b668-29354dd876c0" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 297.643893ms
11502024-12-06T20:43:18.777ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::4]:32221 file = sled-agent/src/services.rs:3743
11512024-12-06T20:43:45.009ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3761
11522024-12-06T20:43:50.142ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3784
11532024-12-06T20:43:50.144ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31397830 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:48439 req_id = 06dc3516-aa15-4c5e-8f17-4e1c764f8585 response_code = 204 uri = /cockroachdb
11542024-12-06T20:43:50.148ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:43167
11552024-12-06T20:43:50.149ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 904 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:43167 req_id = d250ce96-77f6-4d3b-95c1-fb267210c0ad response_code = 200 uri = /baseboard
11562024-12-06T20:43:50.195ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: 0df5e14a-6e1e-4dcd-bf05-d67f92d30034 (service), filesystem_pool: Some(ZpoolName { id: 50f60e54-9000-4b4d-8705-841b133128b0 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 50f60e54-9000-4b4d-8705-841b133128b0 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: f0d51dc5-eec8-4f23-825b-ece452653cf1 (service), filesystem_pool: Some(ZpoolName { id: 99dfd90b-ff92-45e8-a73e-ada9e3f552c8 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 99dfd90b-ff92-45e8-a73e-ada9e3f552c8 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 2372a96e-6bc5-4e12-9310-7e2f7c4121e7 (service), filesystem_pool: Some(ZpoolName { id: 3b3acf4c-a316-45ce-a055-ef8d6c8acdff (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3b3acf4c-a316-45ce-a055-ef8d6c8acdff (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 2e418c90-5369-4643-83ad-18cceb9dcb5f (service), filesystem_pool: Some(ZpoolName { id: 43474e0b-a6d6-4842-bf66-1060f52875b1 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 432ee6c5-0cf5-4762-8cf1-d37791f3534b, kind: Service { id: 2e418c90-5369-4643-83ad-18cceb9dcb5f }, name: Name("ntp-2e418c90-5369-4643-83ad-18cceb9dcb5f"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 206, 90])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 4e6cf073-224e-417c-8875-16567605c2be (service), filesystem_pool: Some(ZpoolName { id: 50f60e54-9000-4b4d-8705-841b133128b0 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 50f60e54-9000-4b4d-8705-841b133128b0 (zpool), kind: External } } } }, OmicronZoneConfig { id: 196fdb83-e76c-47d9-a9ee-d0429aa71154 (service), filesystem_pool: Some(ZpoolName { id: 99dfd90b-ff92-45e8-a73e-ada9e3f552c8 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 99dfd90b-ff92-45e8-a73e-ada9e3f552c8 (zpool), kind: External } } } }, OmicronZoneConfig { id: eb71a443-d6ff-40d1-b0f6-d5e30927d1c2 (service), filesystem_pool: Some(ZpoolName { id: 3b3acf4c-a316-45ce-a055-ef8d6c8acdff (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3b3acf4c-a316-45ce-a055-ef8d6c8acdff (zpool), kind: External } } } }, OmicronZoneConfig { id: c26c9d62-aefd-4ced-b0e7-da16bf299c4d (service), filesystem_pool: Some(ZpoolName { id: 5f5a9c7a-eec2-4e86-a02e-9238700fe7ab (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5f5a9c7a-eec2-4e86-a02e-9238700fe7ab (zpool), kind: External } } } }, OmicronZoneConfig { id: 27229a74-6d47-442c-a7ab-393b73cf74df (service), filesystem_pool: Some(ZpoolName { id: 8e389ddd-65e9-4954-ab37-e305d4d4e112 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8e389ddd-65e9-4954-ab37-e305d4d4e112 (zpool), kind: External } } } }, OmicronZoneConfig { id: 59b92633-3550-4af1-b628-503b6bafd00d (service), filesystem_pool: Some(ZpoolName { id: 50f60e54-9000-4b4d-8705-841b133128b0 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 50f60e54-9000-4b4d-8705-841b133128b0 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.2.164:53, nic: NetworkInterface { id: 525aa886-e2b8-42b8-b1c9-cbf16e16e174, kind: Service { id: 59b92633-3550-4af1-b628-503b6bafd00d }, name: Name("external-dns-59b92633-3550-4af1-b628-503b6bafd00d"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 169])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 9d99eda0-389f-44c6-94ee-e9e7a03c9733 (service), filesystem_pool: Some(ZpoolName { id: 99dfd90b-ff92-45e8-a73e-ada9e3f552c8 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 99dfd90b-ff92-45e8-a73e-ada9e3f552c8 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.2.165:53, nic: NetworkInterface { id: 7ff7e7d1-13cc-4538-9fce-dfd74792a288, kind: Service { id: 9d99eda0-389f-44c6-94ee-e9e7a03c9733 }, name: Name("external-dns-9d99eda0-389f-44c6-94ee-e9e7a03c9733"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 221, 96])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: fd12fb4f-e62d-4cab-a4bd-2024f2546d3b (service), filesystem_pool: Some(ZpoolName { id: 50f60e54-9000-4b4d-8705-841b133128b0 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.2.166, nic: NetworkInterface { id: 9a966830-c35d-4c5c-bab6-585ffc135908, kind: Service { id: fd12fb4f-e62d-4cab-a4bd-2024f2546d3b }, name: Name("nexus-fd12fb4f-e62d-4cab-a4bd-2024f2546d3b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 247, 18])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 3965e738-3305-4fcd-9da0-4c6e0ce7edc1 (service), filesystem_pool: Some(ZpoolName { id: 3b3acf4c-a316-45ce-a055-ef8d6c8acdff (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.2.167, nic: NetworkInterface { id: 176e274c-5ddd-4aa2-b53c-05e8fe632337, kind: Service { id: 3965e738-3305-4fcd-9da0-4c6e0ce7edc1 }, name: Name("nexus-3965e738-3305-4fcd-9da0-4c6e0ce7edc1"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 170, 95])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: e9fe68b0-d53c-4161-a621-681677d5b0d6 (service), filesystem_pool: Some(ZpoolName { id: 3b3acf4c-a316-45ce-a055-ef8d6c8acdff (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.2.168, nic: NetworkInterface { id: 75143dec-1fa4-42e5-a888-c77d19a4a83f, kind: Service { id: e9fe68b0-d53c-4161-a621-681677d5b0d6 }, name: Name("nexus-e9fe68b0-d53c-4161-a621-681677d5b0d6"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 243, 69])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: bef145b4-2934-45c3-870a-63d45572bde4 (service), filesystem_pool: Some(ZpoolName { id: 5f5a9c7a-eec2-4e86-a02e-9238700fe7ab (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: 44e0594e-e8fa-4a38-8f8c-bcb6ceccc555 (service), filesystem_pool: Some(ZpoolName { id: 50f60e54-9000-4b4d-8705-841b133128b0 (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 50f60e54-9000-4b4d-8705-841b133128b0 (zpool), kind: External } } } }, OmicronZoneConfig { id: 46c53ce3-fed2-4b43-8728-cae9919088d1 (service), filesystem_pool: Some(ZpoolName { id: 99dfd90b-ff92-45e8-a73e-ada9e3f552c8 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: 1049fe89-11bc-49dd-aec6-8ba72a4bf488 (service), filesystem_pool: Some(ZpoolName { id: f3f86fa8-b3a1-409b-95c8-f426058deed7 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: ba33747a-8bf5-489f-aaf5-20508b581f0f (service), filesystem_pool: Some(ZpoolName { id: 3b3acf4c-a316-45ce-a055-ef8d6c8acdff (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: 04023147-2580-4e6f-a338-23a2e1e895fc (service), filesystem_pool: Some(ZpoolName { id: 50f60e54-9000-4b4d-8705-841b133128b0 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 50f60e54-9000-4b4d-8705-841b133128b0 (zpool), kind: External } } } }, OmicronZoneConfig { id: 0525204b-63bb-4f1b-be27-505477f54f5d (service), filesystem_pool: Some(ZpoolName { id: 99dfd90b-ff92-45e8-a73e-ada9e3f552c8 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 99dfd90b-ff92-45e8-a73e-ada9e3f552c8 (zpool), kind: External } } } }, OmicronZoneConfig { id: de82b1e5-5cfb-423c-b612-e6e5e77c021f (service), filesystem_pool: Some(ZpoolName { id: 3b3acf4c-a316-45ce-a055-ef8d6c8acdff (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3b3acf4c-a316-45ce-a055-ef8d6c8acdff (zpool), kind: External } } } }, OmicronZoneConfig { id: 19f9def9-3a42-4f07-8788-385d13f17c0a (service), filesystem_pool: Some(ZpoolName { id: 5f5a9c7a-eec2-4e86-a02e-9238700fe7ab (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5f5a9c7a-eec2-4e86-a02e-9238700fe7ab (zpool), kind: External } } } }, OmicronZoneConfig { id: 31a5acd7-f1f6-4683-a49e-44e34c5f6914 (service), filesystem_pool: Some(ZpoolName { id: 8e389ddd-65e9-4954-ab37-e305d4d4e112 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8e389ddd-65e9-4954-ab37-e305d4d4e112 (zpool), kind: External } } } }, OmicronZoneConfig { id: 17a27890-edd1-41a9-b5f3-c1b01576ff0e (service), filesystem_pool: Some(ZpoolName { id: f3f86fa8-b3a1-409b-95c8-f426058deed7 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f3f86fa8-b3a1-409b-95c8-f426058deed7 (zpool), kind: External } } } }, OmicronZoneConfig { id: 84c4aae6-8e5d-40c4-b5db-027cbd5c5b06 (service), filesystem_pool: Some(ZpoolName { id: 2f3ff39c-4b18-4b96-8fb8-fbd672d6202f (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2f3ff39c-4b18-4b96-8fb8-fbd672d6202f (zpool), kind: External } } } }, OmicronZoneConfig { id: ed55ef04-a7c0-4b4e-ac1e-21d76b03e495 (service), filesystem_pool: Some(ZpoolName { id: 33ce0168-de47-475b-9a15-5a0cd6252cb6 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 33ce0168-de47-475b-9a15-5a0cd6252cb6 (zpool), kind: External } } } }, OmicronZoneConfig { id: b2591895-3ac4-4a5b-8bab-97ad5b9d077c (service), filesystem_pool: Some(ZpoolName { id: 43474e0b-a6d6-4842-bf66-1060f52875b1 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 43474e0b-a6d6-4842-bf66-1060f52875b1 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
11572024-12-06T20:43:50.197ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33731
11582024-12-06T20:43:50.206ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 0df5e14a-6e1e-4dcd-bf05-d67f92d30034, dataset_name: DatasetName { pool_name: ZpoolName { id: 50f60e54-9000-4b4d-8705-841b133128b0 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
11592024-12-06T20:43:50.206ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 0df5e14a-6e1e-4dcd-bf05-d67f92d30034, dataset_name: DatasetName { pool_name: ZpoolName { id: 50f60e54-9000-4b4d-8705-841b133128b0 (zpool), kind: External }, kind: InternalDns }, responder: ... }
11602024-12-06T20:43:50.256ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: f0d51dc5-eec8-4f23-825b-ece452653cf1, dataset_name: DatasetName { pool_name: ZpoolName { id: 99dfd90b-ff92-45e8-a73e-ada9e3f552c8 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
11612024-12-06T20:43:50.256ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: f0d51dc5-eec8-4f23-825b-ece452653cf1, dataset_name: DatasetName { pool_name: ZpoolName { id: 99dfd90b-ff92-45e8-a73e-ada9e3f552c8 (zpool), kind: External }, kind: InternalDns }, responder: ... }
11622024-12-06T20:43:50.298ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 2372a96e-6bc5-4e12-9310-7e2f7c4121e7, dataset_name: DatasetName { pool_name: ZpoolName { id: 3b3acf4c-a316-45ce-a055-ef8d6c8acdff (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
11632024-12-06T20:43:50.298ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 2372a96e-6bc5-4e12-9310-7e2f7c4121e7, dataset_name: DatasetName { pool_name: ZpoolName { id: 3b3acf4c-a316-45ce-a055-ef8d6c8acdff (zpool), kind: External }, kind: InternalDns }, responder: ... }
11642024-12-06T20:43:50.336ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 4e6cf073-224e-417c-8875-16567605c2be, dataset_name: DatasetName { pool_name: ZpoolName { id: 50f60e54-9000-4b4d-8705-841b133128b0 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
11652024-12-06T20:43:50.336ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 4e6cf073-224e-417c-8875-16567605c2be, dataset_name: DatasetName { pool_name: ZpoolName { id: 50f60e54-9000-4b4d-8705-841b133128b0 (zpool), kind: External }, kind: Cockroach }, responder: ... }
11662024-12-06T20:43:50.371ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 196fdb83-e76c-47d9-a9ee-d0429aa71154, dataset_name: DatasetName { pool_name: ZpoolName { id: 99dfd90b-ff92-45e8-a73e-ada9e3f552c8 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
11672024-12-06T20:43:50.371ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 196fdb83-e76c-47d9-a9ee-d0429aa71154, dataset_name: DatasetName { pool_name: ZpoolName { id: 99dfd90b-ff92-45e8-a73e-ada9e3f552c8 (zpool), kind: External }, kind: Cockroach }, responder: ... }
11682024-12-06T20:43:50.411ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: eb71a443-d6ff-40d1-b0f6-d5e30927d1c2, dataset_name: DatasetName { pool_name: ZpoolName { id: 3b3acf4c-a316-45ce-a055-ef8d6c8acdff (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
11692024-12-06T20:43:50.411ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: eb71a443-d6ff-40d1-b0f6-d5e30927d1c2, dataset_name: DatasetName { pool_name: ZpoolName { id: 3b3acf4c-a316-45ce-a055-ef8d6c8acdff (zpool), kind: External }, kind: Cockroach }, responder: ... }
11702024-12-06T20:43:50.446ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: c26c9d62-aefd-4ced-b0e7-da16bf299c4d, dataset_name: DatasetName { pool_name: ZpoolName { id: 5f5a9c7a-eec2-4e86-a02e-9238700fe7ab (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
11712024-12-06T20:43:50.446ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: c26c9d62-aefd-4ced-b0e7-da16bf299c4d, dataset_name: DatasetName { pool_name: ZpoolName { id: 5f5a9c7a-eec2-4e86-a02e-9238700fe7ab (zpool), kind: External }, kind: Cockroach }, responder: ... }
11722024-12-06T20:43:50.487ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 27229a74-6d47-442c-a7ab-393b73cf74df, dataset_name: DatasetName { pool_name: ZpoolName { id: 8e389ddd-65e9-4954-ab37-e305d4d4e112 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
11732024-12-06T20:43:50.487ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 27229a74-6d47-442c-a7ab-393b73cf74df, dataset_name: DatasetName { pool_name: ZpoolName { id: 8e389ddd-65e9-4954-ab37-e305d4d4e112 (zpool), kind: External }, kind: Cockroach }, responder: ... }
11742024-12-06T20:43:50.526ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 59b92633-3550-4af1-b628-503b6bafd00d, dataset_name: DatasetName { pool_name: ZpoolName { id: 50f60e54-9000-4b4d-8705-841b133128b0 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
11752024-12-06T20:43:50.526ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 59b92633-3550-4af1-b628-503b6bafd00d, dataset_name: DatasetName { pool_name: ZpoolName { id: 50f60e54-9000-4b4d-8705-841b133128b0 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
11762024-12-06T20:43:50.561ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 9d99eda0-389f-44c6-94ee-e9e7a03c9733, dataset_name: DatasetName { pool_name: ZpoolName { id: 99dfd90b-ff92-45e8-a73e-ada9e3f552c8 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
11772024-12-06T20:43:50.561ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 9d99eda0-389f-44c6-94ee-e9e7a03c9733, dataset_name: DatasetName { pool_name: ZpoolName { id: 99dfd90b-ff92-45e8-a73e-ada9e3f552c8 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
11782024-12-06T20:43:50.604ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 44e0594e-e8fa-4a38-8f8c-bcb6ceccc555, dataset_name: DatasetName { pool_name: ZpoolName { id: 50f60e54-9000-4b4d-8705-841b133128b0 (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:603
11792024-12-06T20:43:50.604ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 44e0594e-e8fa-4a38-8f8c-bcb6ceccc555, dataset_name: DatasetName { pool_name: ZpoolName { id: 50f60e54-9000-4b4d-8705-841b133128b0 (zpool), kind: External }, kind: Clickhouse }, responder: ... }
11802024-12-06T20:43:50.646ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 04023147-2580-4e6f-a338-23a2e1e895fc, dataset_name: DatasetName { pool_name: ZpoolName { id: 50f60e54-9000-4b4d-8705-841b133128b0 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
11812024-12-06T20:43:50.646ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 04023147-2580-4e6f-a338-23a2e1e895fc, dataset_name: DatasetName { pool_name: ZpoolName { id: 50f60e54-9000-4b4d-8705-841b133128b0 (zpool), kind: External }, kind: Crucible }, responder: ... }
11822024-12-06T20:43:50.684ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 0525204b-63bb-4f1b-be27-505477f54f5d, dataset_name: DatasetName { pool_name: ZpoolName { id: 99dfd90b-ff92-45e8-a73e-ada9e3f552c8 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
11832024-12-06T20:43:50.684ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 0525204b-63bb-4f1b-be27-505477f54f5d, dataset_name: DatasetName { pool_name: ZpoolName { id: 99dfd90b-ff92-45e8-a73e-ada9e3f552c8 (zpool), kind: External }, kind: Crucible }, responder: ... }
11842024-12-06T20:43:50.725ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: de82b1e5-5cfb-423c-b612-e6e5e77c021f, dataset_name: DatasetName { pool_name: ZpoolName { id: 3b3acf4c-a316-45ce-a055-ef8d6c8acdff (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
11852024-12-06T20:43:50.725ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: de82b1e5-5cfb-423c-b612-e6e5e77c021f, dataset_name: DatasetName { pool_name: ZpoolName { id: 3b3acf4c-a316-45ce-a055-ef8d6c8acdff (zpool), kind: External }, kind: Crucible }, responder: ... }
11862024-12-06T20:43:50.768ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 19f9def9-3a42-4f07-8788-385d13f17c0a, dataset_name: DatasetName { pool_name: ZpoolName { id: 5f5a9c7a-eec2-4e86-a02e-9238700fe7ab (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
11872024-12-06T20:43:50.768ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 19f9def9-3a42-4f07-8788-385d13f17c0a, dataset_name: DatasetName { pool_name: ZpoolName { id: 5f5a9c7a-eec2-4e86-a02e-9238700fe7ab (zpool), kind: External }, kind: Crucible }, responder: ... }
11882024-12-06T20:43:50.815ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 31a5acd7-f1f6-4683-a49e-44e34c5f6914, dataset_name: DatasetName { pool_name: ZpoolName { id: 8e389ddd-65e9-4954-ab37-e305d4d4e112 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
11892024-12-06T20:43:50.815ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 31a5acd7-f1f6-4683-a49e-44e34c5f6914, dataset_name: DatasetName { pool_name: ZpoolName { id: 8e389ddd-65e9-4954-ab37-e305d4d4e112 (zpool), kind: External }, kind: Crucible }, responder: ... }
11902024-12-06T20:43:50.852ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 17a27890-edd1-41a9-b5f3-c1b01576ff0e, dataset_name: DatasetName { pool_name: ZpoolName { id: f3f86fa8-b3a1-409b-95c8-f426058deed7 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
11912024-12-06T20:43:50.852ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 17a27890-edd1-41a9-b5f3-c1b01576ff0e, dataset_name: DatasetName { pool_name: ZpoolName { id: f3f86fa8-b3a1-409b-95c8-f426058deed7 (zpool), kind: External }, kind: Crucible }, responder: ... }
11922024-12-06T20:43:50.898ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 84c4aae6-8e5d-40c4-b5db-027cbd5c5b06, dataset_name: DatasetName { pool_name: ZpoolName { id: 2f3ff39c-4b18-4b96-8fb8-fbd672d6202f (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
11932024-12-06T20:43:50.898ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 84c4aae6-8e5d-40c4-b5db-027cbd5c5b06, dataset_name: DatasetName { pool_name: ZpoolName { id: 2f3ff39c-4b18-4b96-8fb8-fbd672d6202f (zpool), kind: External }, kind: Crucible }, responder: ... }
11942024-12-06T20:43:50.940ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: ed55ef04-a7c0-4b4e-ac1e-21d76b03e495, dataset_name: DatasetName { pool_name: ZpoolName { id: 33ce0168-de47-475b-9a15-5a0cd6252cb6 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
11952024-12-06T20:43:50.940ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: ed55ef04-a7c0-4b4e-ac1e-21d76b03e495, dataset_name: DatasetName { pool_name: ZpoolName { id: 33ce0168-de47-475b-9a15-5a0cd6252cb6 (zpool), kind: External }, kind: Crucible }, responder: ... }
11962024-12-06T20:43:50.989ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: b2591895-3ac4-4a5b-8bab-97ad5b9d077c, dataset_name: DatasetName { pool_name: ZpoolName { id: 43474e0b-a6d6-4842-bf66-1060f52875b1 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
11972024-12-06T20:43:50.989ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: b2591895-3ac4-4a5b-8bab-97ad5b9d077c, dataset_name: DatasetName { pool_name: ZpoolName { id: 43474e0b-a6d6-4842-bf66-1060f52875b1 (zpool), kind: External }, kind: Crucible }, responder: ... }
11982024-12-06T20:43:51.028ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11992024-12-06T20:43:51.028ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b9ab18cf-4dd7-46c3-920e-833f181cfe8b/config/omicron-zones.json file = common/src/ledger.rs:177
12002024-12-06T20:43:51.029ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/5a719d2c-fbf6-41ef-af9f-e6b70820ebd4/config/omicron-zones.json file = common/src/ledger.rs:177
12012024-12-06T20:43:51.029ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12022024-12-06T20:43:51.146ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12032024-12-06T20:43:51.147ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12042024-12-06T20:43:51.212ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12052024-12-06T20:43:51.212ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12062024-12-06T20:43:51.212ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12072024-12-06T20:43:51.212ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12082024-12-06T20:43:51.212ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12092024-12-06T20:43:51.212ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12102024-12-06T20:43:51.213ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12112024-12-06T20:43:51.213ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12122024-12-06T20:43:51.384ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12132024-12-06T20:43:51.418ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12142024-12-06T20:43:51.418ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12152024-12-06T20:43:51.418ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12162024-12-06T20:43:51.418ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12172024-12-06T20:43:51.421ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12182024-12-06T20:43:51.421ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12192024-12-06T20:43:51.422ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12202024-12-06T20:43:51.424ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12212024-12-06T20:43:51.424ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_44e0594e-e8fa-4a38-8f8c-bcb6ceccc555 file = illumos-utils/src/zone.rs:325
12222024-12-06T20:43:51.430ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_ba33747a-8bf5-489f-aaf5-20508b581f0f file = illumos-utils/src/zone.rs:325
12232024-12-06T20:43:51.435ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_de82b1e5-5cfb-423c-b612-e6e5e77c021f file = illumos-utils/src/zone.rs:325
12242024-12-06T20:43:51.440ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_31a5acd7-f1f6-4683-a49e-44e34c5f6914 file = illumos-utils/src/zone.rs:325
12252024-12-06T20:43:51.445ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_84c4aae6-8e5d-40c4-b5db-027cbd5c5b06 file = illumos-utils/src/zone.rs:325
12262024-12-06T20:43:51.450ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_b2591895-3ac4-4a5b-8bab-97ad5b9d077c file = illumos-utils/src/zone.rs:325
12272024-12-06T20:43:51.455ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_19f9def9-3a42-4f07-8788-385d13f17c0a file = illumos-utils/src/zone.rs:325
12282024-12-06T20:43:51.460ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_46c53ce3-fed2-4b43-8728-cae9919088d1 file = illumos-utils/src/zone.rs:325
12292024-12-06T20:43:51.465ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_04023147-2580-4e6f-a338-23a2e1e895fc file = illumos-utils/src/zone.rs:325
12302024-12-06T20:43:51.572ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_44e0594e-e8fa-4a38-8f8c-bcb6ceccc555 file = illumos-utils/src/zone.rs:363
12312024-12-06T20:43:51.577ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_ba33747a-8bf5-489f-aaf5-20508b581f0f file = illumos-utils/src/zone.rs:363
12322024-12-06T20:43:51.582ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_de82b1e5-5cfb-423c-b612-e6e5e77c021f file = illumos-utils/src/zone.rs:363
12332024-12-06T20:43:51.586ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_31a5acd7-f1f6-4683-a49e-44e34c5f6914 file = illumos-utils/src/zone.rs:363
12342024-12-06T20:43:51.591ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_84c4aae6-8e5d-40c4-b5db-027cbd5c5b06 file = illumos-utils/src/zone.rs:363
12352024-12-06T20:43:51.595ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_b2591895-3ac4-4a5b-8bab-97ad5b9d077c file = illumos-utils/src/zone.rs:363
12362024-12-06T20:43:51.600ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_19f9def9-3a42-4f07-8788-385d13f17c0a file = illumos-utils/src/zone.rs:363
12372024-12-06T20:43:51.605ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_46c53ce3-fed2-4b43-8728-cae9919088d1 file = illumos-utils/src/zone.rs:363
12382024-12-06T20:43:51.610ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_04023147-2580-4e6f-a338-23a2e1e895fc file = illumos-utils/src/zone.rs:363
12392024-12-06T20:43:51.615ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_0525204b-63bb-4f1b-be27-505477f54f5d file = illumos-utils/src/zone.rs:325
12402024-12-06T20:43:51.621ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_17a27890-edd1-41a9-b5f3-c1b01576ff0e file = illumos-utils/src/zone.rs:325
12412024-12-06T20:43:51.627ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_ed55ef04-a7c0-4b4e-ac1e-21d76b03e495 file = illumos-utils/src/zone.rs:325
12422024-12-06T20:43:51.633ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_1049fe89-11bc-49dd-aec6-8ba72a4bf488 file = illumos-utils/src/zone.rs:325
12432024-12-06T20:43:51.641ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_bef145b4-2934-45c3-870a-63d45572bde4 file = illumos-utils/src/zone.rs:325
12442024-12-06T20:43:51.712ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12452024-12-06T20:43:51.713ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_0525204b-63bb-4f1b-be27-505477f54f5d file = illumos-utils/src/zone.rs:363
12462024-12-06T20:43:51.723ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_17a27890-edd1-41a9-b5f3-c1b01576ff0e file = illumos-utils/src/zone.rs:363
12472024-12-06T20:43:51.736ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_ed55ef04-a7c0-4b4e-ac1e-21d76b03e495 file = illumos-utils/src/zone.rs:363
12482024-12-06T20:43:51.755ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_1049fe89-11bc-49dd-aec6-8ba72a4bf488 file = illumos-utils/src/zone.rs:363
12492024-12-06T20:43:51.774ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_bef145b4-2934-45c3-870a-63d45572bde4 file = illumos-utils/src/zone.rs:363
12502024-12-06T20:43:51.851ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12512024-12-06T20:43:51.913ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12522024-12-06T20:43:51.972ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12532024-12-06T20:43:52.031ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12542024-12-06T20:43:52.035ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12552024-12-06T20:43:52.035ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12562024-12-06T20:43:52.093ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 129, 169]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
12572024-12-06T20:43:52.093ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1263 zone_type = external_dns
12582024-12-06T20:43:52.098ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12592024-12-06T20:43:52.098ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12602024-12-06T20:43:52.155ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 221, 96]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
12612024-12-06T20:43:52.155ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1263 zone_type = external_dns
12622024-12-06T20:43:52.156ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12632024-12-06T20:43:52.156ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12642024-12-06T20:43:52.212ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 170, 95]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
12652024-12-06T20:43:52.212ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1263 zone_type = nexus
12662024-12-06T20:43:52.216ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12672024-12-06T20:43:52.216ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12682024-12-06T20:43:52.270ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 243, 69]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
12692024-12-06T20:43:52.270ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1263 zone_type = nexus
12702024-12-06T20:43:52.271ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12712024-12-06T20:43:52.271ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12722024-12-06T20:43:52.339ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 247, 18]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
12732024-12-06T20:43:52.339ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1263 zone_type = nexus
12742024-12-06T20:43:52.339ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:83
12752024-12-06T20:43:52.339ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:90
12762024-12-06T20:43:52.340ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:83
12772024-12-06T20:43:52.340ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:90
12782024-12-06T20:43:52.341ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:83
12792024-12-06T20:43:52.341ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:90
12802024-12-06T20:43:52.341ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:83
12812024-12-06T20:43:52.341ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:90
12822024-12-06T20:43:52.341ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:83
12832024-12-06T20:43:52.341ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:90
12842024-12-06T20:43:52.361ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:118
12852024-12-06T20:43:52.363ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12862024-12-06T20:43:52.411ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:118
12872024-12-06T20:43:52.414ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:118
12882024-12-06T20:43:52.415ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12892024-12-06T20:43:52.418ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:118
12902024-12-06T20:43:52.418ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12912024-12-06T20:43:52.421ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12922024-12-06T20:43:52.421ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:118
12932024-12-06T20:43:52.424ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12942024-12-06T20:43:52.627ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_59b92633-3550-4af1-b628-503b6bafd00d file = illumos-utils/src/zone.rs:325
12952024-12-06T20:43:52.640ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_9d99eda0-389f-44c6-94ee-e9e7a03c9733 file = illumos-utils/src/zone.rs:325
12962024-12-06T20:43:52.654ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_e9fe68b0-d53c-4161-a621-681677d5b0d6 file = illumos-utils/src/zone.rs:325
12972024-12-06T20:43:52.669ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_fd12fb4f-e62d-4cab-a4bd-2024f2546d3b file = illumos-utils/src/zone.rs:325
12982024-12-06T20:43:52.682ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_3965e738-3305-4fcd-9da0-4c6e0ce7edc1 file = illumos-utils/src/zone.rs:325
12992024-12-06T20:43:52.698ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_59b92633-3550-4af1-b628-503b6bafd00d file = illumos-utils/src/zone.rs:363
13002024-12-06T20:43:52.708ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_9d99eda0-389f-44c6-94ee-e9e7a03c9733 file = illumos-utils/src/zone.rs:363
13012024-12-06T20:43:52.717ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_e9fe68b0-d53c-4161-a621-681677d5b0d6 file = illumos-utils/src/zone.rs:363
13022024-12-06T20:43:52.730ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_fd12fb4f-e62d-4cab-a4bd-2024f2546d3b file = illumos-utils/src/zone.rs:363
13032024-12-06T20:43:52.739ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_3965e738-3305-4fcd-9da0-4c6e0ce7edc1 file = illumos-utils/src/zone.rs:363
13042024-12-06T20:43:55.457ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_1049fe89-11bc-49dd-aec6-8ba72a4bf488: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13052024-12-06T20:43:55.457ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_1049fe89-11bc-49dd-aec6-8ba72a4bf488 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_1049fe89-11bc-49dd-aec6-8ba72a4bf488
13062024-12-06T20:43:55.635ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_17a27890-edd1-41a9-b5f3-c1b01576ff0e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_f3f86fa8-b3a1-409b-95c8-f426058deed7/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='297b48e2-d0e0-4161-aeac-3caf5cac7806'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13072024-12-06T20:43:55.635ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_84c4aae6-8e5d-40c4-b5db-027cbd5c5b06: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_2f3ff39c-4b18-4b96-8fb8-fbd672d6202f/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='12c73189-8688-4106-867f-119246508590'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13082024-12-06T20:43:55.635ZINFOSledAgent (ServiceManager): Booting oxz_crucible_17a27890-edd1-41a9-b5f3-c1b01576ff0e zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_17a27890-edd1-41a9-b5f3-c1b01576ff0e
13092024-12-06T20:43:55.645ZINFOSledAgent (ServiceManager): Booting oxz_crucible_84c4aae6-8e5d-40c4-b5db-027cbd5c5b06 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_84c4aae6-8e5d-40c4-b5db-027cbd5c5b06
13102024-12-06T20:43:55.655ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_b2591895-3ac4-4a5b-8bab-97ad5b9d077c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_43474e0b-a6d6-4842-bf66-1060f52875b1/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='a6836da0-9e29-4b55-ab04-709302a923de'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13112024-12-06T20:43:55.655ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_19f9def9-3a42-4f07-8788-385d13f17c0a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_5f5a9c7a-eec2-4e86-a02e-9238700fe7ab/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='0115c2e2-dd5e-45f0-b245-46e787121c25'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13122024-12-06T20:43:55.655ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_ed55ef04-a7c0-4b4e-ac1e-21d76b03e495: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_33ce0168-de47-475b-9a15-5a0cd6252cb6/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='3c53b0ac-e1fb-45dd-9c35-6619ea4164e3'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13132024-12-06T20:43:55.655ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_31a5acd7-f1f6-4683-a49e-44e34c5f6914: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_8e389ddd-65e9-4954-ab37-e305d4d4e112/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='65481afb-a2ea-4a89-92a3-35811bb03c6c'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13142024-12-06T20:43:55.655ZINFOSledAgent (ServiceManager): Booting oxz_crucible_b2591895-3ac4-4a5b-8bab-97ad5b9d077c zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_b2591895-3ac4-4a5b-8bab-97ad5b9d077c
13152024-12-06T20:43:55.690ZINFOSledAgent (ServiceManager): Booting oxz_crucible_19f9def9-3a42-4f07-8788-385d13f17c0a zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_19f9def9-3a42-4f07-8788-385d13f17c0a
13162024-12-06T20:43:55.695ZINFOSledAgent (ServiceManager): Booting oxz_crucible_ed55ef04-a7c0-4b4e-ac1e-21d76b03e495 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_ed55ef04-a7c0-4b4e-ac1e-21d76b03e495
13172024-12-06T20:43:55.708ZINFOSledAgent (ServiceManager): Booting oxz_crucible_31a5acd7-f1f6-4683-a49e-44e34c5f6914 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_31a5acd7-f1f6-4683-a49e-44e34c5f6914
13182024-12-06T20:43:56.072ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1049fe89-11bc-49dd-aec6-8ba72a4bf488") failed: Property not found. retry in 52.420594ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1049fe89-11bc-49dd-aec6-8ba72a4bf488
13192024-12-06T20:43:56.223ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1049fe89-11bc-49dd-aec6-8ba72a4bf488") failed: Property not found. retry in 103.379442ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1049fe89-11bc-49dd-aec6-8ba72a4bf488
13202024-12-06T20:43:56.261ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b2591895-3ac4-4a5b-8bab-97ad5b9d077c") failed: Property not found. retry in 64.995681ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b2591895-3ac4-4a5b-8bab-97ad5b9d077c
13212024-12-06T20:43:56.305ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_19f9def9-3a42-4f07-8788-385d13f17c0a") failed: Property not found. retry in 60.098368ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_19f9def9-3a42-4f07-8788-385d13f17c0a
13222024-12-06T20:43:56.351ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_17a27890-edd1-41a9-b5f3-c1b01576ff0e") failed: Property not found. retry in 27.151463ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_17a27890-edd1-41a9-b5f3-c1b01576ff0e
13232024-12-06T20:43:56.400ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ed55ef04-a7c0-4b4e-ac1e-21d76b03e495") failed: Property not found. retry in 45.699243ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ed55ef04-a7c0-4b4e-ac1e-21d76b03e495
13242024-12-06T20:43:56.448ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1049fe89-11bc-49dd-aec6-8ba72a4bf488") failed: Property not found. retry in 217.848128ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1049fe89-11bc-49dd-aec6-8ba72a4bf488
13252024-12-06T20:43:56.475ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_31a5acd7-f1f6-4683-a49e-44e34c5f6914") failed: Property not found. retry in 48.028311ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_31a5acd7-f1f6-4683-a49e-44e34c5f6914
13262024-12-06T20:43:56.506ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_84c4aae6-8e5d-40c4-b5db-027cbd5c5b06") failed: Property not found. retry in 50.159422ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_84c4aae6-8e5d-40c4-b5db-027cbd5c5b06
13272024-12-06T20:43:56.536ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b2591895-3ac4-4a5b-8bab-97ad5b9d077c") failed: Property not found. retry in 74.620998ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b2591895-3ac4-4a5b-8bab-97ad5b9d077c
13282024-12-06T20:43:56.577ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_19f9def9-3a42-4f07-8788-385d13f17c0a") failed: Property not found. retry in 107.667537ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_19f9def9-3a42-4f07-8788-385d13f17c0a
13292024-12-06T20:43:56.615ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_17a27890-edd1-41a9-b5f3-c1b01576ff0e") failed: Property not found. retry in 139.769607ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_17a27890-edd1-41a9-b5f3-c1b01576ff0e
13302024-12-06T20:43:56.651ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ed55ef04-a7c0-4b4e-ac1e-21d76b03e495") failed: Property not found. retry in 54.759941ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ed55ef04-a7c0-4b4e-ac1e-21d76b03e495
13312024-12-06T20:43:56.671ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_bef145b4-2934-45c3-870a-63d45572bde4: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='bef145b4-2934-45c3-870a-63d45572bde4'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13322024-12-06T20:43:56.671ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_bef145b4-2934-45c3-870a-63d45572bde4 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_oximeter_bef145b4-2934-45c3-870a-63d45572bde4
13332024-12-06T20:43:56.735ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_31a5acd7-f1f6-4683-a49e-44e34c5f6914") failed: Property not found. retry in 139.923337ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_31a5acd7-f1f6-4683-a49e-44e34c5f6914
13342024-12-06T20:43:56.783ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_84c4aae6-8e5d-40c4-b5db-027cbd5c5b06") failed: Property not found. retry in 62.730655ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_84c4aae6-8e5d-40c4-b5db-027cbd5c5b06
13352024-12-06T20:43:56.827ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b2591895-3ac4-4a5b-8bab-97ad5b9d077c") failed: Property not found. retry in 207.944476ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b2591895-3ac4-4a5b-8bab-97ad5b9d077c
13362024-12-06T20:43:56.881ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_19f9def9-3a42-4f07-8788-385d13f17c0a") failed: Property not found. retry in 160.081502ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_19f9def9-3a42-4f07-8788-385d13f17c0a
13372024-12-06T20:43:56.928ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_17a27890-edd1-41a9-b5f3-c1b01576ff0e") failed: Property not found. retry in 282.859693ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_17a27890-edd1-41a9-b5f3-c1b01576ff0e
13382024-12-06T20:43:56.971ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ed55ef04-a7c0-4b4e-ac1e-21d76b03e495") failed: Property not found. retry in 136.325948ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ed55ef04-a7c0-4b4e-ac1e-21d76b03e495
13392024-12-06T20:43:57.018ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1049fe89-11bc-49dd-aec6-8ba72a4bf488") failed: Property not found. retry in 476.905665ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1049fe89-11bc-49dd-aec6-8ba72a4bf488
13402024-12-06T20:43:57.058ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_31a5acd7-f1f6-4683-a49e-44e34c5f6914") failed: Property not found. retry in 242.834206ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_31a5acd7-f1f6-4683-a49e-44e34c5f6914
13412024-12-06T20:43:57.102ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_84c4aae6-8e5d-40c4-b5db-027cbd5c5b06") failed: Property not found. retry in 185.653621ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_84c4aae6-8e5d-40c4-b5db-027cbd5c5b06
13422024-12-06T20:43:57.132ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b2591895-3ac4-4a5b-8bab-97ad5b9d077c") failed: Property not found. retry in 399.708757ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b2591895-3ac4-4a5b-8bab-97ad5b9d077c
13432024-12-06T20:43:57.176ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_19f9def9-3a42-4f07-8788-385d13f17c0a") failed: Property not found. retry in 289.449373ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_19f9def9-3a42-4f07-8788-385d13f17c0a
13442024-12-06T20:43:57.278ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ed55ef04-a7c0-4b4e-ac1e-21d76b03e495") failed: Property not found. retry in 354.582349ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ed55ef04-a7c0-4b4e-ac1e-21d76b03e495
13452024-12-06T20:43:57.312ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_17a27890-edd1-41a9-b5f3-c1b01576ff0e") failed: Property not found. retry in 443.344493ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_17a27890-edd1-41a9-b5f3-c1b01576ff0e
13462024-12-06T20:43:57.328ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_31a5acd7-f1f6-4683-a49e-44e34c5f6914") failed: Property not found. retry in 466.046283ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_31a5acd7-f1f6-4683-a49e-44e34c5f6914
13472024-12-06T20:43:57.343ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_84c4aae6-8e5d-40c4-b5db-027cbd5c5b06") failed: Property not found. retry in 400.117241ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_84c4aae6-8e5d-40c4-b5db-027cbd5c5b06
13482024-12-06T20:43:57.362ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_bef145b4-2934-45c3-870a-63d45572bde4") failed: Property not found. retry in 65.322337ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_bef145b4-2934-45c3-870a-63d45572bde4
13492024-12-06T20:43:57.448ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_bef145b4-2934-45c3-870a-63d45572bde4") failed: Property not found. retry in 117.463838ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_bef145b4-2934-45c3-870a-63d45572bde4
13502024-12-06T20:43:57.483ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_19f9def9-3a42-4f07-8788-385d13f17c0a") failed: Property not found. retry in 407.77562ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_19f9def9-3a42-4f07-8788-385d13f17c0a
13512024-12-06T20:43:57.550ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1049fe89-11bc-49dd-aec6-8ba72a4bf488") failed: Property not found. retry in 904.01893ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1049fe89-11bc-49dd-aec6-8ba72a4bf488
13522024-12-06T20:43:57.637ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b2591895-3ac4-4a5b-8bab-97ad5b9d077c") failed: Property not found. retry in 1.042973461s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b2591895-3ac4-4a5b-8bab-97ad5b9d077c
13532024-12-06T20:43:57.653ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_bef145b4-2934-45c3-870a-63d45572bde4") failed: Property not found. retry in 215.995661ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_bef145b4-2934-45c3-870a-63d45572bde4
13542024-12-06T20:43:57.692ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ed55ef04-a7c0-4b4e-ac1e-21d76b03e495") failed: Property not found. retry in 990.417625ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ed55ef04-a7c0-4b4e-ac1e-21d76b03e495
13552024-12-06T20:43:57.731ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_ba33747a-8bf5-489f-aaf5-20508b581f0f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13562024-12-06T20:43:57.731ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_ba33747a-8bf5-489f-aaf5-20508b581f0f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_ba33747a-8bf5-489f-aaf5-20508b581f0f
13572024-12-06T20:43:57.756ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_84c4aae6-8e5d-40c4-b5db-027cbd5c5b06") failed: Property not found. retry in 674.37568ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_84c4aae6-8e5d-40c4-b5db-027cbd5c5b06
13582024-12-06T20:43:57.771ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_17a27890-edd1-41a9-b5f3-c1b01576ff0e") failed: Property not found. retry in 801.380626ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_17a27890-edd1-41a9-b5f3-c1b01576ff0e
13592024-12-06T20:43:57.783ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_04023147-2580-4e6f-a338-23a2e1e895fc: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_50f60e54-9000-4b4d-8705-841b133128b0/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='c3f09b46-6a2a-4bcb-96aa-373b6e03da76'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13602024-12-06T20:43:57.784ZINFOSledAgent (ServiceManager): Booting oxz_crucible_04023147-2580-4e6f-a338-23a2e1e895fc zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_04023147-2580-4e6f-a338-23a2e1e895fc
13612024-12-06T20:43:57.809ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_31a5acd7-f1f6-4683-a49e-44e34c5f6914") failed: Property not found. retry in 1.194787789s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_31a5acd7-f1f6-4683-a49e-44e34c5f6914
13622024-12-06T20:43:57.886ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_bef145b4-2934-45c3-870a-63d45572bde4") failed: Property not found. retry in 335.881209ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_bef145b4-2934-45c3-870a-63d45572bde4
13632024-12-06T20:43:57.905ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_19f9def9-3a42-4f07-8788-385d13f17c0a") failed: Property not found. retry in 1.067440623s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_19f9def9-3a42-4f07-8788-385d13f17c0a
13642024-12-06T20:43:58.000ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ba33747a-8bf5-489f-aaf5-20508b581f0f") failed: Property not found. retry in 50.426029ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ba33747a-8bf5-489f-aaf5-20508b581f0f
13652024-12-06T20:43:58.009ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_de82b1e5-5cfb-423c-b612-e6e5e77c021f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_3b3acf4c-a316-45ce-a055-ef8d6c8acdff/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='e76d4129-8bda-4bf9-9bc9-a0c9160cab42'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13662024-12-06T20:43:58.013ZINFOSledAgent (ServiceManager): Booting oxz_crucible_de82b1e5-5cfb-423c-b612-e6e5e77c021f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_de82b1e5-5cfb-423c-b612-e6e5e77c021f
13672024-12-06T20:43:58.061ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04023147-2580-4e6f-a338-23a2e1e895fc") failed: Property not found. retry in 72.235704ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04023147-2580-4e6f-a338-23a2e1e895fc
13682024-12-06T20:43:58.072ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ba33747a-8bf5-489f-aaf5-20508b581f0f") failed: Property not found. retry in 135.991769ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ba33747a-8bf5-489f-aaf5-20508b581f0f
13692024-12-06T20:43:58.146ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04023147-2580-4e6f-a338-23a2e1e895fc") failed: Property not found. retry in 96.541407ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04023147-2580-4e6f-a338-23a2e1e895fc
13702024-12-06T20:43:58.153ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_59b92633-3550-4af1-b628-503b6bafd00d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13712024-12-06T20:43:58.154ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_59b92633-3550-4af1-b628-503b6bafd00d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_59b92633-3550-4af1-b628-503b6bafd00d
13722024-12-06T20:43:58.223ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ba33747a-8bf5-489f-aaf5-20508b581f0f") failed: Property not found. retry in 201.889821ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ba33747a-8bf5-489f-aaf5-20508b581f0f
13732024-12-06T20:43:58.237ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_bef145b4-2934-45c3-870a-63d45572bde4") failed: Property not found. retry in 1.06443526s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_bef145b4-2934-45c3-870a-63d45572bde4
13742024-12-06T20:43:58.270ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04023147-2580-4e6f-a338-23a2e1e895fc") failed: Property not found. retry in 131.034575ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04023147-2580-4e6f-a338-23a2e1e895fc
13752024-12-06T20:43:58.282ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de82b1e5-5cfb-423c-b612-e6e5e77c021f") failed: Property not found. retry in 52.446317ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de82b1e5-5cfb-423c-b612-e6e5e77c021f
13762024-12-06T20:43:58.346ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de82b1e5-5cfb-423c-b612-e6e5e77c021f") failed: Property not found. retry in 142.444399ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de82b1e5-5cfb-423c-b612-e6e5e77c021f
13772024-12-06T20:43:58.414ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04023147-2580-4e6f-a338-23a2e1e895fc") failed: Property not found. retry in 470.495067ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04023147-2580-4e6f-a338-23a2e1e895fc
13782024-12-06T20:43:58.424ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_59b92633-3550-4af1-b628-503b6bafd00d") failed: Property not found. retry in 66.65402ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_59b92633-3550-4af1-b628-503b6bafd00d
13792024-12-06T20:43:58.438ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ba33747a-8bf5-489f-aaf5-20508b581f0f") failed: Property not found. retry in 578.197498ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ba33747a-8bf5-489f-aaf5-20508b581f0f
13802024-12-06T20:43:58.449ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_84c4aae6-8e5d-40c4-b5db-027cbd5c5b06") failed: Property not found. retry in 869.200217ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_84c4aae6-8e5d-40c4-b5db-027cbd5c5b06
13812024-12-06T20:43:58.469ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1049fe89-11bc-49dd-aec6-8ba72a4bf488") failed: Property not found. retry in 1.343580677s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1049fe89-11bc-49dd-aec6-8ba72a4bf488
13822024-12-06T20:43:58.501ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de82b1e5-5cfb-423c-b612-e6e5e77c021f") failed: Property not found. retry in 156.670334ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de82b1e5-5cfb-423c-b612-e6e5e77c021f
13832024-12-06T20:43:58.511ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_59b92633-3550-4af1-b628-503b6bafd00d") failed: Property not found. retry in 64.00721ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_59b92633-3550-4af1-b628-503b6bafd00d
13842024-12-06T20:43:58.589ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_17a27890-edd1-41a9-b5f3-c1b01576ff0e") failed: Property not found. retry in 1.131905577s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_17a27890-edd1-41a9-b5f3-c1b01576ff0e
13852024-12-06T20:43:58.601ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_59b92633-3550-4af1-b628-503b6bafd00d") failed: Property not found. retry in 152.307254ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_59b92633-3550-4af1-b628-503b6bafd00d
13862024-12-06T20:43:58.666ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b2591895-3ac4-4a5b-8bab-97ad5b9d077c") failed: Property not found. retry in 553.109304ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b2591895-3ac4-4a5b-8bab-97ad5b9d077c
13872024-12-06T20:43:58.678ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de82b1e5-5cfb-423c-b612-e6e5e77c021f") failed: Property not found. retry in 478.823851ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de82b1e5-5cfb-423c-b612-e6e5e77c021f
13882024-12-06T20:43:58.698ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ed55ef04-a7c0-4b4e-ac1e-21d76b03e495") failed: Property not found. retry in 1.278598367s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ed55ef04-a7c0-4b4e-ac1e-21d76b03e495
13892024-12-06T20:43:58.764ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_59b92633-3550-4af1-b628-503b6bafd00d") failed: Property not found. retry in 322.028415ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_59b92633-3550-4af1-b628-503b6bafd00d
13902024-12-06T20:43:58.902ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04023147-2580-4e6f-a338-23a2e1e895fc") failed: Property not found. retry in 1.175109112s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04023147-2580-4e6f-a338-23a2e1e895fc
13912024-12-06T20:43:58.991ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_19f9def9-3a42-4f07-8788-385d13f17c0a") failed: Property not found. retry in 828.413394ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_19f9def9-3a42-4f07-8788-385d13f17c0a
13922024-12-06T20:43:59.037ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_31a5acd7-f1f6-4683-a49e-44e34c5f6914") failed: Property not found. retry in 1.000518505s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_31a5acd7-f1f6-4683-a49e-44e34c5f6914
13932024-12-06T20:43:59.052ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ba33747a-8bf5-489f-aaf5-20508b581f0f") failed: Property not found. retry in 1.115520569s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ba33747a-8bf5-489f-aaf5-20508b581f0f
13942024-12-06T20:43:59.108ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_59b92633-3550-4af1-b628-503b6bafd00d") failed: Property not found. retry in 1.130685462s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_59b92633-3550-4af1-b628-503b6bafd00d
13952024-12-06T20:43:59.170ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de82b1e5-5cfb-423c-b612-e6e5e77c021f") failed: Property not found. retry in 747.462542ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de82b1e5-5cfb-423c-b612-e6e5e77c021f
13962024-12-06T20:43:59.234ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b2591895-3ac4-4a5b-8bab-97ad5b9d077c") failed: Property not found. retry in 981.187389ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b2591895-3ac4-4a5b-8bab-97ad5b9d077c
13972024-12-06T20:43:59.383ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_bef145b4-2934-45c3-870a-63d45572bde4") failed: Property not found. retry in 1.064142295s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_bef145b4-2934-45c3-870a-63d45572bde4
13982024-12-06T20:43:59.415ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_84c4aae6-8e5d-40c4-b5db-027cbd5c5b06") failed: Property not found. retry in 774.897809ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_84c4aae6-8e5d-40c4-b5db-027cbd5c5b06
13992024-12-06T20:43:59.735ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_17a27890-edd1-41a9-b5f3-c1b01576ff0e") failed: Property not found. retry in 1.03309204s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_17a27890-edd1-41a9-b5f3-c1b01576ff0e
14002024-12-06T20:43:59.791ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_46c53ce3-fed2-4b43-8728-cae9919088d1: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14012024-12-06T20:43:59.792ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_46c53ce3-fed2-4b43-8728-cae9919088d1 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_46c53ce3-fed2-4b43-8728-cae9919088d1
14022024-12-06T20:43:59.825ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1049fe89-11bc-49dd-aec6-8ba72a4bf488") failed: Property not found. retry in 690.429779ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1049fe89-11bc-49dd-aec6-8ba72a4bf488
14032024-12-06T20:43:59.838ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_19f9def9-3a42-4f07-8788-385d13f17c0a") failed: Property not found. retry in 1.150161371s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_19f9def9-3a42-4f07-8788-385d13f17c0a
14042024-12-06T20:43:59.912ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_0525204b-63bb-4f1b-be27-505477f54f5d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_99dfd90b-ff92-45e8-a73e-ada9e3f552c8/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='08939711-ddbd-41ff-b169-e80ce8bf231a'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14052024-12-06T20:43:59.917ZINFOSledAgent (ServiceManager): Booting oxz_crucible_0525204b-63bb-4f1b-be27-505477f54f5d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_0525204b-63bb-4f1b-be27-505477f54f5d
14062024-12-06T20:43:59.937ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de82b1e5-5cfb-423c-b612-e6e5e77c021f") failed: Property not found. retry in 647.76554ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de82b1e5-5cfb-423c-b612-e6e5e77c021f
14072024-12-06T20:43:59.990ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ed55ef04-a7c0-4b4e-ac1e-21d76b03e495") failed: Property not found. retry in 1.475928325s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ed55ef04-a7c0-4b4e-ac1e-21d76b03e495
14082024-12-06T20:44:00.013ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_46c53ce3-fed2-4b43-8728-cae9919088d1") failed: Property not found. retry in 69.696727ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_46c53ce3-fed2-4b43-8728-cae9919088d1
14092024-12-06T20:44:00.051ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_31a5acd7-f1f6-4683-a49e-44e34c5f6914") failed: Property not found. retry in 1.457170899s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_31a5acd7-f1f6-4683-a49e-44e34c5f6914
14102024-12-06T20:44:00.090ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04023147-2580-4e6f-a338-23a2e1e895fc") failed: Property not found. retry in 1.460163704s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04023147-2580-4e6f-a338-23a2e1e895fc
14112024-12-06T20:44:00.101ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_46c53ce3-fed2-4b43-8728-cae9919088d1") failed: Property not found. retry in 145.828714ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_46c53ce3-fed2-4b43-8728-cae9919088d1
14122024-12-06T20:44:00.193ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ba33747a-8bf5-489f-aaf5-20508b581f0f") failed: Property not found. retry in 614.036354ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ba33747a-8bf5-489f-aaf5-20508b581f0f
14132024-12-06T20:44:00.211ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_84c4aae6-8e5d-40c4-b5db-027cbd5c5b06") failed: Property not found. retry in 1.362013462s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_84c4aae6-8e5d-40c4-b5db-027cbd5c5b06
14142024-12-06T20:44:00.211ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_9d99eda0-389f-44c6-94ee-e9e7a03c9733: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14152024-12-06T20:44:00.223ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0525204b-63bb-4f1b-be27-505477f54f5d") failed: Property not found. retry in 59.829159ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0525204b-63bb-4f1b-be27-505477f54f5d
14162024-12-06T20:44:00.234ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b2591895-3ac4-4a5b-8bab-97ad5b9d077c") failed: Property not found. retry in 1.316327456s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b2591895-3ac4-4a5b-8bab-97ad5b9d077c
14172024-12-06T20:44:00.234ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_9d99eda0-389f-44c6-94ee-e9e7a03c9733 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_9d99eda0-389f-44c6-94ee-e9e7a03c9733
14182024-12-06T20:44:00.251ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_59b92633-3550-4af1-b628-503b6bafd00d") failed: Property not found. retry in 1.113210229s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_59b92633-3550-4af1-b628-503b6bafd00d
14192024-12-06T20:44:00.260ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_46c53ce3-fed2-4b43-8728-cae9919088d1") failed: Property not found. retry in 218.86763ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_46c53ce3-fed2-4b43-8728-cae9919088d1
14202024-12-06T20:44:00.296ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0525204b-63bb-4f1b-be27-505477f54f5d") failed: Property not found. retry in 146.493547ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0525204b-63bb-4f1b-be27-505477f54f5d
14212024-12-06T20:44:00.461ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0525204b-63bb-4f1b-be27-505477f54f5d") failed: Property not found. retry in 108.415372ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0525204b-63bb-4f1b-be27-505477f54f5d
14222024-12-06T20:44:00.473ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_bef145b4-2934-45c3-870a-63d45572bde4") failed: Property not found. retry in 728.719674ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_bef145b4-2934-45c3-870a-63d45572bde4
14232024-12-06T20:44:00.490ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9d99eda0-389f-44c6-94ee-e9e7a03c9733") failed: Property not found. retry in 67.218388ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9d99eda0-389f-44c6-94ee-e9e7a03c9733
14242024-12-06T20:44:00.503ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_46c53ce3-fed2-4b43-8728-cae9919088d1") failed: Property not found. retry in 366.415323ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_46c53ce3-fed2-4b43-8728-cae9919088d1
14252024-12-06T20:44:00.530ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1049fe89-11bc-49dd-aec6-8ba72a4bf488") failed: Property not found. retry in 879.333757ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1049fe89-11bc-49dd-aec6-8ba72a4bf488
14262024-12-06T20:44:00.568ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9d99eda0-389f-44c6-94ee-e9e7a03c9733") failed: Property not found. retry in 132.857007ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9d99eda0-389f-44c6-94ee-e9e7a03c9733
14272024-12-06T20:44:00.580ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0525204b-63bb-4f1b-be27-505477f54f5d") failed: Property not found. retry in 266.843274ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0525204b-63bb-4f1b-be27-505477f54f5d
14282024-12-06T20:44:00.597ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de82b1e5-5cfb-423c-b612-e6e5e77c021f") failed: Property not found. retry in 674.007614ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de82b1e5-5cfb-423c-b612-e6e5e77c021f
14292024-12-06T20:44:00.713ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9d99eda0-389f-44c6-94ee-e9e7a03c9733") failed: Property not found. retry in 193.106069ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9d99eda0-389f-44c6-94ee-e9e7a03c9733
14302024-12-06T20:44:00.878ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_17a27890-edd1-41a9-b5f3-c1b01576ff0e") failed: Property not found. retry in 627.17589ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_17a27890-edd1-41a9-b5f3-c1b01576ff0e
14312024-12-06T20:44:00.890ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ba33747a-8bf5-489f-aaf5-20508b581f0f") failed: Property not found. retry in 1.07417187s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ba33747a-8bf5-489f-aaf5-20508b581f0f
14322024-12-06T20:44:00.901ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_46c53ce3-fed2-4b43-8728-cae9919088d1") failed: Property not found. retry in 622.564114ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_46c53ce3-fed2-4b43-8728-cae9919088d1
14332024-12-06T20:44:00.912ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0525204b-63bb-4f1b-be27-505477f54f5d") failed: Property not found. retry in 949.428097ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0525204b-63bb-4f1b-be27-505477f54f5d
14342024-12-06T20:44:00.925ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9d99eda0-389f-44c6-94ee-e9e7a03c9733") failed: Property not found. retry in 472.70878ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9d99eda0-389f-44c6-94ee-e9e7a03c9733
14352024-12-06T20:44:01.003ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_19f9def9-3a42-4f07-8788-385d13f17c0a") failed: Property not found. retry in 1.444980777s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_19f9def9-3a42-4f07-8788-385d13f17c0a
14362024-12-06T20:44:01.215ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_bef145b4-2934-45c3-870a-63d45572bde4") failed: Property not found. retry in 1.025823454s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_bef145b4-2934-45c3-870a-63d45572bde4
14372024-12-06T20:44:01.466ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_59b92633-3550-4af1-b628-503b6bafd00d") failed: Property not found. retry in 1.49166049s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_59b92633-3550-4af1-b628-503b6bafd00d
14382024-12-06T20:44:01.477ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de82b1e5-5cfb-423c-b612-e6e5e77c021f") failed: Property not found. retry in 1.118957942s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de82b1e5-5cfb-423c-b612-e6e5e77c021f
14392024-12-06T20:44:01.488ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9d99eda0-389f-44c6-94ee-e9e7a03c9733") failed: Property not found. retry in 406.240571ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9d99eda0-389f-44c6-94ee-e9e7a03c9733
14402024-12-06T20:44:01.498ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ed55ef04-a7c0-4b4e-ac1e-21d76b03e495") failed: Property not found. retry in 965.490469ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ed55ef04-a7c0-4b4e-ac1e-21d76b03e495
14412024-12-06T20:44:01.509ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1049fe89-11bc-49dd-aec6-8ba72a4bf488") failed: Property not found. retry in 756.708994ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1049fe89-11bc-49dd-aec6-8ba72a4bf488
14422024-12-06T20:44:01.520ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_31a5acd7-f1f6-4683-a49e-44e34c5f6914") failed: Property not found. retry in 1.356558424s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_31a5acd7-f1f6-4683-a49e-44e34c5f6914
14432024-12-06T20:44:01.532ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_17a27890-edd1-41a9-b5f3-c1b01576ff0e") failed: Property not found. retry in 1.215907664s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_17a27890-edd1-41a9-b5f3-c1b01576ff0e
14442024-12-06T20:44:01.544ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_46c53ce3-fed2-4b43-8728-cae9919088d1") failed: Property not found. retry in 710.3937ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_46c53ce3-fed2-4b43-8728-cae9919088d1
14452024-12-06T20:44:01.564ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04023147-2580-4e6f-a338-23a2e1e895fc") failed: Property not found. retry in 641.487449ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04023147-2580-4e6f-a338-23a2e1e895fc
14462024-12-06T20:44:01.574ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b2591895-3ac4-4a5b-8bab-97ad5b9d077c") failed: Property not found. retry in 760.685912ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b2591895-3ac4-4a5b-8bab-97ad5b9d077c
14472024-12-06T20:44:01.585ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_84c4aae6-8e5d-40c4-b5db-027cbd5c5b06") failed: Property not found. retry in 555.54306ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_84c4aae6-8e5d-40c4-b5db-027cbd5c5b06
14482024-12-06T20:44:01.872ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0525204b-63bb-4f1b-be27-505477f54f5d") failed: Property not found. retry in 595.173401ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0525204b-63bb-4f1b-be27-505477f54f5d
14492024-12-06T20:44:01.907ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9d99eda0-389f-44c6-94ee-e9e7a03c9733") failed: Property not found. retry in 1.202646284s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9d99eda0-389f-44c6-94ee-e9e7a03c9733
14502024-12-06T20:44:01.974ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ba33747a-8bf5-489f-aaf5-20508b581f0f") failed: Property not found. retry in 896.615066ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ba33747a-8bf5-489f-aaf5-20508b581f0f
14512024-12-06T20:44:02.151ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_84c4aae6-8e5d-40c4-b5db-027cbd5c5b06") failed: Property not found. retry in 1.130789908s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_84c4aae6-8e5d-40c4-b5db-027cbd5c5b06
14522024-12-06T20:44:02.214ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04023147-2580-4e6f-a338-23a2e1e895fc") failed: Property not found. retry in 1.192226189s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04023147-2580-4e6f-a338-23a2e1e895fc
14532024-12-06T20:44:02.250ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_bef145b4-2934-45c3-870a-63d45572bde4") failed: Property not found. retry in 810.316474ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_bef145b4-2934-45c3-870a-63d45572bde4
14542024-12-06T20:44:02.264ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_46c53ce3-fed2-4b43-8728-cae9919088d1") failed: Property not found. retry in 1.486826858s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_46c53ce3-fed2-4b43-8728-cae9919088d1
14552024-12-06T20:44:02.275ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1049fe89-11bc-49dd-aec6-8ba72a4bf488") failed: Property not found. retry in 874.870565ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1049fe89-11bc-49dd-aec6-8ba72a4bf488
14562024-12-06T20:44:02.345ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b2591895-3ac4-4a5b-8bab-97ad5b9d077c") failed: Property not found. retry in 751.446533ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b2591895-3ac4-4a5b-8bab-97ad5b9d077c
14572024-12-06T20:44:02.457ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_19f9def9-3a42-4f07-8788-385d13f17c0a") failed: Property not found. retry in 1.418236772s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_19f9def9-3a42-4f07-8788-385d13f17c0a
14582024-12-06T20:44:02.474ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ed55ef04-a7c0-4b4e-ac1e-21d76b03e495") failed: Property not found. retry in 639.363816ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ed55ef04-a7c0-4b4e-ac1e-21d76b03e495
14592024-12-06T20:44:02.483ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0525204b-63bb-4f1b-be27-505477f54f5d") failed: Property not found. retry in 1.116606584s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0525204b-63bb-4f1b-be27-505477f54f5d
14602024-12-06T20:44:02.606ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de82b1e5-5cfb-423c-b612-e6e5e77c021f") failed: Property not found. retry in 940.51207ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de82b1e5-5cfb-423c-b612-e6e5e77c021f
14612024-12-06T20:44:02.758ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_17a27890-edd1-41a9-b5f3-c1b01576ff0e") failed: Property not found. retry in 1.311655709s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_17a27890-edd1-41a9-b5f3-c1b01576ff0e
14622024-12-06T20:44:02.881ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ba33747a-8bf5-489f-aaf5-20508b581f0f") failed: Property not found. retry in 686.532773ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ba33747a-8bf5-489f-aaf5-20508b581f0f
14632024-12-06T20:44:02.890ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_31a5acd7-f1f6-4683-a49e-44e34c5f6914") failed: Property not found. retry in 882.188396ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_31a5acd7-f1f6-4683-a49e-44e34c5f6914
14642024-12-06T20:44:02.968ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_59b92633-3550-4af1-b628-503b6bafd00d") failed: Property not found. retry in 1.490133725s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_59b92633-3550-4af1-b628-503b6bafd00d
14652024-12-06T20:44:03.071ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_bef145b4-2934-45c3-870a-63d45572bde4") failed: Property not found. retry in 878.806312ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_bef145b4-2934-45c3-870a-63d45572bde4
14662024-12-06T20:44:03.106ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b2591895-3ac4-4a5b-8bab-97ad5b9d077c") failed: Property not found. retry in 682.209412ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b2591895-3ac4-4a5b-8bab-97ad5b9d077c
14672024-12-06T20:44:03.119ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9d99eda0-389f-44c6-94ee-e9e7a03c9733") failed: Property not found. retry in 851.988104ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9d99eda0-389f-44c6-94ee-e9e7a03c9733
14682024-12-06T20:44:03.127ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ed55ef04-a7c0-4b4e-ac1e-21d76b03e495") failed: Property not found. retry in 871.961206ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ed55ef04-a7c0-4b4e-ac1e-21d76b03e495
14692024-12-06T20:44:03.160ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1049fe89-11bc-49dd-aec6-8ba72a4bf488") failed: Property not found. retry in 1.355294135s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1049fe89-11bc-49dd-aec6-8ba72a4bf488
14702024-12-06T20:44:03.162ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_e9fe68b0-d53c-4161-a621-681677d5b0d6: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14712024-12-06T20:44:03.162ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_fd12fb4f-e62d-4cab-a4bd-2024f2546d3b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14722024-12-06T20:44:03.162ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_3965e738-3305-4fcd-9da0-4c6e0ce7edc1: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14732024-12-06T20:44:03.162ZINFOSledAgent (ServiceManager): Booting oxz_nexus_e9fe68b0-d53c-4161-a621-681677d5b0d6 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_e9fe68b0-d53c-4161-a621-681677d5b0d6
14742024-12-06T20:44:03.166ZINFOSledAgent (ServiceManager): Booting oxz_nexus_fd12fb4f-e62d-4cab-a4bd-2024f2546d3b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_fd12fb4f-e62d-4cab-a4bd-2024f2546d3b
14752024-12-06T20:44:03.170ZINFOSledAgent (ServiceManager): Booting oxz_nexus_3965e738-3305-4fcd-9da0-4c6e0ce7edc1 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_3965e738-3305-4fcd-9da0-4c6e0ce7edc1
14762024-12-06T20:44:03.300ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_84c4aae6-8e5d-40c4-b5db-027cbd5c5b06") failed: Property not found. retry in 822.438584ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_84c4aae6-8e5d-40c4-b5db-027cbd5c5b06
14772024-12-06T20:44:03.344ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e9fe68b0-d53c-4161-a621-681677d5b0d6") failed: Property not found. retry in 71.325984ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e9fe68b0-d53c-4161-a621-681677d5b0d6
14782024-12-06T20:44:03.351ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fd12fb4f-e62d-4cab-a4bd-2024f2546d3b") failed: Property not found. retry in 48.083106ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fd12fb4f-e62d-4cab-a4bd-2024f2546d3b
14792024-12-06T20:44:03.358ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3965e738-3305-4fcd-9da0-4c6e0ce7edc1") failed: Property not found. retry in 71.672976ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3965e738-3305-4fcd-9da0-4c6e0ce7edc1
14802024-12-06T20:44:03.407ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fd12fb4f-e62d-4cab-a4bd-2024f2546d3b") failed: Property not found. retry in 134.287055ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fd12fb4f-e62d-4cab-a4bd-2024f2546d3b
14812024-12-06T20:44:03.415ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04023147-2580-4e6f-a338-23a2e1e895fc") failed: Property not found. retry in 1.467086158s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04023147-2580-4e6f-a338-23a2e1e895fc
14822024-12-06T20:44:03.423ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e9fe68b0-d53c-4161-a621-681677d5b0d6") failed: Property not found. retry in 116.953091ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e9fe68b0-d53c-4161-a621-681677d5b0d6
14832024-12-06T20:44:03.443ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3965e738-3305-4fcd-9da0-4c6e0ce7edc1") failed: Property not found. retry in 77.899118ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3965e738-3305-4fcd-9da0-4c6e0ce7edc1
14842024-12-06T20:44:03.700ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3965e738-3305-4fcd-9da0-4c6e0ce7edc1") failed: Property not found. retry in 260.071392ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3965e738-3305-4fcd-9da0-4c6e0ce7edc1
14852024-12-06T20:44:03.712ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ba33747a-8bf5-489f-aaf5-20508b581f0f") failed: Property not found. retry in 671.609072ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ba33747a-8bf5-489f-aaf5-20508b581f0f
14862024-12-06T20:44:03.723ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de82b1e5-5cfb-423c-b612-e6e5e77c021f") failed: Property not found. retry in 1.348983457s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de82b1e5-5cfb-423c-b612-e6e5e77c021f
14872024-12-06T20:44:03.735ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0525204b-63bb-4f1b-be27-505477f54f5d") failed: Property not found. retry in 877.507408ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0525204b-63bb-4f1b-be27-505477f54f5d
14882024-12-06T20:44:03.747ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e9fe68b0-d53c-4161-a621-681677d5b0d6") failed: Property not found. retry in 140.597195ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e9fe68b0-d53c-4161-a621-681677d5b0d6
14892024-12-06T20:44:03.757ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fd12fb4f-e62d-4cab-a4bd-2024f2546d3b") failed: Property not found. retry in 276.968063ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fd12fb4f-e62d-4cab-a4bd-2024f2546d3b
14902024-12-06T20:44:03.766ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_46c53ce3-fed2-4b43-8728-cae9919088d1") failed: Property not found. retry in 1.204293753s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_46c53ce3-fed2-4b43-8728-cae9919088d1
14912024-12-06T20:44:03.782ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_31a5acd7-f1f6-4683-a49e-44e34c5f6914") failed: Property not found. retry in 688.100072ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_31a5acd7-f1f6-4683-a49e-44e34c5f6914
14922024-12-06T20:44:03.796ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b2591895-3ac4-4a5b-8bab-97ad5b9d077c") failed: Property not found. retry in 1.265238676s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b2591895-3ac4-4a5b-8bab-97ad5b9d077c
14932024-12-06T20:44:03.887ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_19f9def9-3a42-4f07-8788-385d13f17c0a") failed: Property not found. retry in 1.352548949s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_19f9def9-3a42-4f07-8788-385d13f17c0a
14942024-12-06T20:44:03.899ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e9fe68b0-d53c-4161-a621-681677d5b0d6") failed: Property not found. retry in 555.014699ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e9fe68b0-d53c-4161-a621-681677d5b0d6
14952024-12-06T20:44:03.957ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_bef145b4-2934-45c3-870a-63d45572bde4") failed: Property not found. retry in 1.179533815s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_bef145b4-2934-45c3-870a-63d45572bde4
14962024-12-06T20:44:03.970ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3965e738-3305-4fcd-9da0-4c6e0ce7edc1") failed: Property not found. retry in 275.25771ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3965e738-3305-4fcd-9da0-4c6e0ce7edc1
14972024-12-06T20:44:03.980ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9d99eda0-389f-44c6-94ee-e9e7a03c9733") failed: Property not found. retry in 1.401439022s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9d99eda0-389f-44c6-94ee-e9e7a03c9733
14982024-12-06T20:44:04.008ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ed55ef04-a7c0-4b4e-ac1e-21d76b03e495") failed: Property not found. retry in 758.502216ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ed55ef04-a7c0-4b4e-ac1e-21d76b03e495
14992024-12-06T20:44:04.044ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fd12fb4f-e62d-4cab-a4bd-2024f2546d3b") failed: Property not found. retry in 206.859136ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fd12fb4f-e62d-4cab-a4bd-2024f2546d3b
15002024-12-06T20:44:04.080ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_17a27890-edd1-41a9-b5f3-c1b01576ff0e") failed: Property not found. retry in 1.136237575s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_17a27890-edd1-41a9-b5f3-c1b01576ff0e
15012024-12-06T20:44:04.131ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_84c4aae6-8e5d-40c4-b5db-027cbd5c5b06") failed: Property not found. retry in 1.414937654s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_84c4aae6-8e5d-40c4-b5db-027cbd5c5b06
15022024-12-06T20:44:04.254ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3965e738-3305-4fcd-9da0-4c6e0ce7edc1") failed: Property not found. retry in 614.209122ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3965e738-3305-4fcd-9da0-4c6e0ce7edc1
15032024-12-06T20:44:04.262ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fd12fb4f-e62d-4cab-a4bd-2024f2546d3b") failed: Property not found. retry in 1.008125738s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fd12fb4f-e62d-4cab-a4bd-2024f2546d3b
15042024-12-06T20:44:04.394ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ba33747a-8bf5-489f-aaf5-20508b581f0f") failed: Property not found. retry in 571.714431ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ba33747a-8bf5-489f-aaf5-20508b581f0f
15052024-12-06T20:44:04.464ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e9fe68b0-d53c-4161-a621-681677d5b0d6") failed: Property not found. retry in 575.655365ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e9fe68b0-d53c-4161-a621-681677d5b0d6
15062024-12-06T20:44:04.472ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_59b92633-3550-4af1-b628-503b6bafd00d") failed: Property not found. retry in 1.05211562s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_59b92633-3550-4af1-b628-503b6bafd00d
15072024-12-06T20:44:04.481ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_31a5acd7-f1f6-4683-a49e-44e34c5f6914") failed: Property not found. retry in 1.48461212s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_31a5acd7-f1f6-4683-a49e-44e34c5f6914
15082024-12-06T20:44:04.524ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1049fe89-11bc-49dd-aec6-8ba72a4bf488") failed: Property not found. retry in 899.145603ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1049fe89-11bc-49dd-aec6-8ba72a4bf488
15092024-12-06T20:44:04.623ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0525204b-63bb-4f1b-be27-505477f54f5d") failed: Property not found. retry in 1.419094783s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0525204b-63bb-4f1b-be27-505477f54f5d
15102024-12-06T20:44:04.777ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ed55ef04-a7c0-4b4e-ac1e-21d76b03e495") failed: Property not found. retry in 902.291611ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ed55ef04-a7c0-4b4e-ac1e-21d76b03e495
15112024-12-06T20:44:04.877ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3965e738-3305-4fcd-9da0-4c6e0ce7edc1") failed: Property not found. retry in 606.639589ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3965e738-3305-4fcd-9da0-4c6e0ce7edc1
15122024-12-06T20:44:04.891ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04023147-2580-4e6f-a338-23a2e1e895fc") failed: Property not found. retry in 1.405364619s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04023147-2580-4e6f-a338-23a2e1e895fc
15132024-12-06T20:44:04.973ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ba33747a-8bf5-489f-aaf5-20508b581f0f") failed: Property not found. retry in 561.67245ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ba33747a-8bf5-489f-aaf5-20508b581f0f
15142024-12-06T20:44:04.981ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_46c53ce3-fed2-4b43-8728-cae9919088d1") failed: Property not found. retry in 1.390859065s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_46c53ce3-fed2-4b43-8728-cae9919088d1
15152024-12-06T20:44:05.049ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e9fe68b0-d53c-4161-a621-681677d5b0d6") failed: Property not found. retry in 810.760447ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e9fe68b0-d53c-4161-a621-681677d5b0d6
15162024-12-06T20:44:05.070ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b2591895-3ac4-4a5b-8bab-97ad5b9d077c") failed: Property not found. retry in 1.002134913s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b2591895-3ac4-4a5b-8bab-97ad5b9d077c
15172024-12-06T20:44:05.081ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de82b1e5-5cfb-423c-b612-e6e5e77c021f") failed: Property not found. retry in 1.471010326s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de82b1e5-5cfb-423c-b612-e6e5e77c021f
15182024-12-06T20:44:05.146ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_bef145b4-2934-45c3-870a-63d45572bde4") failed: Property not found. retry in 617.444343ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_bef145b4-2934-45c3-870a-63d45572bde4
15192024-12-06T20:44:05.226ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_17a27890-edd1-41a9-b5f3-c1b01576ff0e") failed: Property not found. retry in 857.822835ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_17a27890-edd1-41a9-b5f3-c1b01576ff0e
15202024-12-06T20:44:05.249ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_19f9def9-3a42-4f07-8788-385d13f17c0a") failed: Property not found. retry in 867.991948ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_19f9def9-3a42-4f07-8788-385d13f17c0a
15212024-12-06T20:44:05.279ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fd12fb4f-e62d-4cab-a4bd-2024f2546d3b") failed: Property not found. retry in 1.03487329s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fd12fb4f-e62d-4cab-a4bd-2024f2546d3b
15222024-12-06T20:44:05.395ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9d99eda0-389f-44c6-94ee-e9e7a03c9733") failed: Property not found. retry in 547.621342ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9d99eda0-389f-44c6-94ee-e9e7a03c9733
15232024-12-06T20:44:05.436ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1049fe89-11bc-49dd-aec6-8ba72a4bf488") failed: Property not found. retry in 659.070915ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1049fe89-11bc-49dd-aec6-8ba72a4bf488
15242024-12-06T20:44:05.497ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3965e738-3305-4fcd-9da0-4c6e0ce7edc1") failed: Property not found. retry in 723.343127ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3965e738-3305-4fcd-9da0-4c6e0ce7edc1
15252024-12-06T20:44:05.536ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_59b92633-3550-4af1-b628-503b6bafd00d") failed: Property not found. retry in 658.609652ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_59b92633-3550-4af1-b628-503b6bafd00d
15262024-12-06T20:44:05.547ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ba33747a-8bf5-489f-aaf5-20508b581f0f") failed: Property not found. retry in 676.365534ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ba33747a-8bf5-489f-aaf5-20508b581f0f
15272024-12-06T20:44:05.558ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_84c4aae6-8e5d-40c4-b5db-027cbd5c5b06") failed: Property not found. retry in 672.593059ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_84c4aae6-8e5d-40c4-b5db-027cbd5c5b06
15282024-12-06T20:44:05.691ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ed55ef04-a7c0-4b4e-ac1e-21d76b03e495") failed: Property not found. retry in 548.001279ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ed55ef04-a7c0-4b4e-ac1e-21d76b03e495
15292024-12-06T20:44:05.774ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_bef145b4-2934-45c3-870a-63d45572bde4") failed: Property not found. retry in 952.253471ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_bef145b4-2934-45c3-870a-63d45572bde4
15302024-12-06T20:44:05.870ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e9fe68b0-d53c-4161-a621-681677d5b0d6") failed: Property not found. retry in 963.971372ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e9fe68b0-d53c-4161-a621-681677d5b0d6
15312024-12-06T20:44:05.953ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9d99eda0-389f-44c6-94ee-e9e7a03c9733") failed: Property not found. retry in 1.215556168s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9d99eda0-389f-44c6-94ee-e9e7a03c9733
15322024-12-06T20:44:05.977ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_31a5acd7-f1f6-4683-a49e-44e34c5f6914") failed: Property not found. retry in 1.008166831s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_31a5acd7-f1f6-4683-a49e-44e34c5f6914
15332024-12-06T20:44:06.053ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0525204b-63bb-4f1b-be27-505477f54f5d") failed: Property not found. retry in 1.359146726s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0525204b-63bb-4f1b-be27-505477f54f5d
15342024-12-06T20:44:06.082ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b2591895-3ac4-4a5b-8bab-97ad5b9d077c") failed: Property not found. retry in 1.284600491s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b2591895-3ac4-4a5b-8bab-97ad5b9d077c
15352024-12-06T20:44:06.095ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_17a27890-edd1-41a9-b5f3-c1b01576ff0e") failed: Property not found. retry in 1.260010221s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_17a27890-edd1-41a9-b5f3-c1b01576ff0e
15362024-12-06T20:44:06.105ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1049fe89-11bc-49dd-aec6-8ba72a4bf488") failed: Property not found. retry in 867.843809ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1049fe89-11bc-49dd-aec6-8ba72a4bf488
15372024-12-06T20:44:06.127ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_19f9def9-3a42-4f07-8788-385d13f17c0a") failed: Property not found. retry in 1.490975942s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_19f9def9-3a42-4f07-8788-385d13f17c0a
15382024-12-06T20:44:06.205ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_59b92633-3550-4af1-b628-503b6bafd00d") failed: Property not found. retry in 1.32928762s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_59b92633-3550-4af1-b628-503b6bafd00d
15392024-12-06T20:44:06.229ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3965e738-3305-4fcd-9da0-4c6e0ce7edc1") failed: Property not found. retry in 1.487637565s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3965e738-3305-4fcd-9da0-4c6e0ce7edc1
15402024-12-06T20:44:06.238ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ba33747a-8bf5-489f-aaf5-20508b581f0f") failed: Property not found. retry in 774.763253ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ba33747a-8bf5-489f-aaf5-20508b581f0f
15412024-12-06T20:44:06.245ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_84c4aae6-8e5d-40c4-b5db-027cbd5c5b06") failed: Property not found. retry in 512.496173ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_84c4aae6-8e5d-40c4-b5db-027cbd5c5b06
15422024-12-06T20:44:06.253ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ed55ef04-a7c0-4b4e-ac1e-21d76b03e495") failed: Property not found. retry in 840.387566ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ed55ef04-a7c0-4b4e-ac1e-21d76b03e495
15432024-12-06T20:44:06.306ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04023147-2580-4e6f-a338-23a2e1e895fc") failed: Property not found. retry in 1.488613615s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04023147-2580-4e6f-a338-23a2e1e895fc
15442024-12-06T20:44:06.323ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fd12fb4f-e62d-4cab-a4bd-2024f2546d3b") failed: Property not found. retry in 1.296056376s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fd12fb4f-e62d-4cab-a4bd-2024f2546d3b
15452024-12-06T20:44:06.381ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_46c53ce3-fed2-4b43-8728-cae9919088d1") failed: Property not found. retry in 644.075357ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_46c53ce3-fed2-4b43-8728-cae9919088d1
15462024-12-06T20:44:06.562ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de82b1e5-5cfb-423c-b612-e6e5e77c021f") failed: Property not found. retry in 715.163392ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de82b1e5-5cfb-423c-b612-e6e5e77c021f
15472024-12-06T20:44:06.737ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_bef145b4-2934-45c3-870a-63d45572bde4") failed: Property not found. retry in 1.111700851s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_bef145b4-2934-45c3-870a-63d45572bde4
15482024-12-06T20:44:06.767ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_84c4aae6-8e5d-40c4-b5db-027cbd5c5b06") failed: Property not found. retry in 757.577469ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_84c4aae6-8e5d-40c4-b5db-027cbd5c5b06
15492024-12-06T20:44:06.844ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e9fe68b0-d53c-4161-a621-681677d5b0d6") failed: Property not found. retry in 1.42617779s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e9fe68b0-d53c-4161-a621-681677d5b0d6
15502024-12-06T20:44:06.983ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1049fe89-11bc-49dd-aec6-8ba72a4bf488") failed: Property not found. retry in 1.488303521s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1049fe89-11bc-49dd-aec6-8ba72a4bf488
15512024-12-06T20:44:06.994ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_31a5acd7-f1f6-4683-a49e-44e34c5f6914") failed: Property not found. retry in 627.881777ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_31a5acd7-f1f6-4683-a49e-44e34c5f6914
15522024-12-06T20:44:07.021ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ba33747a-8bf5-489f-aaf5-20508b581f0f") failed: Property not found. retry in 972.64057ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ba33747a-8bf5-489f-aaf5-20508b581f0f
15532024-12-06T20:44:07.036ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_46c53ce3-fed2-4b43-8728-cae9919088d1") failed: Property not found. retry in 1.240076374s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_46c53ce3-fed2-4b43-8728-cae9919088d1
15542024-12-06T20:44:07.103ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ed55ef04-a7c0-4b4e-ac1e-21d76b03e495") failed: Property not found. retry in 1.135952922s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ed55ef04-a7c0-4b4e-ac1e-21d76b03e495
15552024-12-06T20:44:07.179ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9d99eda0-389f-44c6-94ee-e9e7a03c9733") failed: Property not found. retry in 676.283025ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9d99eda0-389f-44c6-94ee-e9e7a03c9733
15562024-12-06T20:44:07.287ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de82b1e5-5cfb-423c-b612-e6e5e77c021f") failed: Property not found. retry in 675.814154ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de82b1e5-5cfb-423c-b612-e6e5e77c021f
15572024-12-06T20:44:07.366ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_17a27890-edd1-41a9-b5f3-c1b01576ff0e") failed: Property not found. retry in 764.856822ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_17a27890-edd1-41a9-b5f3-c1b01576ff0e
15582024-12-06T20:44:07.377ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b2591895-3ac4-4a5b-8bab-97ad5b9d077c") failed: Property not found. retry in 1.049526914s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b2591895-3ac4-4a5b-8bab-97ad5b9d077c
15592024-12-06T20:44:07.421ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0525204b-63bb-4f1b-be27-505477f54f5d") failed: Property not found. retry in 1.13914838s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0525204b-63bb-4f1b-be27-505477f54f5d
15602024-12-06T20:44:07.535ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_84c4aae6-8e5d-40c4-b5db-027cbd5c5b06") failed: Property not found. retry in 673.44825ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_84c4aae6-8e5d-40c4-b5db-027cbd5c5b06
15612024-12-06T20:44:07.544ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_59b92633-3550-4af1-b628-503b6bafd00d") failed: Property not found. retry in 1.216501356s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_59b92633-3550-4af1-b628-503b6bafd00d
15622024-12-06T20:44:07.629ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_19f9def9-3a42-4f07-8788-385d13f17c0a") failed: Property not found. retry in 610.10201ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_19f9def9-3a42-4f07-8788-385d13f17c0a
15632024-12-06T20:44:07.638ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_31a5acd7-f1f6-4683-a49e-44e34c5f6914") failed: Property not found. retry in 668.456565ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_31a5acd7-f1f6-4683-a49e-44e34c5f6914
15642024-12-06T20:44:07.646ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fd12fb4f-e62d-4cab-a4bd-2024f2546d3b") failed: Property not found. retry in 1.195793575s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fd12fb4f-e62d-4cab-a4bd-2024f2546d3b
15652024-12-06T20:44:07.726ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3965e738-3305-4fcd-9da0-4c6e0ce7edc1") failed: Property not found. retry in 1.345675436s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3965e738-3305-4fcd-9da0-4c6e0ce7edc1
15662024-12-06T20:44:07.804ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04023147-2580-4e6f-a338-23a2e1e895fc") failed: Property not found. retry in 1.227368706s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04023147-2580-4e6f-a338-23a2e1e895fc
15672024-12-06T20:44:07.859ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_bef145b4-2934-45c3-870a-63d45572bde4") failed: Property not found. retry in 1.115705655s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_bef145b4-2934-45c3-870a-63d45572bde4
15682024-12-06T20:44:07.867ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9d99eda0-389f-44c6-94ee-e9e7a03c9733") failed: Property not found. retry in 568.817664ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9d99eda0-389f-44c6-94ee-e9e7a03c9733
15692024-12-06T20:44:07.975ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de82b1e5-5cfb-423c-b612-e6e5e77c021f") failed: Property not found. retry in 1.110449738s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de82b1e5-5cfb-423c-b612-e6e5e77c021f
15702024-12-06T20:44:08.004ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ba33747a-8bf5-489f-aaf5-20508b581f0f") failed: Property not found. retry in 510.369175ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ba33747a-8bf5-489f-aaf5-20508b581f0f
15712024-12-06T20:44:08.141ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_17a27890-edd1-41a9-b5f3-c1b01576ff0e") failed: Property not found. retry in 1.497077131s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_17a27890-edd1-41a9-b5f3-c1b01576ff0e
15722024-12-06T20:44:08.217ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_84c4aae6-8e5d-40c4-b5db-027cbd5c5b06") failed: Property not found. retry in 1.351083923s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_84c4aae6-8e5d-40c4-b5db-027cbd5c5b06
15732024-12-06T20:44:08.248ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_19f9def9-3a42-4f07-8788-385d13f17c0a") failed: Property not found. retry in 1.233969667s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_19f9def9-3a42-4f07-8788-385d13f17c0a
15742024-12-06T20:44:08.256ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ed55ef04-a7c0-4b4e-ac1e-21d76b03e495") failed: Property not found. retry in 912.950705ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ed55ef04-a7c0-4b4e-ac1e-21d76b03e495
15752024-12-06T20:44:08.279ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e9fe68b0-d53c-4161-a621-681677d5b0d6") failed: Property not found. retry in 907.857132ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e9fe68b0-d53c-4161-a621-681677d5b0d6
15762024-12-06T20:44:08.288ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_46c53ce3-fed2-4b43-8728-cae9919088d1") failed: Property not found. retry in 809.130733ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_46c53ce3-fed2-4b43-8728-cae9919088d1
15772024-12-06T20:44:08.316ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_31a5acd7-f1f6-4683-a49e-44e34c5f6914") failed: Property not found. retry in 1.080301466s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_31a5acd7-f1f6-4683-a49e-44e34c5f6914
15782024-12-06T20:44:08.436ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b2591895-3ac4-4a5b-8bab-97ad5b9d077c") failed: Property not found. retry in 811.015079ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b2591895-3ac4-4a5b-8bab-97ad5b9d077c
15792024-12-06T20:44:08.445ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9d99eda0-389f-44c6-94ee-e9e7a03c9733") failed: Property not found. retry in 802.219238ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9d99eda0-389f-44c6-94ee-e9e7a03c9733
15802024-12-06T20:44:08.481ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1049fe89-11bc-49dd-aec6-8ba72a4bf488") failed: Property not found. retry in 845.072422ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1049fe89-11bc-49dd-aec6-8ba72a4bf488
15812024-12-06T20:44:08.524ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ba33747a-8bf5-489f-aaf5-20508b581f0f") failed: Property not found. retry in 872.720079ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ba33747a-8bf5-489f-aaf5-20508b581f0f
15822024-12-06T20:44:08.572ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0525204b-63bb-4f1b-be27-505477f54f5d") failed: Property not found. retry in 1.058414213s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0525204b-63bb-4f1b-be27-505477f54f5d
15832024-12-06T20:44:08.772ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_59b92633-3550-4af1-b628-503b6bafd00d") failed: Property not found. retry in 1.094574851s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_59b92633-3550-4af1-b628-503b6bafd00d
15842024-12-06T20:44:08.852ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fd12fb4f-e62d-4cab-a4bd-2024f2546d3b") failed: Property not found. retry in 538.464174ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fd12fb4f-e62d-4cab-a4bd-2024f2546d3b
15852024-12-06T20:44:08.986ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_bef145b4-2934-45c3-870a-63d45572bde4") failed: Property not found. retry in 707.695821ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_bef145b4-2934-45c3-870a-63d45572bde4
15862024-12-06T20:44:09.042ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04023147-2580-4e6f-a338-23a2e1e895fc") failed: Property not found. retry in 1.396528625s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04023147-2580-4e6f-a338-23a2e1e895fc
15872024-12-06T20:44:09.082ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3965e738-3305-4fcd-9da0-4c6e0ce7edc1") failed: Property not found. retry in 1.482230559s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3965e738-3305-4fcd-9da0-4c6e0ce7edc1
15882024-12-06T20:44:09.094ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de82b1e5-5cfb-423c-b612-e6e5e77c021f") failed: Property not found. retry in 1.07014991s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de82b1e5-5cfb-423c-b612-e6e5e77c021f
15892024-12-06T20:44:09.105ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_46c53ce3-fed2-4b43-8728-cae9919088d1") failed: Property not found. retry in 1.382866393s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_46c53ce3-fed2-4b43-8728-cae9919088d1
15902024-12-06T20:44:09.178ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ed55ef04-a7c0-4b4e-ac1e-21d76b03e495") failed: Property not found. retry in 845.030744ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ed55ef04-a7c0-4b4e-ac1e-21d76b03e495
15912024-12-06T20:44:09.196ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e9fe68b0-d53c-4161-a621-681677d5b0d6") failed: Property not found. retry in 1.47479743s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e9fe68b0-d53c-4161-a621-681677d5b0d6
15922024-12-06T20:44:09.255ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b2591895-3ac4-4a5b-8bab-97ad5b9d077c") failed: Property not found. retry in 1.421691469s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b2591895-3ac4-4a5b-8bab-97ad5b9d077c
15932024-12-06T20:44:09.261ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9d99eda0-389f-44c6-94ee-e9e7a03c9733") failed: Property not found. retry in 1.087035612s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9d99eda0-389f-44c6-94ee-e9e7a03c9733
15942024-12-06T20:44:09.334ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1049fe89-11bc-49dd-aec6-8ba72a4bf488") failed: Property not found. retry in 1.361223391s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1049fe89-11bc-49dd-aec6-8ba72a4bf488
15952024-12-06T20:44:09.398ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fd12fb4f-e62d-4cab-a4bd-2024f2546d3b") failed: Property not found. retry in 1.033104599s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fd12fb4f-e62d-4cab-a4bd-2024f2546d3b
15962024-12-06T20:44:09.404ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ba33747a-8bf5-489f-aaf5-20508b581f0f") failed: Property not found. retry in 1.419092726s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ba33747a-8bf5-489f-aaf5-20508b581f0f
15972024-12-06T20:44:09.411ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_31a5acd7-f1f6-4683-a49e-44e34c5f6914") failed: Property not found. retry in 734.452602ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_31a5acd7-f1f6-4683-a49e-44e34c5f6914
15982024-12-06T20:44:09.490ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_19f9def9-3a42-4f07-8788-385d13f17c0a") failed: Property not found. retry in 1.32528972s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_19f9def9-3a42-4f07-8788-385d13f17c0a
15992024-12-06T20:44:09.576ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_84c4aae6-8e5d-40c4-b5db-027cbd5c5b06") failed: Property not found. retry in 1.066285424s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_84c4aae6-8e5d-40c4-b5db-027cbd5c5b06
16002024-12-06T20:44:09.639ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0525204b-63bb-4f1b-be27-505477f54f5d") failed: Property not found. retry in 1.016227392s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0525204b-63bb-4f1b-be27-505477f54f5d
16012024-12-06T20:44:09.645ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_17a27890-edd1-41a9-b5f3-c1b01576ff0e") failed: Property not found. retry in 1.22424364s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_17a27890-edd1-41a9-b5f3-c1b01576ff0e
16022024-12-06T20:44:09.703ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_bef145b4-2934-45c3-870a-63d45572bde4") failed: Property not found. retry in 934.159774ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_bef145b4-2934-45c3-870a-63d45572bde4
16032024-12-06T20:44:09.878ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_59b92633-3550-4af1-b628-503b6bafd00d") failed: Property not found. retry in 784.022796ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_59b92633-3550-4af1-b628-503b6bafd00d
16042024-12-06T20:44:10.035ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ed55ef04-a7c0-4b4e-ac1e-21d76b03e495") failed: Property not found. retry in 1.36870574s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ed55ef04-a7c0-4b4e-ac1e-21d76b03e495
16052024-12-06T20:44:10.059ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_44e0594e-e8fa-4a38-8f8c-bcb6ceccc555: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin-single"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:8123'/> <propval type="astring" name="ch_binary" value='/opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
16062024-12-06T20:44:10.059ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_44e0594e-e8fa-4a38-8f8c-bcb6ceccc555 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_clickhouse_44e0594e-e8fa-4a38-8f8c-bcb6ceccc555
16072024-12-06T20:44:10.156ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_31a5acd7-f1f6-4683-a49e-44e34c5f6914") failed: Property not found. retry in 1.495888873s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_31a5acd7-f1f6-4683-a49e-44e34c5f6914
16082024-12-06T20:44:10.174ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de82b1e5-5cfb-423c-b612-e6e5e77c021f") failed: Property not found. retry in 591.677225ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de82b1e5-5cfb-423c-b612-e6e5e77c021f
16092024-12-06T20:44:10.248ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_44e0594e-e8fa-4a38-8f8c-bcb6ceccc555") failed: Property not found. retry in 40.344823ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_44e0594e-e8fa-4a38-8f8c-bcb6ceccc555
16102024-12-06T20:44:10.298ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_44e0594e-e8fa-4a38-8f8c-bcb6ceccc555") failed: Property not found. retry in 145.011369ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_44e0594e-e8fa-4a38-8f8c-bcb6ceccc555
16112024-12-06T20:44:10.365ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9d99eda0-389f-44c6-94ee-e9e7a03c9733") failed: Property not found. retry in 729.678373ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9d99eda0-389f-44c6-94ee-e9e7a03c9733
16122024-12-06T20:44:10.441ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fd12fb4f-e62d-4cab-a4bd-2024f2546d3b") failed: Property not found. retry in 657.199275ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fd12fb4f-e62d-4cab-a4bd-2024f2546d3b
16132024-12-06T20:44:10.450ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04023147-2580-4e6f-a338-23a2e1e895fc") failed: Property not found. retry in 1.255785085s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04023147-2580-4e6f-a338-23a2e1e895fc
16142024-12-06T20:44:10.458ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_44e0594e-e8fa-4a38-8f8c-bcb6ceccc555") failed: Property not found. retry in 261.096974ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_44e0594e-e8fa-4a38-8f8c-bcb6ceccc555
16152024-12-06T20:44:10.498ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_46c53ce3-fed2-4b43-8728-cae9919088d1") failed: Property not found. retry in 950.502883ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_46c53ce3-fed2-4b43-8728-cae9919088d1
16162024-12-06T20:44:10.575ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3965e738-3305-4fcd-9da0-4c6e0ce7edc1") failed: Property not found. retry in 1.098113217s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3965e738-3305-4fcd-9da0-4c6e0ce7edc1
16172024-12-06T20:44:10.648ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_bef145b4-2934-45c3-870a-63d45572bde4") failed: Property not found. retry in 1.031277818s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_bef145b4-2934-45c3-870a-63d45572bde4
16182024-12-06T20:44:10.657ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_84c4aae6-8e5d-40c4-b5db-027cbd5c5b06") failed: Property not found. retry in 1.169199771s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_84c4aae6-8e5d-40c4-b5db-027cbd5c5b06
16192024-12-06T20:44:10.667ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0525204b-63bb-4f1b-be27-505477f54f5d") failed: Property not found. retry in 855.241087ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0525204b-63bb-4f1b-be27-505477f54f5d
16202024-12-06T20:44:10.676ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_59b92633-3550-4af1-b628-503b6bafd00d") failed: Property not found. retry in 1.229311841s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_59b92633-3550-4af1-b628-503b6bafd00d
16212024-12-06T20:44:10.685ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b2591895-3ac4-4a5b-8bab-97ad5b9d077c") failed: Property not found. retry in 523.101203ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b2591895-3ac4-4a5b-8bab-97ad5b9d077c
16222024-12-06T20:44:10.693ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e9fe68b0-d53c-4161-a621-681677d5b0d6") failed: Property not found. retry in 615.505123ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e9fe68b0-d53c-4161-a621-681677d5b0d6
16232024-12-06T20:44:10.704ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1049fe89-11bc-49dd-aec6-8ba72a4bf488") failed: Property not found. retry in 1.366741383s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1049fe89-11bc-49dd-aec6-8ba72a4bf488
16242024-12-06T20:44:10.731ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_44e0594e-e8fa-4a38-8f8c-bcb6ceccc555") failed: Property not found. retry in 249.888779ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_44e0594e-e8fa-4a38-8f8c-bcb6ceccc555
16252024-12-06T20:44:10.777ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de82b1e5-5cfb-423c-b612-e6e5e77c021f") failed: Property not found. retry in 801.408272ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de82b1e5-5cfb-423c-b612-e6e5e77c021f
16262024-12-06T20:44:10.827ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_19f9def9-3a42-4f07-8788-385d13f17c0a") failed: Property not found. retry in 1.086681944s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_19f9def9-3a42-4f07-8788-385d13f17c0a
16272024-12-06T20:44:10.838ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ba33747a-8bf5-489f-aaf5-20508b581f0f") failed: Property not found. retry in 1.140634388s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ba33747a-8bf5-489f-aaf5-20508b581f0f
16282024-12-06T20:44:10.882ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_17a27890-edd1-41a9-b5f3-c1b01576ff0e") failed: Property not found. retry in 1.347530408s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_17a27890-edd1-41a9-b5f3-c1b01576ff0e
16292024-12-06T20:44:10.993ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_44e0594e-e8fa-4a38-8f8c-bcb6ceccc555") failed: Property not found. retry in 668.979401ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_44e0594e-e8fa-4a38-8f8c-bcb6ceccc555
16302024-12-06T20:44:11.108ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9d99eda0-389f-44c6-94ee-e9e7a03c9733") failed: Property not found. retry in 616.921489ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9d99eda0-389f-44c6-94ee-e9e7a03c9733
16312024-12-06T20:44:11.120ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fd12fb4f-e62d-4cab-a4bd-2024f2546d3b") failed: Property not found. retry in 1.191749475s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fd12fb4f-e62d-4cab-a4bd-2024f2546d3b
16322024-12-06T20:44:11.220ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b2591895-3ac4-4a5b-8bab-97ad5b9d077c") failed: Property not found. retry in 728.83737ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b2591895-3ac4-4a5b-8bab-97ad5b9d077c
16332024-12-06T20:44:11.329ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e9fe68b0-d53c-4161-a621-681677d5b0d6") failed: Property not found. retry in 1.050334099s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e9fe68b0-d53c-4161-a621-681677d5b0d6
16342024-12-06T20:44:11.416ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ed55ef04-a7c0-4b4e-ac1e-21d76b03e495") failed: Property not found. retry in 617.348156ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ed55ef04-a7c0-4b4e-ac1e-21d76b03e495
16352024-12-06T20:44:11.461ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_46c53ce3-fed2-4b43-8728-cae9919088d1") failed: Property not found. retry in 1.439214288s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_46c53ce3-fed2-4b43-8728-cae9919088d1
16362024-12-06T20:44:11.536ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0525204b-63bb-4f1b-be27-505477f54f5d") failed: Property not found. retry in 1.322472169s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0525204b-63bb-4f1b-be27-505477f54f5d
16372024-12-06T20:44:11.591ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de82b1e5-5cfb-423c-b612-e6e5e77c021f") failed: Property not found. retry in 1.497734211s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de82b1e5-5cfb-423c-b612-e6e5e77c021f
16382024-12-06T20:44:11.666ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_31a5acd7-f1f6-4683-a49e-44e34c5f6914") failed: Property not found. retry in 1.477079896s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_31a5acd7-f1f6-4683-a49e-44e34c5f6914
16392024-12-06T20:44:11.679ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_44e0594e-e8fa-4a38-8f8c-bcb6ceccc555") failed: Property not found. retry in 580.209118ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_44e0594e-e8fa-4a38-8f8c-bcb6ceccc555
16402024-12-06T20:44:11.690ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3965e738-3305-4fcd-9da0-4c6e0ce7edc1") failed: Property not found. retry in 934.009261ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3965e738-3305-4fcd-9da0-4c6e0ce7edc1
16412024-12-06T20:44:11.701ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_bef145b4-2934-45c3-870a-63d45572bde4") failed: Property not found. retry in 1.49783735s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_bef145b4-2934-45c3-870a-63d45572bde4
16422024-12-06T20:44:11.721ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04023147-2580-4e6f-a338-23a2e1e895fc") failed: Property not found. retry in 713.023839ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04023147-2580-4e6f-a338-23a2e1e895fc
16432024-12-06T20:44:11.738ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9d99eda0-389f-44c6-94ee-e9e7a03c9733") failed: Property not found. retry in 1.235595229s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9d99eda0-389f-44c6-94ee-e9e7a03c9733
16442024-12-06T20:44:11.840ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_84c4aae6-8e5d-40c4-b5db-027cbd5c5b06") failed: Property not found. retry in 1.290847427s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_84c4aae6-8e5d-40c4-b5db-027cbd5c5b06
16452024-12-06T20:44:11.918ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_59b92633-3550-4af1-b628-503b6bafd00d") failed: Property not found. retry in 1.320228183s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_59b92633-3550-4af1-b628-503b6bafd00d
16462024-12-06T20:44:11.929ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_19f9def9-3a42-4f07-8788-385d13f17c0a") failed: Property not found. retry in 1.419513915s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_19f9def9-3a42-4f07-8788-385d13f17c0a
16472024-12-06T20:44:11.959ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b2591895-3ac4-4a5b-8bab-97ad5b9d077c") failed: Property not found. retry in 1.006650685s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b2591895-3ac4-4a5b-8bab-97ad5b9d077c
16482024-12-06T20:44:11.989ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ba33747a-8bf5-489f-aaf5-20508b581f0f") failed: Property not found. retry in 1.381961545s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ba33747a-8bf5-489f-aaf5-20508b581f0f
16492024-12-06T20:44:12.043ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ed55ef04-a7c0-4b4e-ac1e-21d76b03e495") failed: Property not found. retry in 597.391007ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ed55ef04-a7c0-4b4e-ac1e-21d76b03e495
16502024-12-06T20:44:12.085ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1049fe89-11bc-49dd-aec6-8ba72a4bf488") failed: Property not found. retry in 958.812241ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1049fe89-11bc-49dd-aec6-8ba72a4bf488
16512024-12-06T20:44:12.244ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_17a27890-edd1-41a9-b5f3-c1b01576ff0e") failed: Property not found. retry in 768.846753ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_17a27890-edd1-41a9-b5f3-c1b01576ff0e
16522024-12-06T20:44:12.273ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_44e0594e-e8fa-4a38-8f8c-bcb6ceccc555") failed: Property not found. retry in 812.398003ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_44e0594e-e8fa-4a38-8f8c-bcb6ceccc555
16532024-12-06T20:44:12.328ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fd12fb4f-e62d-4cab-a4bd-2024f2546d3b") failed: Property not found. retry in 864.668387ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fd12fb4f-e62d-4cab-a4bd-2024f2546d3b
16542024-12-06T20:44:12.393ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e9fe68b0-d53c-4161-a621-681677d5b0d6") failed: Property not found. retry in 910.169013ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e9fe68b0-d53c-4161-a621-681677d5b0d6
16552024-12-06T20:44:12.450ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04023147-2580-4e6f-a338-23a2e1e895fc") failed: Property not found. retry in 1.255473018s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04023147-2580-4e6f-a338-23a2e1e895fc
16562024-12-06T20:44:12.638ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3965e738-3305-4fcd-9da0-4c6e0ce7edc1") failed: Property not found. retry in 1.214092041s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3965e738-3305-4fcd-9da0-4c6e0ce7edc1
16572024-12-06T20:44:12.652ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ed55ef04-a7c0-4b4e-ac1e-21d76b03e495") failed: Property not found. retry in 941.833879ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ed55ef04-a7c0-4b4e-ac1e-21d76b03e495
16582024-12-06T20:44:12.872ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0525204b-63bb-4f1b-be27-505477f54f5d") failed: Property not found. retry in 552.489584ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0525204b-63bb-4f1b-be27-505477f54f5d
16592024-12-06T20:44:12.913ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_46c53ce3-fed2-4b43-8728-cae9919088d1") failed: Property not found. retry in 1.363767436s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_46c53ce3-fed2-4b43-8728-cae9919088d1
16602024-12-06T20:44:12.977ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b2591895-3ac4-4a5b-8bab-97ad5b9d077c") failed: Property not found. retry in 767.591338ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b2591895-3ac4-4a5b-8bab-97ad5b9d077c
16612024-12-06T20:44:12.989ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9d99eda0-389f-44c6-94ee-e9e7a03c9733") failed: Property not found. retry in 696.342205ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9d99eda0-389f-44c6-94ee-e9e7a03c9733
16622024-12-06T20:44:13.027ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_17a27890-edd1-41a9-b5f3-c1b01576ff0e") failed: Property not found. retry in 1.179653266s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_17a27890-edd1-41a9-b5f3-c1b01576ff0e
16632024-12-06T20:44:13.054ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1049fe89-11bc-49dd-aec6-8ba72a4bf488") failed: Property not found. retry in 1.399140142s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1049fe89-11bc-49dd-aec6-8ba72a4bf488
16642024-12-06T20:44:13.094ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_44e0594e-e8fa-4a38-8f8c-bcb6ceccc555") failed: Property not found. retry in 1.402136274s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_44e0594e-e8fa-4a38-8f8c-bcb6ceccc555
16652024-12-06T20:44:13.104ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de82b1e5-5cfb-423c-b612-e6e5e77c021f") failed: Property not found. retry in 629.4366ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de82b1e5-5cfb-423c-b612-e6e5e77c021f
16662024-12-06T20:44:13.140ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_84c4aae6-8e5d-40c4-b5db-027cbd5c5b06") failed: Property not found. retry in 1.317259737s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_84c4aae6-8e5d-40c4-b5db-027cbd5c5b06
16672024-12-06T20:44:13.152ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_31a5acd7-f1f6-4683-a49e-44e34c5f6914") failed: Property not found. retry in 1.028210409s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_31a5acd7-f1f6-4683-a49e-44e34c5f6914
16682024-12-06T20:44:13.202ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fd12fb4f-e62d-4cab-a4bd-2024f2546d3b") failed: Property not found. retry in 792.373571ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fd12fb4f-e62d-4cab-a4bd-2024f2546d3b
16692024-12-06T20:44:13.212ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_bef145b4-2934-45c3-870a-63d45572bde4") failed: Property not found. retry in 1.399172976s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_bef145b4-2934-45c3-870a-63d45572bde4
16702024-12-06T20:44:13.249ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_59b92633-3550-4af1-b628-503b6bafd00d") failed: Property not found. retry in 1.210053886s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_59b92633-3550-4af1-b628-503b6bafd00d
16712024-12-06T20:44:13.316ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e9fe68b0-d53c-4161-a621-681677d5b0d6") failed: Property not found. retry in 714.753148ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e9fe68b0-d53c-4161-a621-681677d5b0d6
16722024-12-06T20:44:13.360ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_19f9def9-3a42-4f07-8788-385d13f17c0a") failed: Property not found. retry in 1.018883453s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_19f9def9-3a42-4f07-8788-385d13f17c0a
16732024-12-06T20:44:13.382ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ba33747a-8bf5-489f-aaf5-20508b581f0f") failed: Property not found. retry in 1.477676725s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ba33747a-8bf5-489f-aaf5-20508b581f0f
16742024-12-06T20:44:13.436ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0525204b-63bb-4f1b-be27-505477f54f5d") failed: Property not found. retry in 1.067870158s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0525204b-63bb-4f1b-be27-505477f54f5d
16752024-12-06T20:44:13.606ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ed55ef04-a7c0-4b4e-ac1e-21d76b03e495") failed: Property not found. retry in 1.089466883s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ed55ef04-a7c0-4b4e-ac1e-21d76b03e495
16762024-12-06T20:44:13.699ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9d99eda0-389f-44c6-94ee-e9e7a03c9733") failed: Property not found. retry in 1.062649198s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9d99eda0-389f-44c6-94ee-e9e7a03c9733
16772024-12-06T20:44:13.720ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04023147-2580-4e6f-a338-23a2e1e895fc") failed: Property not found. retry in 1.350470809s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04023147-2580-4e6f-a338-23a2e1e895fc
16782024-12-06T20:44:13.743ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de82b1e5-5cfb-423c-b612-e6e5e77c021f") failed: Property not found. retry in 908.937394ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de82b1e5-5cfb-423c-b612-e6e5e77c021f
16792024-12-06T20:44:13.756ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b2591895-3ac4-4a5b-8bab-97ad5b9d077c") failed: Property not found. retry in 1.381592373s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b2591895-3ac4-4a5b-8bab-97ad5b9d077c
16802024-12-06T20:44:13.866ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3965e738-3305-4fcd-9da0-4c6e0ce7edc1") failed: Property not found. retry in 608.620425ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3965e738-3305-4fcd-9da0-4c6e0ce7edc1
16812024-12-06T20:44:14.007ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fd12fb4f-e62d-4cab-a4bd-2024f2546d3b") failed: Property not found. retry in 1.097709484s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fd12fb4f-e62d-4cab-a4bd-2024f2546d3b
16822024-12-06T20:44:14.047ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e9fe68b0-d53c-4161-a621-681677d5b0d6") failed: Property not found. retry in 958.443652ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e9fe68b0-d53c-4161-a621-681677d5b0d6
16832024-12-06T20:44:14.193ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_31a5acd7-f1f6-4683-a49e-44e34c5f6914") failed: Property not found. retry in 1.317658379s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_31a5acd7-f1f6-4683-a49e-44e34c5f6914
16842024-12-06T20:44:14.219ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_17a27890-edd1-41a9-b5f3-c1b01576ff0e") failed: Property not found. retry in 1.093019824s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_17a27890-edd1-41a9-b5f3-c1b01576ff0e
16852024-12-06T20:44:14.290ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_46c53ce3-fed2-4b43-8728-cae9919088d1") failed: Property not found. retry in 593.187489ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_46c53ce3-fed2-4b43-8728-cae9919088d1
16862024-12-06T20:44:14.393ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_19f9def9-3a42-4f07-8788-385d13f17c0a") failed: Property not found. retry in 1.004417812s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_19f9def9-3a42-4f07-8788-385d13f17c0a
16872024-12-06T20:44:14.465ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1049fe89-11bc-49dd-aec6-8ba72a4bf488") failed: Property not found. retry in 1.489516123s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1049fe89-11bc-49dd-aec6-8ba72a4bf488
16882024-12-06T20:44:14.476ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_59b92633-3550-4af1-b628-503b6bafd00d") failed: Property not found. retry in 1.491722193s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_59b92633-3550-4af1-b628-503b6bafd00d
16892024-12-06T20:44:14.487ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_84c4aae6-8e5d-40c4-b5db-027cbd5c5b06") failed: Property not found. retry in 1.259592724s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_84c4aae6-8e5d-40c4-b5db-027cbd5c5b06
16902024-12-06T20:44:14.497ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3965e738-3305-4fcd-9da0-4c6e0ce7edc1") failed: Property not found. retry in 1.492113092s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3965e738-3305-4fcd-9da0-4c6e0ce7edc1
16912024-12-06T20:44:14.510ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_44e0594e-e8fa-4a38-8f8c-bcb6ceccc555") failed: Property not found. retry in 976.244559ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_44e0594e-e8fa-4a38-8f8c-bcb6ceccc555
16922024-12-06T20:44:14.520ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0525204b-63bb-4f1b-be27-505477f54f5d") failed: Property not found. retry in 845.542407ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0525204b-63bb-4f1b-be27-505477f54f5d
16932024-12-06T20:44:14.622ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_bef145b4-2934-45c3-870a-63d45572bde4") failed: Property not found. retry in 1.028192851s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_bef145b4-2934-45c3-870a-63d45572bde4
16942024-12-06T20:44:14.664ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de82b1e5-5cfb-423c-b612-e6e5e77c021f") failed: Property not found. retry in 537.030367ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de82b1e5-5cfb-423c-b612-e6e5e77c021f
16952024-12-06T20:44:14.710ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ed55ef04-a7c0-4b4e-ac1e-21d76b03e495") failed: Property not found. retry in 827.039979ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ed55ef04-a7c0-4b4e-ac1e-21d76b03e495
16962024-12-06T20:44:14.773ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9d99eda0-389f-44c6-94ee-e9e7a03c9733") failed: Property not found. retry in 1.059859374s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9d99eda0-389f-44c6-94ee-e9e7a03c9733
16972024-12-06T20:44:14.872ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ba33747a-8bf5-489f-aaf5-20508b581f0f") failed: Property not found. retry in 563.66461ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ba33747a-8bf5-489f-aaf5-20508b581f0f
16982024-12-06T20:44:14.896ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_46c53ce3-fed2-4b43-8728-cae9919088d1") failed: Property not found. retry in 1.4146993s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_46c53ce3-fed2-4b43-8728-cae9919088d1
16992024-12-06T20:44:15.020ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e9fe68b0-d53c-4161-a621-681677d5b0d6") failed: Property not found. retry in 732.841977ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e9fe68b0-d53c-4161-a621-681677d5b0d6
17002024-12-06T20:44:15.087ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04023147-2580-4e6f-a338-23a2e1e895fc") failed: Property not found. retry in 1.404911396s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04023147-2580-4e6f-a338-23a2e1e895fc
17012024-12-06T20:44:15.121ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fd12fb4f-e62d-4cab-a4bd-2024f2546d3b") failed: Property not found. retry in 787.676476ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fd12fb4f-e62d-4cab-a4bd-2024f2546d3b
17022024-12-06T20:44:15.155ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b2591895-3ac4-4a5b-8bab-97ad5b9d077c") failed: Property not found. retry in 869.34492ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b2591895-3ac4-4a5b-8bab-97ad5b9d077c
17032024-12-06T20:44:15.217ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de82b1e5-5cfb-423c-b612-e6e5e77c021f") failed: Property not found. retry in 1.025459551s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de82b1e5-5cfb-423c-b612-e6e5e77c021f
17042024-12-06T20:44:15.326ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_17a27890-edd1-41a9-b5f3-c1b01576ff0e") failed: Property not found. retry in 917.53201ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_17a27890-edd1-41a9-b5f3-c1b01576ff0e
17052024-12-06T20:44:15.383ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0525204b-63bb-4f1b-be27-505477f54f5d") failed: Property not found. retry in 1.38549392s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0525204b-63bb-4f1b-be27-505477f54f5d
17062024-12-06T20:44:15.411ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_19f9def9-3a42-4f07-8788-385d13f17c0a") failed: Property not found. retry in 523.496902ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_19f9def9-3a42-4f07-8788-385d13f17c0a
17072024-12-06T20:44:15.446ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ba33747a-8bf5-489f-aaf5-20508b581f0f") failed: Property not found. retry in 1.378486777s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ba33747a-8bf5-489f-aaf5-20508b581f0f
17082024-12-06T20:44:15.499ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_44e0594e-e8fa-4a38-8f8c-bcb6ceccc555") failed: Property not found. retry in 691.565483ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_44e0594e-e8fa-4a38-8f8c-bcb6ceccc555
17092024-12-06T20:44:15.524ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_31a5acd7-f1f6-4683-a49e-44e34c5f6914") failed: Property not found. retry in 1.254208574s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_31a5acd7-f1f6-4683-a49e-44e34c5f6914
17102024-12-06T20:44:15.549ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ed55ef04-a7c0-4b4e-ac1e-21d76b03e495") failed: Property not found. retry in 1.374600208s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ed55ef04-a7c0-4b4e-ac1e-21d76b03e495
17112024-12-06T20:44:15.664ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_bef145b4-2934-45c3-870a-63d45572bde4") failed: Property not found. retry in 702.443649ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_bef145b4-2934-45c3-870a-63d45572bde4
17122024-12-06T20:44:15.760ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_84c4aae6-8e5d-40c4-b5db-027cbd5c5b06") failed: Property not found. retry in 917.737767ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_84c4aae6-8e5d-40c4-b5db-027cbd5c5b06
17132024-12-06T20:44:15.770ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e9fe68b0-d53c-4161-a621-681677d5b0d6") failed: Property not found. retry in 573.30495ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e9fe68b0-d53c-4161-a621-681677d5b0d6
17142024-12-06T20:44:15.844ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9d99eda0-389f-44c6-94ee-e9e7a03c9733") failed: Property not found. retry in 1.221853016s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9d99eda0-389f-44c6-94ee-e9e7a03c9733
17152024-12-06T20:44:15.920ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fd12fb4f-e62d-4cab-a4bd-2024f2546d3b") failed: Property not found. retry in 563.835688ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fd12fb4f-e62d-4cab-a4bd-2024f2546d3b
17162024-12-06T20:44:15.944ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_19f9def9-3a42-4f07-8788-385d13f17c0a") failed: Property not found. retry in 569.42453ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_19f9def9-3a42-4f07-8788-385d13f17c0a
17172024-12-06T20:44:15.978ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_59b92633-3550-4af1-b628-503b6bafd00d") failed: Property not found. retry in 1.07267605s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_59b92633-3550-4af1-b628-503b6bafd00d
17182024-12-06T20:44:16.006ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3965e738-3305-4fcd-9da0-4c6e0ce7edc1") failed: Property not found. retry in 1.090609156s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3965e738-3305-4fcd-9da0-4c6e0ce7edc1
17192024-12-06T20:44:16.035ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b2591895-3ac4-4a5b-8bab-97ad5b9d077c") failed: Property not found. retry in 859.542333ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b2591895-3ac4-4a5b-8bab-97ad5b9d077c
17202024-12-06T20:44:16.200ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_44e0594e-e8fa-4a38-8f8c-bcb6ceccc555") failed: Property not found. retry in 771.608878ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_44e0594e-e8fa-4a38-8f8c-bcb6ceccc555
17212024-12-06T20:44:16.251ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de82b1e5-5cfb-423c-b612-e6e5e77c021f") failed: Property not found. retry in 640.728794ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de82b1e5-5cfb-423c-b612-e6e5e77c021f
17222024-12-06T20:44:16.259ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_17a27890-edd1-41a9-b5f3-c1b01576ff0e") failed: Property not found. retry in 1.000683946s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_17a27890-edd1-41a9-b5f3-c1b01576ff0e
17232024-12-06T20:44:16.321ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_46c53ce3-fed2-4b43-8728-cae9919088d1") failed: Property not found. retry in 1.412012929s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_46c53ce3-fed2-4b43-8728-cae9919088d1
17242024-12-06T20:44:16.353ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e9fe68b0-d53c-4161-a621-681677d5b0d6") failed: Property not found. retry in 1.483562423s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e9fe68b0-d53c-4161-a621-681677d5b0d6
17252024-12-06T20:44:16.377ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_bef145b4-2934-45c3-870a-63d45572bde4") failed: Property not found. retry in 1.05566027s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_bef145b4-2934-45c3-870a-63d45572bde4
17262024-12-06T20:44:16.457ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 61.192855137s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
17272024-12-06T20:44:16.493ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fd12fb4f-e62d-4cab-a4bd-2024f2546d3b") failed: Property not found. retry in 1.051712126s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fd12fb4f-e62d-4cab-a4bd-2024f2546d3b
17282024-12-06T20:44:16.501ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04023147-2580-4e6f-a338-23a2e1e895fc") failed: Property not found. retry in 929.287612ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04023147-2580-4e6f-a338-23a2e1e895fc
17292024-12-06T20:44:16.530ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_19f9def9-3a42-4f07-8788-385d13f17c0a") failed: Property not found. retry in 1.245869021s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_19f9def9-3a42-4f07-8788-385d13f17c0a
17302024-12-06T20:44:16.689ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_84c4aae6-8e5d-40c4-b5db-027cbd5c5b06") failed: Property not found. retry in 867.149889ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_84c4aae6-8e5d-40c4-b5db-027cbd5c5b06
17312024-12-06T20:44:16.779ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0525204b-63bb-4f1b-be27-505477f54f5d") failed: Property not found. retry in 785.587357ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0525204b-63bb-4f1b-be27-505477f54f5d
17322024-12-06T20:44:16.833ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ba33747a-8bf5-489f-aaf5-20508b581f0f") failed: Property not found. retry in 904.687051ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ba33747a-8bf5-489f-aaf5-20508b581f0f
17332024-12-06T20:44:16.901ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de82b1e5-5cfb-423c-b612-e6e5e77c021f") failed: Property not found. retry in 783.446911ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de82b1e5-5cfb-423c-b612-e6e5e77c021f
17342024-12-06T20:44:16.909ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b2591895-3ac4-4a5b-8bab-97ad5b9d077c") failed: Property not found. retry in 626.530292ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b2591895-3ac4-4a5b-8bab-97ad5b9d077c
17352024-12-06T20:44:16.932ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ed55ef04-a7c0-4b4e-ac1e-21d76b03e495") failed: Property not found. retry in 967.646457ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ed55ef04-a7c0-4b4e-ac1e-21d76b03e495
17362024-12-06T20:44:16.981ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_44e0594e-e8fa-4a38-8f8c-bcb6ceccc555") failed: Property not found. retry in 1.181365376s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_44e0594e-e8fa-4a38-8f8c-bcb6ceccc555
17372024-12-06T20:44:17.060ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_59b92633-3550-4af1-b628-503b6bafd00d") failed: Property not found. retry in 630.286265ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_59b92633-3550-4af1-b628-503b6bafd00d
17382024-12-06T20:44:17.075ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9d99eda0-389f-44c6-94ee-e9e7a03c9733") failed: Property not found. retry in 1.365432069s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9d99eda0-389f-44c6-94ee-e9e7a03c9733
17392024-12-06T20:44:17.105ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3965e738-3305-4fcd-9da0-4c6e0ce7edc1") failed: Property not found. retry in 1.214239303s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3965e738-3305-4fcd-9da0-4c6e0ce7edc1
17402024-12-06T20:44:17.442ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04023147-2580-4e6f-a338-23a2e1e895fc") failed: Property not found. retry in 1.498183643s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04023147-2580-4e6f-a338-23a2e1e895fc
17412024-12-06T20:44:17.451ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_bef145b4-2934-45c3-870a-63d45572bde4") failed: Property not found. retry in 710.621484ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_bef145b4-2934-45c3-870a-63d45572bde4
17422024-12-06T20:44:17.545ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b2591895-3ac4-4a5b-8bab-97ad5b9d077c") failed: Property not found. retry in 1.021624113s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b2591895-3ac4-4a5b-8bab-97ad5b9d077c
17432024-12-06T20:44:17.554ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fd12fb4f-e62d-4cab-a4bd-2024f2546d3b") failed: Property not found. retry in 862.834001ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fd12fb4f-e62d-4cab-a4bd-2024f2546d3b
17442024-12-06T20:44:17.564ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_84c4aae6-8e5d-40c4-b5db-027cbd5c5b06") failed: Property not found. retry in 1.263434912s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_84c4aae6-8e5d-40c4-b5db-027cbd5c5b06
17452024-12-06T20:44:17.574ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0525204b-63bb-4f1b-be27-505477f54f5d") failed: Property not found. retry in 706.376813ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0525204b-63bb-4f1b-be27-505477f54f5d
17462024-12-06T20:44:17.694ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de82b1e5-5cfb-423c-b612-e6e5e77c021f") failed: Property not found. retry in 944.498748ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de82b1e5-5cfb-423c-b612-e6e5e77c021f
17472024-12-06T20:44:17.703ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_59b92633-3550-4af1-b628-503b6bafd00d") failed: Property not found. retry in 673.707067ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_59b92633-3550-4af1-b628-503b6bafd00d
17482024-12-06T20:44:17.742ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_46c53ce3-fed2-4b43-8728-cae9919088d1") failed: Property not found. retry in 1.39260696s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_46c53ce3-fed2-4b43-8728-cae9919088d1
17492024-12-06T20:44:17.750ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ba33747a-8bf5-489f-aaf5-20508b581f0f") failed: Property not found. retry in 924.188621ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ba33747a-8bf5-489f-aaf5-20508b581f0f
17502024-12-06T20:44:17.785ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_19f9def9-3a42-4f07-8788-385d13f17c0a") failed: Property not found. retry in 1.293081952s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_19f9def9-3a42-4f07-8788-385d13f17c0a
17512024-12-06T20:44:17.847ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e9fe68b0-d53c-4161-a621-681677d5b0d6") failed: Property not found. retry in 667.193163ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e9fe68b0-d53c-4161-a621-681677d5b0d6
17522024-12-06T20:44:17.911ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ed55ef04-a7c0-4b4e-ac1e-21d76b03e495") failed: Property not found. retry in 802.402257ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ed55ef04-a7c0-4b4e-ac1e-21d76b03e495
17532024-12-06T20:44:18.172ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_bef145b4-2934-45c3-870a-63d45572bde4") failed: Property not found. retry in 1.375786932s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_bef145b4-2934-45c3-870a-63d45572bde4
17542024-12-06T20:44:18.184ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_44e0594e-e8fa-4a38-8f8c-bcb6ceccc555") failed: Property not found. retry in 902.509042ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_44e0594e-e8fa-4a38-8f8c-bcb6ceccc555
17552024-12-06T20:44:19.110ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_44e0594e-e8fa-4a38-8f8c-bcb6ceccc555") failed: Property not found. retry in 1.145194345s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_44e0594e-e8fa-4a38-8f8c-bcb6ceccc555
17562024-12-06T20:44:20.223ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:45606
17572024-12-06T20:44:20.223ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:45606 req_id = 23e4de24-fbbb-4a7d-bcb2-db2566403eb1 response_code = 200 uri = /baseboard
17582024-12-06T20:44:20.297ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_clickhouse_44e0594e-e8fa-4a38-8f8c-bcb6ceccc555
17592024-12-06T20:44:20.297ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_external_dns_59b92633-3550-4af1-b628-503b6bafd00d
17602024-12-06T20:44:20.297ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_pantry_ba33747a-8bf5-489f-aaf5-20508b581f0f
17612024-12-06T20:44:20.297ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_de82b1e5-5cfb-423c-b612-e6e5e77c021f
17622024-12-06T20:44:20.297ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_31a5acd7-f1f6-4683-a49e-44e34c5f6914
17632024-12-06T20:44:20.297ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_84c4aae6-8e5d-40c4-b5db-027cbd5c5b06
17642024-12-06T20:44:20.297ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_b2591895-3ac4-4a5b-8bab-97ad5b9d077c
17652024-12-06T20:44:20.297ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_19f9def9-3a42-4f07-8788-385d13f17c0a
17662024-12-06T20:44:20.297ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_pantry_46c53ce3-fed2-4b43-8728-cae9919088d1
17672024-12-06T20:44:20.297ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_04023147-2580-4e6f-a338-23a2e1e895fc
17682024-12-06T20:44:20.297ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_external_dns_9d99eda0-389f-44c6-94ee-e9e7a03c9733
17692024-12-06T20:44:20.297ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_0525204b-63bb-4f1b-be27-505477f54f5d
17702024-12-06T20:44:20.297ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_17a27890-edd1-41a9-b5f3-c1b01576ff0e
17712024-12-06T20:44:20.297ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_ed55ef04-a7c0-4b4e-ac1e-21d76b03e495
17722024-12-06T20:44:20.297ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_nexus_e9fe68b0-d53c-4161-a621-681677d5b0d6
17732024-12-06T20:44:20.297ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_pantry_1049fe89-11bc-49dd-aec6-8ba72a4bf488
17742024-12-06T20:44:20.297ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_nexus_fd12fb4f-e62d-4cab-a4bd-2024f2546d3b
17752024-12-06T20:44:20.297ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_nexus_3965e738-3305-4fcd-9da0-4c6e0ce7edc1
17762024-12-06T20:44:20.297ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_oximeter_bef145b4-2934-45c3-870a-63d45572bde4
17772024-12-06T20:44:20.297ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/b9ab18cf-4dd7-46c3-920e-833f181cfe8b/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
17782024-12-06T20:44:20.301ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/5a719d2c-fbf6-41ef-af9f-e6b70820ebd4/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
17792024-12-06T20:44:20.306ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 30109501 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:33731 req_id = 8f7f6f61-258c-4b31-b754-7ff634af49ca response_code = 204 uri = /omicron-zones
17802024-12-06T20:44:20.310ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1415
17812024-12-06T20:44:20.314ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:790
17822024-12-06T20:44:20.315ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::b]:12221 file = sled-agent/src/rack_setup/service.rs:802
17832024-12-06T20:44:20.361ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, rib_priority: None, vlan_id: None, }, ], switch: Switch0, tx_eq: None, uplink_port_fec: Some( None, ), uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:1016
17842024-12-06T20:44:22.438ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/06ed6b43-f7cd-4ed6-8c86-7494248aa355/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17852024-12-06T20:44:22.560ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/06ed6b43-f7cd-4ed6-8c86-7494248aa355/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17862024-12-06T20:44:22.649ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/06ed6b43-f7cd-4ed6-8c86-7494248aa355/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17872024-12-06T20:44:22.751ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/06ed6b43-f7cd-4ed6-8c86-7494248aa355/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17882024-12-06T20:44:22.953ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/0a667526-2006-419e-9b68-c251fd138c06) file = sled-agent/src/probe_manager.rs:231 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
17892024-12-06T20:44:22.981ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/06ed6b43-f7cd-4ed6-8c86-7494248aa355/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17902024-12-06T20:44:23.248ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/06ed6b43-f7cd-4ed6-8c86-7494248aa355/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17912024-12-06T20:44:23.443ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/0a667526-2006-419e-9b68-c251fd138c06) file = sled-agent/src/nexus.rs:527 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
17922024-12-06T20:44:23.558ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/06ed6b43-f7cd-4ed6-8c86-7494248aa355/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17932024-12-06T20:44:23.897ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/06ed6b43-f7cd-4ed6-8c86-7494248aa355/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17942024-12-06T20:44:23.964ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/0a667526-2006-419e-9b68-c251fd138c06) file = sled-agent/src/probe_manager.rs:231 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
17952024-12-06T20:44:24.285ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/0a667526-2006-419e-9b68-c251fd138c06) file = sled-agent/src/nexus.rs:527 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
17962024-12-06T20:44:24.380ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/06ed6b43-f7cd-4ed6-8c86-7494248aa355/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17972024-12-06T20:44:24.812ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/06ed6b43-f7cd-4ed6-8c86-7494248aa355/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17982024-12-06T20:44:24.966ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/0a667526-2006-419e-9b68-c251fd138c06) file = sled-agent/src/probe_manager.rs:231 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
17992024-12-06T20:44:25.196ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/06ed6b43-f7cd-4ed6-8c86-7494248aa355/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
18002024-12-06T20:44:26.099ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/06ed6b43-f7cd-4ed6-8c86-7494248aa355/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
18012024-12-06T20:44:26.841ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/06ed6b43-f7cd-4ed6-8c86-7494248aa355/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
18022024-12-06T20:44:27.310ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/06ed6b43-f7cd-4ed6-8c86-7494248aa355/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
18032024-12-06T20:44:28.127ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "0c93c9c6-bfb8-4ef2-b309-87438cfa424a", "content-length": "173", "date": "Fri, 06 Dec 2024 20:44:27 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"06ed6b43-f7cd-4ed6-8c86-7494248aa355\"", request_id: "0c93c9c6-bfb8-4ef2-b309-87438cfa424a" } file = sled-agent/src/rack_setup/service.rs:1078
18042024-12-06T20:44:28.416ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:500 new_generation = 1 old_generation = 1 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
18052024-12-06T20:44:28.879ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "b4ec001f-39c5-451d-9bb0-fc6d6b6bb449", "content-length": "173", "date": "Fri, 06 Dec 2024 20:44:28 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"06ed6b43-f7cd-4ed6-8c86-7494248aa355\"", request_id: "b4ec001f-39c5-451d-9bb0-fc6d6b6bb449" } file = sled-agent/src/rack_setup/service.rs:1078
18062024-12-06T20:44:29.175ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36330
18072024-12-06T20:44:29.180ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4400 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36330 req_id = 244e757b-af85-4b44-b495-ede7a5ff6e97 response_code = 200 uri = /vpc-routes
18082024-12-06T20:44:29.188ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64016
18092024-12-06T20:44:29.188ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 30 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64016 req_id = dd210aa6-c2be-4fb2-b20b-4b362ae41247 response_code = 200 uri = /vpc-routes
18102024-12-06T20:44:29.289ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53884
18112024-12-06T20:44:29.290ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
18122024-12-06T20:44:29.290ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
18132024-12-06T20:44:29.290ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b9ab18cf-4dd7-46c3-920e-833f181cfe8b/config/omicron-zones.json file = common/src/ledger.rs:177
18142024-12-06T20:44:29.290ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/5a719d2c-fbf6-41ef-af9f-e6b70820ebd4/config/omicron-zones.json file = common/src/ledger.rs:177
18152024-12-06T20:44:29.305ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 50f60e54-9000-4b4d-8705-841b133128b0 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18162024-12-06T20:44:29.305ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_50f60e54-9000-4b4d-8705-841b133128b0
18172024-12-06T20:44:29.339ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 99dfd90b-ff92-45e8-a73e-ada9e3f552c8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18182024-12-06T20:44:29.339ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_99dfd90b-ff92-45e8-a73e-ada9e3f552c8
18192024-12-06T20:44:29.344ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65280
18202024-12-06T20:44:29.353ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 values = ExternalIpGatewayMap { mappings: {} }
18212024-12-06T20:44:29.354ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1343 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64016 req_id = 0755b8bc-ee9c-44ef-b3ce-43e765d34e2f response_code = 204 uri = /eip-gateways
18222024-12-06T20:44:29.355ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 values = ExternalIpGatewayMap { mappings: {} }
18232024-12-06T20:44:29.355ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36330 req_id = 3f23f50b-9387-461f-9991-57ae31c5a21c response_code = 204 uri = /eip-gateways
18242024-12-06T20:44:29.357ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
18252024-12-06T20:44:29.357ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
18262024-12-06T20:44:29.357ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b9ab18cf-4dd7-46c3-920e-833f181cfe8b/config/omicron-zones.json file = common/src/ledger.rs:177
18272024-12-06T20:44:29.361ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/5a719d2c-fbf6-41ef-af9f-e6b70820ebd4/config/omicron-zones.json file = common/src/ledger.rs:177
18282024-12-06T20:44:29.368ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3b3acf4c-a316-45ce-a055-ef8d6c8acdff (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18292024-12-06T20:44:29.368ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_3b3acf4c-a316-45ce-a055-ef8d6c8acdff
18302024-12-06T20:44:29.387ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 50f60e54-9000-4b4d-8705-841b133128b0 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18312024-12-06T20:44:29.387ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_50f60e54-9000-4b4d-8705-841b133128b0
18322024-12-06T20:44:29.418ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 99dfd90b-ff92-45e8-a73e-ada9e3f552c8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18332024-12-06T20:44:29.418ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_99dfd90b-ff92-45e8-a73e-ada9e3f552c8
18342024-12-06T20:44:29.437ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5f5a9c7a-eec2-4e86-a02e-9238700fe7ab (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18352024-12-06T20:44:29.437ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_5f5a9c7a-eec2-4e86-a02e-9238700fe7ab
18362024-12-06T20:44:29.455ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3b3acf4c-a316-45ce-a055-ef8d6c8acdff (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18372024-12-06T20:44:29.455ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_3b3acf4c-a316-45ce-a055-ef8d6c8acdff
18382024-12-06T20:44:29.477ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3080 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64016 req_id = 7e73ab7f-ba77-4618-9820-9c1e4edeae5d response_code = 204 uri = /vpc-routes
18392024-12-06T20:44:29.479ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8e389ddd-65e9-4954-ab37-e305d4d4e112 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18402024-12-06T20:44:29.479ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_8e389ddd-65e9-4954-ab37-e305d4d4e112
18412024-12-06T20:44:29.484ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57309
18422024-12-06T20:44:29.489ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 687 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57309 req_id = baddcb7c-bd84-4d56-a057-36d9953cb9d4 response_code = 200 uri = /v2p
18432024-12-06T20:44:29.499ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5f5a9c7a-eec2-4e86-a02e-9238700fe7ab (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18442024-12-06T20:44:29.500ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_5f5a9c7a-eec2-4e86-a02e-9238700fe7ab
18452024-12-06T20:44:29.504ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:486 new_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 0 } old_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 0 } subnet = RouterId { vni: Vni(100), kind: System }
18462024-12-06T20:44:29.505ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4661 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36330 req_id = 8da422c0-ff4d-4f08-818a-71aec2fc6e96 response_code = 204 uri = /vpc-routes
18472024-12-06T20:44:29.516ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45504
18482024-12-06T20:44:29.516ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45504 req_id = a406ca0d-cbfd-412e-9439-11bf35645d75 response_code = 200 uri = /v2p
18492024-12-06T20:44:29.517ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f3f86fa8-b3a1-409b-95c8-f426058deed7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18502024-12-06T20:44:29.518ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_f3f86fa8-b3a1-409b-95c8-f426058deed7
18512024-12-06T20:44:29.546ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2f3ff39c-4b18-4b96-8fb8-fbd672d6202f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18522024-12-06T20:44:29.546ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_2f3ff39c-4b18-4b96-8fb8-fbd672d6202f
18532024-12-06T20:44:29.560ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8e389ddd-65e9-4954-ab37-e305d4d4e112 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18542024-12-06T20:44:29.560ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_8e389ddd-65e9-4954-ab37-e305d4d4e112
18552024-12-06T20:44:29.579ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 33ce0168-de47-475b-9a15-5a0cd6252cb6 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18562024-12-06T20:44:29.579ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_33ce0168-de47-475b-9a15-5a0cd6252cb6
18572024-12-06T20:44:29.596ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f3f86fa8-b3a1-409b-95c8-f426058deed7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18582024-12-06T20:44:29.596ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_f3f86fa8-b3a1-409b-95c8-f426058deed7
18592024-12-06T20:44:29.611ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 43474e0b-a6d6-4842-bf66-1060f52875b1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18602024-12-06T20:44:29.611ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_43474e0b-a6d6-4842-bf66-1060f52875b1
18612024-12-06T20:44:29.629ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 339951 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53884 req_id = a6cf9e9f-12fa-490c-9b0e-91c206ed4a43 response_code = 200 uri = /inventory
18622024-12-06T20:44:29.636ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2f3ff39c-4b18-4b96-8fb8-fbd672d6202f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18632024-12-06T20:44:29.636ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_2f3ff39c-4b18-4b96-8fb8-fbd672d6202f
18642024-12-06T20:44:29.660ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 33ce0168-de47-475b-9a15-5a0cd6252cb6 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18652024-12-06T20:44:29.660ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_33ce0168-de47-475b-9a15-5a0cd6252cb6
18662024-12-06T20:44:29.684ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 43474e0b-a6d6-4842-bf66-1060f52875b1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18672024-12-06T20:44:29.684ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_43474e0b-a6d6-4842-bf66-1060f52875b1
18682024-12-06T20:44:29.697ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 353338 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65280 req_id = 0e0e0e34-8760-4cf0-9757-a772470341be response_code = 200 uri = /inventory
18692024-12-06T20:44:30.199ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50528
18702024-12-06T20:44:30.199ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
18712024-12-06T20:44:30.199ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
18722024-12-06T20:44:30.199ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b9ab18cf-4dd7-46c3-920e-833f181cfe8b/config/omicron-zones.json file = common/src/ledger.rs:177
18732024-12-06T20:44:30.200ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/5a719d2c-fbf6-41ef-af9f-e6b70820ebd4/config/omicron-zones.json file = common/src/ledger.rs:177
18742024-12-06T20:44:30.221ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 50f60e54-9000-4b4d-8705-841b133128b0 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18752024-12-06T20:44:30.221ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_50f60e54-9000-4b4d-8705-841b133128b0
18762024-12-06T20:44:30.255ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 99dfd90b-ff92-45e8-a73e-ada9e3f552c8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18772024-12-06T20:44:30.255ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_99dfd90b-ff92-45e8-a73e-ada9e3f552c8
18782024-12-06T20:44:30.291ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3b3acf4c-a316-45ce-a055-ef8d6c8acdff (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18792024-12-06T20:44:30.291ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_3b3acf4c-a316-45ce-a055-ef8d6c8acdff
18802024-12-06T20:44:30.318ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35735
18812024-12-06T20:44:30.318ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35735 req_id = 1f7c159b-04c8-4313-b8cb-a457e7b11dc7 response_code = 200 uri = /vpc-routes
18822024-12-06T20:44:30.320ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5f5a9c7a-eec2-4e86-a02e-9238700fe7ab (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18832024-12-06T20:44:30.320ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_5f5a9c7a-eec2-4e86-a02e-9238700fe7ab
18842024-12-06T20:44:30.350ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8e389ddd-65e9-4954-ab37-e305d4d4e112 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18852024-12-06T20:44:30.350ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_8e389ddd-65e9-4954-ab37-e305d4d4e112
18862024-12-06T20:44:30.379ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f3f86fa8-b3a1-409b-95c8-f426058deed7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18872024-12-06T20:44:30.379ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_f3f86fa8-b3a1-409b-95c8-f426058deed7
18882024-12-06T20:44:30.409ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2f3ff39c-4b18-4b96-8fb8-fbd672d6202f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18892024-12-06T20:44:30.409ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_2f3ff39c-4b18-4b96-8fb8-fbd672d6202f
18902024-12-06T20:44:30.413ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 values = ExternalIpGatewayMap { mappings: {} }
18912024-12-06T20:44:30.413ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 639 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35735 req_id = abe58399-2b6e-40b0-9168-3fc3cccd094f response_code = 204 uri = /eip-gateways
18922024-12-06T20:44:30.435ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 33ce0168-de47-475b-9a15-5a0cd6252cb6 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18932024-12-06T20:44:30.435ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_33ce0168-de47-475b-9a15-5a0cd6252cb6
18942024-12-06T20:44:30.463ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 43474e0b-a6d6-4842-bf66-1060f52875b1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18952024-12-06T20:44:30.463ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_43474e0b-a6d6-4842-bf66-1060f52875b1
18962024-12-06T20:44:30.479ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 279880 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50528 req_id = ac96d036-4cba-4cdd-a912-2b2e8354924f response_code = 200 uri = /inventory
18972024-12-06T20:44:30.489ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35057
18982024-12-06T20:44:30.490ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 170 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35057 req_id = 50e3c200-84f2-4eaa-b63c-8e1b3710e43d response_code = 200 uri = /v2p
18992024-12-06T20:44:30.588ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35376
19002024-12-06T20:44:30.588ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
19012024-12-06T20:44:30.588ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
19022024-12-06T20:44:30.588ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b9ab18cf-4dd7-46c3-920e-833f181cfe8b/config/omicron-zones.json file = common/src/ledger.rs:177
19032024-12-06T20:44:30.589ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/5a719d2c-fbf6-41ef-af9f-e6b70820ebd4/config/omicron-zones.json file = common/src/ledger.rs:177
19042024-12-06T20:44:30.601ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 50f60e54-9000-4b4d-8705-841b133128b0 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19052024-12-06T20:44:30.601ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_50f60e54-9000-4b4d-8705-841b133128b0
19062024-12-06T20:44:30.626ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1090 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35735 req_id = 35f49814-e27f-410d-9e0a-62af78c0a39d response_code = 204 uri = /vpc-routes
19072024-12-06T20:44:30.630ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 99dfd90b-ff92-45e8-a73e-ada9e3f552c8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19082024-12-06T20:44:30.630ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_99dfd90b-ff92-45e8-a73e-ada9e3f552c8
19092024-12-06T20:44:30.658ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3b3acf4c-a316-45ce-a055-ef8d6c8acdff (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19102024-12-06T20:44:30.658ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_3b3acf4c-a316-45ce-a055-ef8d6c8acdff
19112024-12-06T20:44:30.685ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5f5a9c7a-eec2-4e86-a02e-9238700fe7ab (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19122024-12-06T20:44:30.685ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_5f5a9c7a-eec2-4e86-a02e-9238700fe7ab
19132024-12-06T20:44:30.711ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8e389ddd-65e9-4954-ab37-e305d4d4e112 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19142024-12-06T20:44:30.711ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_8e389ddd-65e9-4954-ab37-e305d4d4e112
19152024-12-06T20:44:30.736ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f3f86fa8-b3a1-409b-95c8-f426058deed7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19162024-12-06T20:44:30.736ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_f3f86fa8-b3a1-409b-95c8-f426058deed7
19172024-12-06T20:44:30.760ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2f3ff39c-4b18-4b96-8fb8-fbd672d6202f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19182024-12-06T20:44:30.760ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_2f3ff39c-4b18-4b96-8fb8-fbd672d6202f
19192024-12-06T20:44:30.787ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 33ce0168-de47-475b-9a15-5a0cd6252cb6 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19202024-12-06T20:44:30.787ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_33ce0168-de47-475b-9a15-5a0cd6252cb6
19212024-12-06T20:44:30.810ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 43474e0b-a6d6-4842-bf66-1060f52875b1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19222024-12-06T20:44:30.810ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_43474e0b-a6d6-4842-bf66-1060f52875b1
19232024-12-06T20:44:30.824ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 236697 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35376 req_id = 17ac13dc-6121-4bb6-a0d3-19690a6390cb response_code = 200 uri = /inventory
19242024-12-06T20:44:32.776ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51681
19252024-12-06T20:44:32.779ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 525aa886-e2b8-42b8-b1c9-cbf16e16e174, kind: Service { id: 59b92633-3550-4af1-b628-503b6bafd00d }, name: Name("external-dns-59b92633-3550-4af1-b628-503b6bafd00d"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 169])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7ff7e7d1-13cc-4538-9fce-dfd74792a288, kind: Service { id: 9d99eda0-389f-44c6-94ee-e9e7a03c9733 }, name: Name("external-dns-9d99eda0-389f-44c6-94ee-e9e7a03c9733"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 221, 96])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 176e274c-5ddd-4aa2-b53c-05e8fe632337, kind: Service { id: 3965e738-3305-4fcd-9da0-4c6e0ce7edc1 }, name: Name("nexus-3965e738-3305-4fcd-9da0-4c6e0ce7edc1"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 170, 95])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 75143dec-1fa4-42e5-a888-c77d19a4a83f, kind: Service { id: e9fe68b0-d53c-4161-a621-681677d5b0d6 }, name: Name("nexus-e9fe68b0-d53c-4161-a621-681677d5b0d6"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 243, 69])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9a966830-c35d-4c5c-bab6-585ffc135908, kind: Service { id: fd12fb4f-e62d-4cab-a4bd-2024f2546d3b }, name: Name("nexus-fd12fb4f-e62d-4cab-a4bd-2024f2546d3b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 247, 18])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
19262024-12-06T20:44:32.779ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19272024-12-06T20:44:32.779ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
19282024-12-06T20:44:32.779ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19292024-12-06T20:44:32.779ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19302024-12-06T20:44:32.779ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19312024-12-06T20:44:32.779ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19322024-12-06T20:44:32.779ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2484 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51681 req_id = 3a6716e3-387d-4e64-bdae-5c2e4dfa6897 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
19332024-12-06T20:44:32.780ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:1088
19342024-12-06T20:44:32.783ZINFOSledAgent (RSS): Writing ledger to /pool/int/b9ab18cf-4dd7-46c3-920e-833f181cfe8b/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
19352024-12-06T20:44:32.783ZINFOSledAgent (RSS): Writing ledger to /pool/int/5a719d2c-fbf6-41ef-af9f-e6b70820ebd4/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
19362024-12-06T20:44:33.130ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64225
19372024-12-06T20:44:33.130ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
19382024-12-06T20:44:33.130ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
19392024-12-06T20:44:33.130ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b9ab18cf-4dd7-46c3-920e-833f181cfe8b/config/omicron-zones.json file = common/src/ledger.rs:177
19402024-12-06T20:44:33.130ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/5a719d2c-fbf6-41ef-af9f-e6b70820ebd4/config/omicron-zones.json file = common/src/ledger.rs:177
19412024-12-06T20:44:33.143ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 50f60e54-9000-4b4d-8705-841b133128b0 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19422024-12-06T20:44:33.143ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_50f60e54-9000-4b4d-8705-841b133128b0
19432024-12-06T20:44:33.171ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 99dfd90b-ff92-45e8-a73e-ada9e3f552c8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19442024-12-06T20:44:33.171ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_99dfd90b-ff92-45e8-a73e-ada9e3f552c8
19452024-12-06T20:44:33.198ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3b3acf4c-a316-45ce-a055-ef8d6c8acdff (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19462024-12-06T20:44:33.198ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_3b3acf4c-a316-45ce-a055-ef8d6c8acdff
19472024-12-06T20:44:33.225ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5f5a9c7a-eec2-4e86-a02e-9238700fe7ab (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19482024-12-06T20:44:33.225ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_5f5a9c7a-eec2-4e86-a02e-9238700fe7ab
19492024-12-06T20:44:33.249ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8e389ddd-65e9-4954-ab37-e305d4d4e112 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19502024-12-06T20:44:33.249ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_8e389ddd-65e9-4954-ab37-e305d4d4e112
19512024-12-06T20:44:33.273ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f3f86fa8-b3a1-409b-95c8-f426058deed7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19522024-12-06T20:44:33.273ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_f3f86fa8-b3a1-409b-95c8-f426058deed7
19532024-12-06T20:44:33.296ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2f3ff39c-4b18-4b96-8fb8-fbd672d6202f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19542024-12-06T20:44:33.296ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_2f3ff39c-4b18-4b96-8fb8-fbd672d6202f
19552024-12-06T20:44:33.319ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 33ce0168-de47-475b-9a15-5a0cd6252cb6 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19562024-12-06T20:44:33.319ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_33ce0168-de47-475b-9a15-5a0cd6252cb6
19572024-12-06T20:44:33.343ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 43474e0b-a6d6-4842-bf66-1060f52875b1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19582024-12-06T20:44:33.343ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_43474e0b-a6d6-4842-bf66-1060f52875b1
19592024-12-06T20:44:33.358ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 228010 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64225 req_id = 1c1b9e34-99a2-4811-ad87-51391b30d717 response_code = 200 uri = /inventory
19602024-12-06T20:44:33.382ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41147
19612024-12-06T20:44:33.382ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 525aa886-e2b8-42b8-b1c9-cbf16e16e174, kind: Service { id: 59b92633-3550-4af1-b628-503b6bafd00d }, name: Name("external-dns-59b92633-3550-4af1-b628-503b6bafd00d"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 169])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7ff7e7d1-13cc-4538-9fce-dfd74792a288, kind: Service { id: 9d99eda0-389f-44c6-94ee-e9e7a03c9733 }, name: Name("external-dns-9d99eda0-389f-44c6-94ee-e9e7a03c9733"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 221, 96])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 176e274c-5ddd-4aa2-b53c-05e8fe632337, kind: Service { id: 3965e738-3305-4fcd-9da0-4c6e0ce7edc1 }, name: Name("nexus-3965e738-3305-4fcd-9da0-4c6e0ce7edc1"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 170, 95])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 75143dec-1fa4-42e5-a888-c77d19a4a83f, kind: Service { id: e9fe68b0-d53c-4161-a621-681677d5b0d6 }, name: Name("nexus-e9fe68b0-d53c-4161-a621-681677d5b0d6"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 243, 69])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9a966830-c35d-4c5c-bab6-585ffc135908, kind: Service { id: fd12fb4f-e62d-4cab-a4bd-2024f2546d3b }, name: Name("nexus-fd12fb4f-e62d-4cab-a4bd-2024f2546d3b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 247, 18])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
19622024-12-06T20:44:33.382ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19632024-12-06T20:44:33.382ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
19642024-12-06T20:44:33.382ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19652024-12-06T20:44:33.382ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19662024-12-06T20:44:33.382ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19672024-12-06T20:44:33.382ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19682024-12-06T20:44:33.382ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 234 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41147 req_id = 3509037b-52c4-422d-9131-7dca2e5e484b response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
19692024-12-06T20:44:33.683ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54558
19702024-12-06T20:44:33.683ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 525aa886-e2b8-42b8-b1c9-cbf16e16e174, kind: Service { id: 59b92633-3550-4af1-b628-503b6bafd00d }, name: Name("external-dns-59b92633-3550-4af1-b628-503b6bafd00d"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 169])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7ff7e7d1-13cc-4538-9fce-dfd74792a288, kind: Service { id: 9d99eda0-389f-44c6-94ee-e9e7a03c9733 }, name: Name("external-dns-9d99eda0-389f-44c6-94ee-e9e7a03c9733"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 221, 96])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 176e274c-5ddd-4aa2-b53c-05e8fe632337, kind: Service { id: 3965e738-3305-4fcd-9da0-4c6e0ce7edc1 }, name: Name("nexus-3965e738-3305-4fcd-9da0-4c6e0ce7edc1"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 170, 95])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 75143dec-1fa4-42e5-a888-c77d19a4a83f, kind: Service { id: e9fe68b0-d53c-4161-a621-681677d5b0d6 }, name: Name("nexus-e9fe68b0-d53c-4161-a621-681677d5b0d6"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 243, 69])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9a966830-c35d-4c5c-bab6-585ffc135908, kind: Service { id: fd12fb4f-e62d-4cab-a4bd-2024f2546d3b }, name: Name("nexus-fd12fb4f-e62d-4cab-a4bd-2024f2546d3b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 247, 18])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
19712024-12-06T20:44:33.683ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19722024-12-06T20:44:33.683ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
19732024-12-06T20:44:33.683ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19742024-12-06T20:44:33.683ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19752024-12-06T20:44:33.683ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19762024-12-06T20:44:33.683ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19772024-12-06T20:44:33.683ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 239 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54558 req_id = 0166d684-a821-44a3-8883-d4ae0212bcb1 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
19782024-12-06T20:44:34.169ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38246
19792024-12-06T20:44:34.170ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 525aa886-e2b8-42b8-b1c9-cbf16e16e174, kind: Service { id: 59b92633-3550-4af1-b628-503b6bafd00d }, name: Name("external-dns-59b92633-3550-4af1-b628-503b6bafd00d"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 169])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7ff7e7d1-13cc-4538-9fce-dfd74792a288, kind: Service { id: 9d99eda0-389f-44c6-94ee-e9e7a03c9733 }, name: Name("external-dns-9d99eda0-389f-44c6-94ee-e9e7a03c9733"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 221, 96])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 176e274c-5ddd-4aa2-b53c-05e8fe632337, kind: Service { id: 3965e738-3305-4fcd-9da0-4c6e0ce7edc1 }, name: Name("nexus-3965e738-3305-4fcd-9da0-4c6e0ce7edc1"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 170, 95])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 75143dec-1fa4-42e5-a888-c77d19a4a83f, kind: Service { id: e9fe68b0-d53c-4161-a621-681677d5b0d6 }, name: Name("nexus-e9fe68b0-d53c-4161-a621-681677d5b0d6"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 243, 69])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9a966830-c35d-4c5c-bab6-585ffc135908, kind: Service { id: fd12fb4f-e62d-4cab-a4bd-2024f2546d3b }, name: Name("nexus-fd12fb4f-e62d-4cab-a4bd-2024f2546d3b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 247, 18])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
19802024-12-06T20:44:34.170ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19812024-12-06T20:44:34.170ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
19822024-12-06T20:44:34.170ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19832024-12-06T20:44:34.170ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19842024-12-06T20:44:34.170ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19852024-12-06T20:44:34.170ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19862024-12-06T20:44:34.170ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 227 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38246 req_id = 8d3f2b81-a802-459f-876e-b1c72d4095b5 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
19872024-12-06T20:44:47.361ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54792
19882024-12-06T20:44:47.361ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54792 req_id = f38d8b94-5828-4800-867a-260c6f7dfff6 response_code = 200 uri = /vpc-routes
19892024-12-06T20:44:47.735ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 values = ExternalIpGatewayMap { mappings: {} }
19902024-12-06T20:44:47.735ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54792 req_id = 5904c525-06e1-410d-a92d-274e0a893f7d response_code = 204 uri = /eip-gateways
19912024-12-06T20:44:47.744ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 239 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54792 req_id = a611569a-b1e2-4546-89fd-71e7cac3dca4 response_code = 204 uri = /vpc-routes
19922024-12-06T20:44:50.257ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:59746
19932024-12-06T20:44:50.257ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:59746 req_id = 805cd472-9c4c-4c37-879f-aa385cc8ce28 response_code = 200 uri = /baseboard
19942024-12-06T20:44:59.015ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56640
19952024-12-06T20:44:59.015ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56640 req_id = 4d4decbc-6147-468f-b287-78b88662fe75 response_code = 200 uri = /vpc-routes
19962024-12-06T20:44:59.077ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 values = ExternalIpGatewayMap { mappings: {} }
19972024-12-06T20:44:59.077ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56640 req_id = faf385df-1a79-45c8-af75-022ef7702110 response_code = 204 uri = /eip-gateways
19982024-12-06T20:44:59.089ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 191 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56640 req_id = 8fe3a442-fe1e-4e64-92d4-2850cf27037f response_code = 204 uri = /vpc-routes
19992024-12-06T20:44:59.167ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41975
20002024-12-06T20:44:59.167ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 183 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41975 req_id = 0040e120-02c8-49fb-9f88-efdee8452bcb response_code = 200 uri = /v2p
20012024-12-06T20:44:59.170ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56239
20022024-12-06T20:44:59.170ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56239 req_id = 7d25a5db-b963-40da-a72c-7515b65a4f0f response_code = 200 uri = /vpc-routes
20032024-12-06T20:44:59.219ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 values = ExternalIpGatewayMap { mappings: {} }
20042024-12-06T20:44:59.219ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56239 req_id = db84c71c-691b-4fc7-8551-0deee934daac response_code = 204 uri = /eip-gateways
20052024-12-06T20:44:59.220ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63566
20062024-12-06T20:44:59.220ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63566 req_id = f1b94e96-82f4-417d-8254-145c0e550149 response_code = 200 uri = /v2p
20072024-12-06T20:44:59.228ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 160 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56239 req_id = 73d415bc-23d1-4364-9906-a2898e6200f3 response_code = 204 uri = /vpc-routes
20082024-12-06T20:44:59.379ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37917
20092024-12-06T20:44:59.381ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20102024-12-06T20:44:59.470ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20112024-12-06T20:44:59.534ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 154399 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:37917 req_id = 470176b0-cd59-40f2-83fe-84ae4766e09d response_code = 204 uri = /switch-ports
20122024-12-06T20:44:59.534ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63349
20132024-12-06T20:44:59.534ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20142024-12-06T20:44:59.542ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7882 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37917 req_id = d76b6af4-5608-4d81-a22e-adad8068d8e9 response_code = 200 uri = /network-bootstore-config
20152024-12-06T20:44:59.570ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20162024-12-06T20:44:59.634ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100032 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:63349 req_id = 483a5f58-0d79-4a8d-816a-ec763239da84 response_code = 204 uri = /switch-ports
20172024-12-06T20:44:59.635ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 160 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63349 req_id = 989a4359-86a5-4725-8032-eb426219e8d0 response_code = 200 uri = /network-bootstore-config
20182024-12-06T20:44:59.642ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
20192024-12-06T20:44:59.642ZINFOSledAgent (bootstore): Writing ledger to /pool/int/b9ab18cf-4dd7-46c3-920e-833f181cfe8b/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
20202024-12-06T20:44:59.644ZINFOSledAgent (bootstore): Writing ledger to /pool/int/5a719d2c-fbf6-41ef-af9f-e6b70820ebd4/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
20212024-12-06T20:44:59.645ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
20222024-12-06T20:44:59.645ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2961 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37917 req_id = ac77985a-5145-43ef-b320-5ac4126a1564 response_code = 204 uri = /network-bootstore-config
20232024-12-06T20:45:00.305ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60006
20242024-12-06T20:45:00.305ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60006 req_id = cba998b5-0403-4ed1-b007-f5567bf5fe89 response_code = 200 uri = /vpc-routes
20252024-12-06T20:45:00.352ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35563
20262024-12-06T20:45:00.353ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35563 req_id = 5de2692e-d9e4-4192-975e-acc481c2ad62 response_code = 200 uri = /v2p
20272024-12-06T20:45:00.393ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 values = ExternalIpGatewayMap { mappings: {} }
20282024-12-06T20:45:00.393ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60006 req_id = 64df37d3-bd95-4e8a-9022-68090d942fa8 response_code = 204 uri = /eip-gateways
20292024-12-06T20:45:00.407ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 205 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60006 req_id = 6f6d1948-5ba0-4fec-9b45-014e42fb03c9 response_code = 204 uri = /vpc-routes
20302024-12-06T20:45:00.453ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38967
20312024-12-06T20:45:00.453ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20322024-12-06T20:45:00.505ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20332024-12-06T20:45:00.596ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 142822 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:38967 req_id = 0e50efd0-c59d-4b28-ac43-7e37fe49b2b3 response_code = 204 uri = /switch-ports
20342024-12-06T20:45:00.597ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 710 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38967 req_id = 77971ae7-7f4f-4d05-8795-2812107bec86 response_code = 200 uri = /network-bootstore-config
20352024-12-06T20:45:20.294ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:35807
20362024-12-06T20:45:20.294ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:35807 req_id = 0b62ef1e-8b1e-4ac0-965f-e8cbc5fbfe1d response_code = 200 uri = /baseboard
20372024-12-06T20:45:27.445ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:45033 remote_addr = [fd00:1122:3344:101::d]:44003 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
20382024-12-06T20:45:27.465ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 19199 local_addr = [fd00:1122:3344:101::1]:45033 method = GET remote_addr = [fd00:1122:3344:101::d]:44003 req_id = ec274c43-ad35-4f7c-b656-9d6c0543c536 response_code = 200 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 uri = /0a667526-2006-419e-9b68-c251fd138c06
20392024-12-06T20:45:29.088ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49617
20402024-12-06T20:45:29.088ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49617 req_id = d3cec984-52a1-408d-a62b-848d6b2e0753 response_code = 200 uri = /vpc-routes
20412024-12-06T20:45:29.159ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 values = ExternalIpGatewayMap { mappings: {} }
20422024-12-06T20:45:29.159ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49617 req_id = 4e9f49e9-9066-4760-9395-cf7576aa57ad response_code = 204 uri = /eip-gateways
20432024-12-06T20:45:29.166ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46996
20442024-12-06T20:45:29.166ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46996 req_id = 06da8a72-9d37-4dc5-816c-8a4e0627e6f9 response_code = 200 uri = /vpc-routes
20452024-12-06T20:45:29.172ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 260 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49617 req_id = 2bd6e830-9625-4412-9d32-7ba78ffc0989 response_code = 204 uri = /vpc-routes
20462024-12-06T20:45:29.225ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 values = ExternalIpGatewayMap { mappings: {} }
20472024-12-06T20:45:29.225ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46996 req_id = ee821026-3981-4e13-9d59-adcf03419d02 response_code = 204 uri = /eip-gateways
20482024-12-06T20:45:29.236ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 167 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46996 req_id = 9b7e1a8b-0fa3-48e9-80bd-88a25d4dfb57 response_code = 204 uri = /vpc-routes
20492024-12-06T20:45:29.280ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33458
20502024-12-06T20:45:29.280ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33458 req_id = ed8d7f4f-8617-4fc6-9d0f-6a4bef050294 response_code = 200 uri = /v2p
20512024-12-06T20:45:29.363ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40591
20522024-12-06T20:45:29.363ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40591 req_id = df2fe8bf-ca41-4bf9-9941-232e3744a3bb response_code = 200 uri = /v2p
20532024-12-06T20:45:29.373ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57887
20542024-12-06T20:45:29.373ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20552024-12-06T20:45:29.412ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20562024-12-06T20:45:29.469ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96749 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:57887 req_id = cadef052-a49f-40fb-9575-9f7f29b0fab9 response_code = 204 uri = /switch-ports
20572024-12-06T20:45:29.469ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65031
20582024-12-06T20:45:29.470ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20592024-12-06T20:45:29.470ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 176 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57887 req_id = b7ff32e1-a993-4fbb-a2d2-022232691841 response_code = 200 uri = /network-bootstore-config
20602024-12-06T20:45:29.505ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20612024-12-06T20:45:29.560ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90139 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:65031 req_id = 3fed4490-6464-4fb5-8cb8-587be5848a0e response_code = 204 uri = /switch-ports
20622024-12-06T20:45:29.560ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65031 req_id = 6b48372b-19eb-49a2-9779-b49c306375f4 response_code = 200 uri = /network-bootstore-config
20632024-12-06T20:45:30.329ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59249
20642024-12-06T20:45:30.329ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59249 req_id = 17182990-e0e1-4a52-b613-b71a810db68b response_code = 200 uri = /vpc-routes
20652024-12-06T20:45:30.600ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53911
20662024-12-06T20:45:30.600ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53911 req_id = 86821c5f-f32c-4831-998c-cccba97b61c0 response_code = 200 uri = /v2p
20672024-12-06T20:45:30.646ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 values = ExternalIpGatewayMap { mappings: {} }
20682024-12-06T20:45:30.646ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59249 req_id = d0df307e-490f-4804-87b7-00093de92216 response_code = 204 uri = /eip-gateways
20692024-12-06T20:45:30.655ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 230 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59249 req_id = 94b89684-3611-4819-8d08-331bfd53770a response_code = 204 uri = /vpc-routes
20702024-12-06T20:45:30.695ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46577
20712024-12-06T20:45:30.695ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20722024-12-06T20:45:30.736ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20732024-12-06T20:45:30.793ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97975 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:46577 req_id = 5a24a75f-a0b8-46ab-a55e-a0c710240489 response_code = 204 uri = /switch-ports
20742024-12-06T20:45:30.793ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46577 req_id = a5a00a27-f5bd-4567-a838-56f95c422f7f response_code = 200 uri = /network-bootstore-config
20752024-12-06T20:45:33.565ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
20762024-12-06T20:45:50.327ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:56320
20772024-12-06T20:45:50.327ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:56320 req_id = a517a63f-7d39-4663-96cf-84bf03703179 response_code = 200 uri = /baseboard
20782024-12-06T20:45:57.420ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6786 local_addr = [fd00:1122:3344:101::1]:45033 method = GET remote_addr = [fd00:1122:3344:101::d]:44003 req_id = 25401e38-3d44-4a38-99bf-18a09229f5f6 response_code = 200 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 uri = /0a667526-2006-419e-9b68-c251fd138c06
20792024-12-06T20:45:59.052ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60260
20802024-12-06T20:45:59.052ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60260 req_id = f2d8ebd2-e8ad-4287-bd4b-8d100bafedfe response_code = 200 uri = /vpc-routes
20812024-12-06T20:45:59.077ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49178
20822024-12-06T20:45:59.078ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49178 req_id = 0e2bf736-93dd-42e2-9130-92bfdb8724d2 response_code = 200 uri = /vpc-routes
20832024-12-06T20:45:59.082ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 values = ExternalIpGatewayMap { mappings: {} }
20842024-12-06T20:45:59.082ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60260 req_id = 425f5d95-2916-4982-a3bc-5cdff0bf7cc4 response_code = 204 uri = /eip-gateways
20852024-12-06T20:45:59.096ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51603
20862024-12-06T20:45:59.096ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51603 req_id = a4ac86f7-ed62-4dee-bc2f-080f8b99091c response_code = 200 uri = /v2p
20872024-12-06T20:45:59.096ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 values = ExternalIpGatewayMap { mappings: {} }
20882024-12-06T20:45:59.096ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49178 req_id = d952dfa8-b322-468d-9392-a4feb3c1b0d4 response_code = 204 uri = /eip-gateways
20892024-12-06T20:45:59.101ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 235 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60260 req_id = 775b5839-d5f4-48f5-98da-980153342764 response_code = 204 uri = /vpc-routes
20902024-12-06T20:45:59.137ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57391
20912024-12-06T20:45:59.137ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57391 req_id = 92a8354f-0bb4-49d3-98d8-185106bad9ba response_code = 200 uri = /v2p
20922024-12-06T20:45:59.143ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49178 req_id = a99b1cb9-e496-4936-915d-44c6c3f59aa5 response_code = 204 uri = /vpc-routes
20932024-12-06T20:45:59.300ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46540
20942024-12-06T20:45:59.300ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20952024-12-06T20:45:59.340ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20962024-12-06T20:45:59.398ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97618 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:46540 req_id = c2ed55a8-712f-40eb-81e4-38426c56d333 response_code = 204 uri = /switch-ports
20972024-12-06T20:45:59.398ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52509
20982024-12-06T20:45:59.398ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20992024-12-06T20:45:59.398ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 268 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46540 req_id = 7ae5820b-bc28-483b-9330-12077c0c0e17 response_code = 200 uri = /network-bootstore-config
21002024-12-06T20:45:59.430ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21012024-12-06T20:45:59.484ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86344 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:52509 req_id = d6901eb1-4e07-4df7-abcd-34431f77ecb9 response_code = 204 uri = /switch-ports
21022024-12-06T20:45:59.485ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52509 req_id = 809ded60-aa47-40ce-b8b9-98b8a28d2f32 response_code = 200 uri = /network-bootstore-config
21032024-12-06T20:46:00.435ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51158
21042024-12-06T20:46:00.435ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51158 req_id = 5f9902ac-7809-48ea-9788-3b116559d3f1 response_code = 200 uri = /vpc-routes
21052024-12-06T20:46:00.469ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54838
21062024-12-06T20:46:00.469ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54838 req_id = 88ecafcc-ce20-461c-8091-827de5663805 response_code = 200 uri = /v2p
21072024-12-06T20:46:00.477ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 values = ExternalIpGatewayMap { mappings: {} }
21082024-12-06T20:46:00.477ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51158 req_id = 03e7baa7-b9bb-4137-9fab-f444bdf5511a response_code = 204 uri = /eip-gateways
21092024-12-06T20:46:00.486ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 215 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51158 req_id = 0efe0463-7c73-41f8-a162-304892f0a074 response_code = 204 uri = /vpc-routes
21102024-12-06T20:46:00.551ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62827
21112024-12-06T20:46:00.551ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21122024-12-06T20:46:00.584ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21132024-12-06T20:46:00.635ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84317 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:62827 req_id = d847cd39-a98a-4831-8c32-37dcd9d8859b response_code = 204 uri = /switch-ports
21142024-12-06T20:46:00.635ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62827 req_id = 06a9437f-8b50-4144-b8ce-c60d3c6bbee0 response_code = 200 uri = /network-bootstore-config
21152024-12-06T20:46:20.360ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:37152
21162024-12-06T20:46:20.360ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 30 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:37152 req_id = be4db3fa-7924-4281-9108-78e1760ec338 response_code = 200 uri = /baseboard
21172024-12-06T20:46:27.419ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6166 local_addr = [fd00:1122:3344:101::1]:45033 method = GET remote_addr = [fd00:1122:3344:101::d]:44003 req_id = 6bd42ce1-755d-4cb6-ac02-3bcbef6b93dd response_code = 200 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 uri = /0a667526-2006-419e-9b68-c251fd138c06
21182024-12-06T20:46:29.201ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49627
21192024-12-06T20:46:29.201ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49627 req_id = 032e9319-d89d-4862-a84d-733b9893fc86 response_code = 200 uri = /vpc-routes
21202024-12-06T20:46:29.213ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57504
21212024-12-06T20:46:29.213ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57504 req_id = 3fc45ccf-5fb4-4814-a527-141a45b83753 response_code = 200 uri = /vpc-routes
21222024-12-06T20:46:29.229ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 values = ExternalIpGatewayMap { mappings: {} }
21232024-12-06T20:46:29.229ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57504 req_id = 99a4ccc9-96a0-4e86-b6b0-8c3ee847d5da response_code = 204 uri = /eip-gateways
21242024-12-06T20:46:29.238ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 306 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57504 req_id = 643fe4e8-3ae5-4ea9-a6ac-e5d3908cbd41 response_code = 204 uri = /vpc-routes
21252024-12-06T20:46:29.252ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 values = ExternalIpGatewayMap { mappings: {} }
21262024-12-06T20:46:29.252ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49627 req_id = 630d8e1b-3135-4a29-a38c-6a7cab8699eb response_code = 204 uri = /eip-gateways
21272024-12-06T20:46:29.262ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 300 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49627 req_id = b7bc512e-f838-4091-a265-bd55c7db5ba9 response_code = 204 uri = /vpc-routes
21282024-12-06T20:46:29.397ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33531
21292024-12-06T20:46:29.397ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33531 req_id = 0a6f4e1d-f9e3-45d4-a347-84757c1d3e69 response_code = 200 uri = /v2p
21302024-12-06T20:46:29.448ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52360
21312024-12-06T20:46:29.448ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52360 req_id = fb34982e-0c13-4bbf-bb79-9feead81f03a response_code = 200 uri = /v2p
21322024-12-06T20:46:29.566ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37439
21332024-12-06T20:46:29.566ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21342024-12-06T20:46:29.604ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21352024-12-06T20:46:29.658ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91410 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:37439 req_id = de9794ef-e962-416e-a1e4-1025d42cb84f response_code = 204 uri = /switch-ports
21362024-12-06T20:46:29.658ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 208 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37439 req_id = 627d23dc-18a2-4de6-8e26-f70dcff84192 response_code = 200 uri = /network-bootstore-config
21372024-12-06T20:46:29.699ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45098
21382024-12-06T20:46:29.700ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21392024-12-06T20:46:29.739ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21402024-12-06T20:46:29.795ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95555 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:45098 req_id = 388ae6b4-ef2c-44d6-9573-d9b27fe091e4 response_code = 204 uri = /switch-ports
21412024-12-06T20:46:29.795ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45098 req_id = d894b09b-fa9a-47df-a313-2bac32cc136c response_code = 200 uri = /network-bootstore-config
21422024-12-06T20:46:30.537ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56149
21432024-12-06T20:46:30.538ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56149 req_id = a5b2d3d0-65ae-4b8e-8f81-81a3843873d8 response_code = 200 uri = /vpc-routes
21442024-12-06T20:46:30.553ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64472
21452024-12-06T20:46:30.553ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64472 req_id = ba60758f-d3eb-42e6-bdea-b1d367c53b2f response_code = 200 uri = /v2p
21462024-12-06T20:46:30.574ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 values = ExternalIpGatewayMap { mappings: {} }
21472024-12-06T20:46:30.574ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56149 req_id = 55f0beac-52f6-4bbe-8fce-0917dbb50ad9 response_code = 204 uri = /eip-gateways
21482024-12-06T20:46:30.588ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56149 req_id = 91329666-fb1a-41de-99c9-442faa282adb response_code = 204 uri = /vpc-routes
21492024-12-06T20:46:30.742ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45826
21502024-12-06T20:46:30.743ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21512024-12-06T20:46:30.779ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21522024-12-06T20:46:30.835ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92821 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:45826 req_id = 05356d12-797a-43d3-a022-4da6efc6dbdc response_code = 204 uri = /switch-ports
21532024-12-06T20:46:30.836ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45826 req_id = 04a62547-1e76-4723-b4e9-1b4248234c1f response_code = 200 uri = /network-bootstore-config
21542024-12-06T20:46:50.395ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:57772
21552024-12-06T20:46:50.395ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:57772 req_id = 954dca9e-3e21-4bb7-82bb-5effd6676171 response_code = 200 uri = /baseboard
21562024-12-06T20:46:57.419ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6536 local_addr = [fd00:1122:3344:101::1]:45033 method = GET remote_addr = [fd00:1122:3344:101::d]:44003 req_id = 43c9b9b0-dcf8-40e4-b730-c882ad762b9f response_code = 200 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 uri = /0a667526-2006-419e-9b68-c251fd138c06
21572024-12-06T20:46:59.048ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58689
21582024-12-06T20:46:59.048ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 160 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58689 req_id = 0234a680-eb52-45b8-b99a-01d4322c9ebb response_code = 200 uri = /v2p
21592024-12-06T20:46:59.104ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37673
21602024-12-06T20:46:59.105ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37673 req_id = 1711dca6-660b-4227-87b5-f98f30112288 response_code = 200 uri = /vpc-routes
21612024-12-06T20:46:59.121ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 values = ExternalIpGatewayMap { mappings: {} }
21622024-12-06T20:46:59.121ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37673 req_id = cfdd8271-0892-4793-bbfe-0fcd5e3f039f response_code = 204 uri = /eip-gateways
21632024-12-06T20:46:59.130ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 248 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37673 req_id = 7b72aa5f-5684-48c3-98f3-60250f63711b response_code = 204 uri = /vpc-routes
21642024-12-06T20:46:59.218ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63509
21652024-12-06T20:46:59.218ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63509 req_id = 98566f73-1d0c-41c9-b13b-c62ba287a74d response_code = 200 uri = /vpc-routes
21662024-12-06T20:46:59.221ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50986
21672024-12-06T20:46:59.221ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21682024-12-06T20:46:59.263ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21692024-12-06T20:46:59.324ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102975 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:50986 req_id = 04ba7706-c58b-4659-b65e-fef49211c377 response_code = 204 uri = /switch-ports
21702024-12-06T20:46:59.325ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 values = ExternalIpGatewayMap { mappings: {} }
21712024-12-06T20:46:59.325ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63518
21722024-12-06T20:46:59.325ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63509 req_id = a7b2e958-a556-4097-aa28-b19f0e5731af response_code = 204 uri = /eip-gateways
21732024-12-06T20:46:59.325ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55617
21742024-12-06T20:46:59.325ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 259 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50986 req_id = c54b26ec-f148-4f82-a455-8bcafc0284f6 response_code = 200 uri = /network-bootstore-config
21752024-12-06T20:46:59.325ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21762024-12-06T20:46:59.328ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3585 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55617 req_id = f5710f67-2993-4fc0-a1c6-c7f80b13f579 response_code = 200 uri = /v2p
21772024-12-06T20:46:59.336ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 303 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63509 req_id = ed8e14b9-cc7a-4ae4-a076-47f9496f12d6 response_code = 204 uri = /vpc-routes
21782024-12-06T20:46:59.359ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21792024-12-06T20:46:59.412ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87289 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:63518 req_id = ab979a62-3d18-4ec0-a4a8-780e626b0a43 response_code = 204 uri = /switch-ports
21802024-12-06T20:46:59.412ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63518 req_id = 99219634-1cc7-4c19-bc5b-302bfb8a693e response_code = 200 uri = /network-bootstore-config
21812024-12-06T20:47:00.365ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54601
21822024-12-06T20:47:00.365ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54601 req_id = c91606a2-b402-4d42-9770-226c51ed77a3 response_code = 200 uri = /v2p
21832024-12-06T20:47:00.382ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59558
21842024-12-06T20:47:00.382ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59558 req_id = e85ef6e6-75b3-45a7-9738-f11be5efeaab response_code = 200 uri = /vpc-routes
21852024-12-06T20:47:00.414ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36139
21862024-12-06T20:47:00.414ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21872024-12-06T20:47:00.453ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21882024-12-06T20:47:00.508ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93795 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:36139 req_id = 85bc10b7-2152-4d96-8b62-38555c204bde response_code = 204 uri = /switch-ports
21892024-12-06T20:47:00.508ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 values = ExternalIpGatewayMap { mappings: {} }
21902024-12-06T20:47:00.508ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 186 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59558 req_id = b360dd30-17fa-4864-a4e8-52f4f7d294fc response_code = 204 uri = /eip-gateways
21912024-12-06T20:47:00.508ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 247 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36139 req_id = a9c2abf6-ee7f-4efd-9d5d-54aad19390bb response_code = 200 uri = /network-bootstore-config
21922024-12-06T20:47:00.521ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 362 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59558 req_id = 4c204e52-ffc6-4200-9e4f-5048776e9992 response_code = 204 uri = /vpc-routes
21932024-12-06T20:47:20.427ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:57403
21942024-12-06T20:47:20.427ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 29 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:57403 req_id = 98882168-c75f-432f-9e09-2309e3fcb0ed response_code = 200 uri = /baseboard
21952024-12-06T20:47:27.419ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6561 local_addr = [fd00:1122:3344:101::1]:45033 method = GET remote_addr = [fd00:1122:3344:101::d]:44003 req_id = c898ec96-5d49-4708-918d-6c294b0474e4 response_code = 200 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 uri = /0a667526-2006-419e-9b68-c251fd138c06
21962024-12-06T20:47:29.189ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54737
21972024-12-06T20:47:29.189ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54737 req_id = a53514b4-a848-4788-aa31-b49e467f738f response_code = 200 uri = /vpc-routes
21982024-12-06T20:47:29.203ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 values = ExternalIpGatewayMap { mappings: {} }
21992024-12-06T20:47:29.203ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54737 req_id = e501b847-3689-43bc-bdb1-abb7ac6f924b response_code = 204 uri = /eip-gateways
22002024-12-06T20:47:29.213ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54737 req_id = eb327136-5de2-4596-9a7f-0bce5aba456b response_code = 204 uri = /vpc-routes
22012024-12-06T20:47:29.295ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59128
22022024-12-06T20:47:29.295ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59128 req_id = 037eb107-e206-4c60-8b3f-fb8f7288f265 response_code = 200 uri = /v2p
22032024-12-06T20:47:29.335ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38612
22042024-12-06T20:47:29.335ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 22 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38612 req_id = a80b18ac-5a70-487d-8f29-480c28ff9f3e response_code = 200 uri = /vpc-routes
22052024-12-06T20:47:29.387ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 values = ExternalIpGatewayMap { mappings: {} }
22062024-12-06T20:47:29.387ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38612 req_id = 72018575-2cec-48c5-83f4-036e1dd49958 response_code = 204 uri = /eip-gateways
22072024-12-06T20:47:29.399ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 245 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38612 req_id = 90331ea7-534b-411d-aca3-76b1dc0cc6b2 response_code = 204 uri = /vpc-routes
22082024-12-06T20:47:29.411ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59598
22092024-12-06T20:47:29.411ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22102024-12-06T20:47:29.451ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22112024-12-06T20:47:29.509ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97843 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:59598 req_id = 620d5848-02b3-468b-8361-3219071fff25 response_code = 204 uri = /switch-ports
22122024-12-06T20:47:29.510ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59598 req_id = 6d64e2ca-f153-4b4d-948e-351ca2ca0c01 response_code = 200 uri = /network-bootstore-config
22132024-12-06T20:47:29.550ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34003
22142024-12-06T20:47:29.550ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22152024-12-06T20:47:29.587ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22162024-12-06T20:47:29.644ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93995 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:34003 req_id = dca94efc-f528-4977-9bce-387476f0f20e response_code = 204 uri = /switch-ports
22172024-12-06T20:47:29.644ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34003 req_id = 89890f98-d3a2-4300-843f-c9b19e7c07bc response_code = 200 uri = /network-bootstore-config
22182024-12-06T20:47:29.677ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55727
22192024-12-06T20:47:29.678ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55727 req_id = 5fb61476-0d18-49eb-a944-2fad1da95e35 response_code = 200 uri = /v2p
22202024-12-06T20:47:30.311ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58067
22212024-12-06T20:47:30.311ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58067 req_id = 4edc5530-4bd0-49f2-920e-32b9cd2224b0 response_code = 200 uri = /vpc-routes
22222024-12-06T20:47:30.367ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 values = ExternalIpGatewayMap { mappings: {} }
22232024-12-06T20:47:30.367ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58067 req_id = c37c2581-33fb-494f-9083-ee7305457918 response_code = 204 uri = /eip-gateways
22242024-12-06T20:47:30.378ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 392 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58067 req_id = 905ed877-2671-40d9-855e-44107a0c65fb response_code = 204 uri = /vpc-routes
22252024-12-06T20:47:30.654ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36252
22262024-12-06T20:47:30.654ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36252 req_id = 0af20cb1-2df7-4480-adcd-5f0ca3d59de7 response_code = 200 uri = /v2p
22272024-12-06T20:47:30.680ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36756
22282024-12-06T20:47:30.680ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22292024-12-06T20:47:30.717ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22302024-12-06T20:47:30.774ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93463 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:36756 req_id = b4ee99b4-c4c2-4c27-ae67-458ec9710234 response_code = 204 uri = /switch-ports
22312024-12-06T20:47:30.774ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36756 req_id = bf48c3ba-a3d0-40ca-a1cd-b83347f86f0a response_code = 200 uri = /network-bootstore-config
22322024-12-06T20:47:50.460ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:47268
22332024-12-06T20:47:50.460ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:47268 req_id = f25469d5-2602-41d7-a8f1-80d981670f8d response_code = 200 uri = /baseboard
22342024-12-06T20:47:57.419ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7419 local_addr = [fd00:1122:3344:101::1]:45033 method = GET remote_addr = [fd00:1122:3344:101::d]:44003 req_id = a40e2c2c-40bb-4172-9081-0218b6f1bafc response_code = 200 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 uri = /0a667526-2006-419e-9b68-c251fd138c06
22352024-12-06T20:47:59.031ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43692
22362024-12-06T20:47:59.032ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43692 req_id = e7f1439e-e781-4d34-8d70-03e36551245f response_code = 200 uri = /vpc-routes
22372024-12-06T20:47:59.053ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 values = ExternalIpGatewayMap { mappings: {} }
22382024-12-06T20:47:59.053ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43692 req_id = f65f22ca-3dd7-4e9f-b122-a1ca1b36ef38 response_code = 204 uri = /eip-gateways
22392024-12-06T20:47:59.062ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43692 req_id = 85f450e4-0ee2-41bc-afed-0803e8b0ce37 response_code = 204 uri = /vpc-routes
22402024-12-06T20:47:59.193ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62778
22412024-12-06T20:47:59.193ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62778 req_id = d1dd6a05-75d7-4acf-8d37-313115021624 response_code = 200 uri = /v2p
22422024-12-06T20:47:59.238ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44463
22432024-12-06T20:47:59.239ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44463 req_id = 2e4536b0-82fc-49a9-a09c-ffbceba3f0a6 response_code = 200 uri = /v2p
22442024-12-06T20:47:59.267ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47617
22452024-12-06T20:47:59.267ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 20 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47617 req_id = 6a0efa5e-b623-46a6-8a69-8074c68c338f response_code = 200 uri = /vpc-routes
22462024-12-06T20:47:59.307ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 values = ExternalIpGatewayMap { mappings: {} }
22472024-12-06T20:47:59.307ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47617 req_id = 75463d3b-2f7b-48d0-a9a7-bf8ea39b117e response_code = 204 uri = /eip-gateways
22482024-12-06T20:47:59.316ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 221 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47617 req_id = 705c07c9-e3c4-4e80-aaec-6d4ce0623008 response_code = 204 uri = /vpc-routes
22492024-12-06T20:47:59.362ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58569
22502024-12-06T20:47:59.362ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22512024-12-06T20:47:59.402ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22522024-12-06T20:47:59.463ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100314 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:58569 req_id = 7df03899-6a18-4111-8334-0e9e97ff1f60 response_code = 204 uri = /switch-ports
22532024-12-06T20:47:59.463ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45087
22542024-12-06T20:47:59.463ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22552024-12-06T20:47:59.463ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 230 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58569 req_id = 8132f91d-cc8f-4a7a-9828-50361196554b response_code = 200 uri = /network-bootstore-config
22562024-12-06T20:47:59.499ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22572024-12-06T20:47:59.553ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90525 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:45087 req_id = 68ca0c16-b3fc-451c-8098-94c980d03ad2 response_code = 204 uri = /switch-ports
22582024-12-06T20:47:59.554ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45087 req_id = d00d0af0-6d96-44fb-aa8d-e3508bf1d7b5 response_code = 200 uri = /network-bootstore-config
22592024-12-06T20:48:00.364ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33620
22602024-12-06T20:48:00.364ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33620 req_id = 3fc8bfb3-f50d-4b9e-8601-b39b437418f5 response_code = 200 uri = /vpc-routes
22612024-12-06T20:48:00.381ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 values = ExternalIpGatewayMap { mappings: {} }
22622024-12-06T20:48:00.381ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33620 req_id = f2898c49-78e4-46d3-bc63-9c2960c03b01 response_code = 204 uri = /eip-gateways
22632024-12-06T20:48:00.390ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33620 req_id = b83ec312-55eb-462b-bef6-61eae189e625 response_code = 204 uri = /vpc-routes
22642024-12-06T20:48:00.435ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62327
22652024-12-06T20:48:00.435ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22662024-12-06T20:48:00.475ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22672024-12-06T20:48:00.530ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94592 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:62327 req_id = 5e1181e0-49ca-44ae-85c0-2d2afe55030c response_code = 204 uri = /switch-ports
22682024-12-06T20:48:00.530ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60983
22692024-12-06T20:48:00.530ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62327 req_id = e5b3feb7-07f7-40ab-afee-bcf20e678c21 response_code = 200 uri = /network-bootstore-config
22702024-12-06T20:48:00.530ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 173 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60983 req_id = a82f4464-bc8b-4de4-87c6-08d7605ad7f1 response_code = 200 uri = /v2p
22712024-12-06T20:48:20.495ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:62880
22722024-12-06T20:48:20.496ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:62880 req_id = b2145da1-067b-4994-93ac-84746f105edf response_code = 200 uri = /baseboard
22732024-12-06T20:48:27.418ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6141 local_addr = [fd00:1122:3344:101::1]:45033 method = GET remote_addr = [fd00:1122:3344:101::d]:44003 req_id = eca723ec-242b-40a2-9dc4-caa382dd344c response_code = 200 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 uri = /0a667526-2006-419e-9b68-c251fd138c06
22742024-12-06T20:48:29.173ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60616
22752024-12-06T20:48:29.173ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60616 req_id = dcda52c0-272b-4559-bcf1-8308db56ad4b response_code = 200 uri = /vpc-routes
22762024-12-06T20:48:29.226ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 values = ExternalIpGatewayMap { mappings: {} }
22772024-12-06T20:48:29.226ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60616 req_id = d3da79bd-0556-4e9b-8096-04c1952551cf response_code = 204 uri = /eip-gateways
22782024-12-06T20:48:29.236ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 180 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60616 req_id = b74fadd7-c6c7-4345-ad6f-cb7e14904cfe response_code = 204 uri = /vpc-routes
22792024-12-06T20:48:29.268ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50619
22802024-12-06T20:48:29.268ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50619 req_id = 57f14098-12ff-4fd2-8924-3b1bfb302783 response_code = 200 uri = /vpc-routes
22812024-12-06T20:48:29.343ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44015
22822024-12-06T20:48:29.343ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22832024-12-06T20:48:29.381ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22842024-12-06T20:48:29.437ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93992 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:44015 req_id = 42a76abe-205e-414b-9910-221586711371 response_code = 204 uri = /switch-ports
22852024-12-06T20:48:29.437ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62545
22862024-12-06T20:48:29.437ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44256
22872024-12-06T20:48:29.437ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 255 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44256 req_id = 51ea0467-440a-4010-a9f7-f03a9b7097e9 response_code = 200 uri = /v2p
22882024-12-06T20:48:29.437ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 250 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44015 req_id = 1dec0b70-9373-4218-af5e-a7dd940115ed response_code = 200 uri = /network-bootstore-config
22892024-12-06T20:48:29.437ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 242 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62545 req_id = c82c0808-09e6-4f72-bd41-4fbfe844eb40 response_code = 200 uri = /v2p
22902024-12-06T20:48:29.454ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42626
22912024-12-06T20:48:29.454ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22922024-12-06T20:48:29.493ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22932024-12-06T20:48:29.551ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96876 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:42626 req_id = 5a855717-04bb-41fe-ac5c-1c08874692cf response_code = 204 uri = /switch-ports
22942024-12-06T20:48:29.551ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 values = ExternalIpGatewayMap { mappings: {} }
22952024-12-06T20:48:29.551ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50619 req_id = e8384498-6092-429f-896f-9ab4038a7397 response_code = 204 uri = /eip-gateways
22962024-12-06T20:48:29.551ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 197 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42626 req_id = 50ab273c-7428-4bc9-b484-2d7a3e676d72 response_code = 200 uri = /network-bootstore-config
22972024-12-06T20:48:29.562ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 358 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50619 req_id = 289524a1-d057-4da8-9a32-765023653851 response_code = 204 uri = /vpc-routes
22982024-12-06T20:48:30.283ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56478
22992024-12-06T20:48:30.284ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56478 req_id = 6574dea2-a052-41aa-8304-df3cb1ef22d0 response_code = 200 uri = /vpc-routes
23002024-12-06T20:48:30.328ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 values = ExternalIpGatewayMap { mappings: {} }
23012024-12-06T20:48:30.328ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56478 req_id = 4a415b7e-0d54-45c3-b0b7-61667976ad2c response_code = 204 uri = /eip-gateways
23022024-12-06T20:48:30.338ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 243 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56478 req_id = 19db9c0e-4bc6-4afd-95d5-f2cae74b1e71 response_code = 204 uri = /vpc-routes
23032024-12-06T20:48:30.397ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47755
23042024-12-06T20:48:30.397ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47755 req_id = b85db4f8-5b14-4834-9abd-0c155776fa53 response_code = 200 uri = /v2p
23052024-12-06T20:48:30.550ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42147
23062024-12-06T20:48:30.550ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23072024-12-06T20:48:30.585ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23082024-12-06T20:48:30.640ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90497 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:42147 req_id = b430319b-dbc1-4367-ab0e-03a69b2edd7c response_code = 204 uri = /switch-ports
23092024-12-06T20:48:30.640ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42147 req_id = 319c43e7-aa08-4be8-9b7e-f3d166377ae6 response_code = 200 uri = /network-bootstore-config
23102024-12-06T20:48:50.528ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:37717
23112024-12-06T20:48:50.528ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:37717 req_id = 559bee73-543f-4218-bd98-fad1a4b0edd8 response_code = 200 uri = /baseboard
23122024-12-06T20:48:57.417ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6152 local_addr = [fd00:1122:3344:101::1]:45033 method = GET remote_addr = [fd00:1122:3344:101::d]:44003 req_id = 41dd0a2a-68ca-4da3-98ce-e22a067a8093 response_code = 200 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 uri = /0a667526-2006-419e-9b68-c251fd138c06
23132024-12-06T20:48:59.053ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46752
23142024-12-06T20:48:59.053ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46752 req_id = 97b3cc7e-05c9-481f-8aa2-e3832d91edd9 response_code = 200 uri = /vpc-routes
23152024-12-06T20:48:59.073ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 values = ExternalIpGatewayMap { mappings: {} }
23162024-12-06T20:48:59.073ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46752 req_id = 4d586f55-f8be-4eee-aad6-82f94a184cd0 response_code = 204 uri = /eip-gateways
23172024-12-06T20:48:59.082ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 236 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46752 req_id = ac4f369e-d230-4b17-b520-55f614e6a752 response_code = 204 uri = /vpc-routes
23182024-12-06T20:48:59.095ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44484
23192024-12-06T20:48:59.095ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 29 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44484 req_id = b23eca6c-0aa4-40d2-8d79-a9ab7e902945 response_code = 200 uri = /vpc-routes
23202024-12-06T20:48:59.142ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 values = ExternalIpGatewayMap { mappings: {} }
23212024-12-06T20:48:59.142ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44484 req_id = 7fe2fa74-fe6c-4fcf-aa57-6af5edd21acb response_code = 204 uri = /eip-gateways
23222024-12-06T20:48:59.151ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33464
23232024-12-06T20:48:59.151ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23242024-12-06T20:48:59.188ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23252024-12-06T20:48:59.239ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87875 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:33464 req_id = 67a95353-c129-419e-9307-10ed06675aa7 response_code = 204 uri = /switch-ports
23262024-12-06T20:48:59.240ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62291
23272024-12-06T20:48:59.240ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38544
23282024-12-06T20:48:59.240ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 297 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33464 req_id = 200bfa80-263f-41ee-82c5-b896c339edda response_code = 200 uri = /network-bootstore-config
23292024-12-06T20:48:59.240ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 266 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62291 req_id = cd951792-525c-46b1-b396-05e8e16c20e1 response_code = 200 uri = /v2p
23302024-12-06T20:48:59.240ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 536 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44484 req_id = 30e48a16-314b-4301-ba87-f4843648755c response_code = 204 uri = /vpc-routes
23312024-12-06T20:48:59.240ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 306 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38544 req_id = cd762ab5-c1aa-48d8-97b6-4a2af631a61b response_code = 200 uri = /v2p
23322024-12-06T20:48:59.246ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49249
23332024-12-06T20:48:59.246ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23342024-12-06T20:48:59.282ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23352024-12-06T20:48:59.336ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90071 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:49249 req_id = 7fda3352-a88e-4d21-8218-d25cb76b2965 response_code = 204 uri = /switch-ports
23362024-12-06T20:48:59.336ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49249 req_id = 79f71f11-802f-4b0d-ba31-a96c6499343e response_code = 200 uri = /network-bootstore-config
23372024-12-06T20:49:00.321ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43622
23382024-12-06T20:49:00.321ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43622 req_id = 4ce72a62-96aa-4e3b-b7c8-f3a6a35a42e8 response_code = 200 uri = /vpc-routes
23392024-12-06T20:49:00.365ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 values = ExternalIpGatewayMap { mappings: {} }
23402024-12-06T20:49:00.365ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43622 req_id = c756b5cc-1e19-45d4-a913-b4eb222f4d3a response_code = 204 uri = /eip-gateways
23412024-12-06T20:49:00.409ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52506
23422024-12-06T20:49:00.409ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52506 req_id = f27678bf-226b-4dac-b080-0945236bdb22 response_code = 200 uri = /v2p
23432024-12-06T20:49:00.412ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 192 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43622 req_id = ee732359-4b94-487a-9f5f-7ebf24ac2324 response_code = 204 uri = /vpc-routes
23442024-12-06T20:49:00.448ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63440
23452024-12-06T20:49:00.448ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23462024-12-06T20:49:00.485ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23472024-12-06T20:49:00.540ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91886 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:63440 req_id = a7303f2a-a22c-47f2-ab14-b1219f78cfe6 response_code = 204 uri = /switch-ports
23482024-12-06T20:49:00.540ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63440 req_id = 5461f9b9-240c-4e82-8b58-fbc93a8e99eb response_code = 200 uri = /network-bootstore-config
23492024-12-06T20:49:20.562ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:37404
23502024-12-06T20:49:20.562ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:37404 req_id = 22cbdf1e-05a0-43e5-85f1-d93430348e03 response_code = 200 uri = /baseboard
23512024-12-06T20:49:27.418ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5988 local_addr = [fd00:1122:3344:101::1]:45033 method = GET remote_addr = [fd00:1122:3344:101::d]:44003 req_id = 7c628cda-747a-4c19-b747-0acebdfacb2c response_code = 200 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 uri = /0a667526-2006-419e-9b68-c251fd138c06
23522024-12-06T20:49:29.277ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51757
23532024-12-06T20:49:29.277ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51757 req_id = fe08d78d-d46b-4353-830f-e92bf3f293eb response_code = 200 uri = /vpc-routes
23542024-12-06T20:49:29.319ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 values = ExternalIpGatewayMap { mappings: {} }
23552024-12-06T20:49:29.319ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51757 req_id = 90b96a49-8479-43ee-ade3-66b19295a675 response_code = 204 uri = /eip-gateways
23562024-12-06T20:49:29.326ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62602
23572024-12-06T20:49:29.326ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 23 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62602 req_id = 76a52a3b-9402-4871-874f-cc130aab3fe5 response_code = 200 uri = /vpc-routes
23582024-12-06T20:49:29.376ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61830
23592024-12-06T20:49:29.376ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61830 req_id = 710f9719-4590-45b0-8d91-cce92743b2f1 response_code = 200 uri = /v2p
23602024-12-06T20:49:29.378ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 values = ExternalIpGatewayMap { mappings: {} }
23612024-12-06T20:49:29.378ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 30 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62602 req_id = 1a0291db-7546-4fa4-adc3-ea1743f5b369 response_code = 204 uri = /eip-gateways
23622024-12-06T20:49:29.384ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37103
23632024-12-06T20:49:29.384ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37103 req_id = 0458a3cd-6876-4225-b8cf-a8493edd8472 response_code = 200 uri = /v2p
23642024-12-06T20:49:29.386ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 249 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62602 req_id = afeec47d-d1fb-4c94-91bb-1f669ceb2ed3 response_code = 204 uri = /vpc-routes
23652024-12-06T20:49:29.392ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53757
23662024-12-06T20:49:29.392ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23672024-12-06T20:49:29.432ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23682024-12-06T20:49:29.499ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106389 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:53757 req_id = f9c5ba49-acae-4674-92ac-7fb9005cc0fb response_code = 204 uri = /switch-ports
23692024-12-06T20:49:29.499ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41908
23702024-12-06T20:49:29.499ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23712024-12-06T20:49:29.499ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 176 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53757 req_id = c0f9cd36-6de8-48ff-88d6-ba3893132429 response_code = 200 uri = /network-bootstore-config
23722024-12-06T20:49:29.503ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4039 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51757 req_id = 873d0ba0-748a-45ac-8cf8-e98a9903fbf9 response_code = 204 uri = /vpc-routes
23732024-12-06T20:49:29.531ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23742024-12-06T20:49:29.546ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54913
23752024-12-06T20:49:29.546ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 525aa886-e2b8-42b8-b1c9-cbf16e16e174, kind: Service { id: 59b92633-3550-4af1-b628-503b6bafd00d }, name: Name("external-dns-59b92633-3550-4af1-b628-503b6bafd00d"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 169])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7ff7e7d1-13cc-4538-9fce-dfd74792a288, kind: Service { id: 9d99eda0-389f-44c6-94ee-e9e7a03c9733 }, name: Name("external-dns-9d99eda0-389f-44c6-94ee-e9e7a03c9733"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 221, 96])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 176e274c-5ddd-4aa2-b53c-05e8fe632337, kind: Service { id: 3965e738-3305-4fcd-9da0-4c6e0ce7edc1 }, name: Name("nexus-3965e738-3305-4fcd-9da0-4c6e0ce7edc1"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 170, 95])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 75143dec-1fa4-42e5-a888-c77d19a4a83f, kind: Service { id: e9fe68b0-d53c-4161-a621-681677d5b0d6 }, name: Name("nexus-e9fe68b0-d53c-4161-a621-681677d5b0d6"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 243, 69])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9a966830-c35d-4c5c-bab6-585ffc135908, kind: Service { id: fd12fb4f-e62d-4cab-a4bd-2024f2546d3b }, name: Name("nexus-fd12fb4f-e62d-4cab-a4bd-2024f2546d3b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 247, 18])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
23762024-12-06T20:49:29.546ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23772024-12-06T20:49:29.546ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
23782024-12-06T20:49:29.546ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23792024-12-06T20:49:29.546ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23802024-12-06T20:49:29.547ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23812024-12-06T20:49:29.547ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23822024-12-06T20:49:29.547ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 703 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54913 req_id = 707aeff6-a7ff-4e20-91b7-1d8afb1dc2f6 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
23832024-12-06T20:49:29.583ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83922 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:41908 req_id = 808f27db-7992-4ab3-9f8c-aaf1e6cc3993 response_code = 204 uri = /switch-ports
23842024-12-06T20:49:29.583ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41908 req_id = e6074479-8052-41cc-8759-995cbdae5d65 response_code = 200 uri = /network-bootstore-config
23852024-12-06T20:49:29.635ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54625
23862024-12-06T20:49:29.635ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 525aa886-e2b8-42b8-b1c9-cbf16e16e174, kind: Service { id: 59b92633-3550-4af1-b628-503b6bafd00d }, name: Name("external-dns-59b92633-3550-4af1-b628-503b6bafd00d"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 169])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7ff7e7d1-13cc-4538-9fce-dfd74792a288, kind: Service { id: 9d99eda0-389f-44c6-94ee-e9e7a03c9733 }, name: Name("external-dns-9d99eda0-389f-44c6-94ee-e9e7a03c9733"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 221, 96])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 176e274c-5ddd-4aa2-b53c-05e8fe632337, kind: Service { id: 3965e738-3305-4fcd-9da0-4c6e0ce7edc1 }, name: Name("nexus-3965e738-3305-4fcd-9da0-4c6e0ce7edc1"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 170, 95])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 75143dec-1fa4-42e5-a888-c77d19a4a83f, kind: Service { id: e9fe68b0-d53c-4161-a621-681677d5b0d6 }, name: Name("nexus-e9fe68b0-d53c-4161-a621-681677d5b0d6"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 243, 69])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9a966830-c35d-4c5c-bab6-585ffc135908, kind: Service { id: fd12fb4f-e62d-4cab-a4bd-2024f2546d3b }, name: Name("nexus-fd12fb4f-e62d-4cab-a4bd-2024f2546d3b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 247, 18])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
23872024-12-06T20:49:29.635ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23882024-12-06T20:49:29.635ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
23892024-12-06T20:49:29.635ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23902024-12-06T20:49:29.635ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23912024-12-06T20:49:29.635ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23922024-12-06T20:49:29.635ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23932024-12-06T20:49:29.635ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 400 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54625 req_id = db24394d-0d78-4e35-b082-8453fea5da3b response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
23942024-12-06T20:49:30.413ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39949
23952024-12-06T20:49:30.414ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39949 req_id = 67b9e971-b45b-4be6-b544-eee74a8402b2 response_code = 200 uri = /vpc-routes
23962024-12-06T20:49:30.459ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 values = ExternalIpGatewayMap { mappings: {} }
23972024-12-06T20:49:30.459ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39949 req_id = bbee9a74-f859-4217-8db4-98aea3c72f6a response_code = 204 uri = /eip-gateways
23982024-12-06T20:49:30.469ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 204 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39949 req_id = aeb09eb8-66f6-4de1-86f9-fd0d744af767 response_code = 204 uri = /vpc-routes
23992024-12-06T20:49:30.601ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45681
24002024-12-06T20:49:30.601ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45681 req_id = ff670e30-a3bb-4ed7-b647-65dd0d55ab45 response_code = 200 uri = /v2p
24012024-12-06T20:49:30.647ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65427
24022024-12-06T20:49:30.647ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24032024-12-06T20:49:30.683ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24042024-12-06T20:49:30.733ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86282 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:65427 req_id = d4cc86d9-001f-428e-8e67-db3e70d91239 response_code = 204 uri = /switch-ports
24052024-12-06T20:49:30.733ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48085
24062024-12-06T20:49:30.734ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 525aa886-e2b8-42b8-b1c9-cbf16e16e174, kind: Service { id: 59b92633-3550-4af1-b628-503b6bafd00d }, name: Name("external-dns-59b92633-3550-4af1-b628-503b6bafd00d"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 169])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7ff7e7d1-13cc-4538-9fce-dfd74792a288, kind: Service { id: 9d99eda0-389f-44c6-94ee-e9e7a03c9733 }, name: Name("external-dns-9d99eda0-389f-44c6-94ee-e9e7a03c9733"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 221, 96])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 176e274c-5ddd-4aa2-b53c-05e8fe632337, kind: Service { id: 3965e738-3305-4fcd-9da0-4c6e0ce7edc1 }, name: Name("nexus-3965e738-3305-4fcd-9da0-4c6e0ce7edc1"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 170, 95])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 75143dec-1fa4-42e5-a888-c77d19a4a83f, kind: Service { id: e9fe68b0-d53c-4161-a621-681677d5b0d6 }, name: Name("nexus-e9fe68b0-d53c-4161-a621-681677d5b0d6"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 243, 69])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9a966830-c35d-4c5c-bab6-585ffc135908, kind: Service { id: fd12fb4f-e62d-4cab-a4bd-2024f2546d3b }, name: Name("nexus-fd12fb4f-e62d-4cab-a4bd-2024f2546d3b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 247, 18])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
24072024-12-06T20:49:30.734ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 232 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65427 req_id = d2ee318a-bfe9-493f-b97d-84131e2a2620 response_code = 200 uri = /network-bootstore-config
24082024-12-06T20:49:30.734ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24092024-12-06T20:49:30.734ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
24102024-12-06T20:49:30.734ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
24112024-12-06T20:49:30.734ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24122024-12-06T20:49:30.734ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
24132024-12-06T20:49:30.734ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24142024-12-06T20:49:30.734ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 469 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48085 req_id = f48a6325-82a6-4af8-b09b-52cd903fd98a response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
24152024-12-06T20:49:50.597ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:33194
24162024-12-06T20:49:50.597ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:33194 req_id = f38edbcc-c81e-4666-a86b-8da74f60e27c response_code = 200 uri = /baseboard
24172024-12-06T20:49:57.418ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6674 local_addr = [fd00:1122:3344:101::1]:45033 method = GET remote_addr = [fd00:1122:3344:101::d]:44003 req_id = 69f5be2d-dabd-49e2-a4eb-488505e9972b response_code = 200 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 uri = /0a667526-2006-419e-9b68-c251fd138c06
24182024-12-06T20:49:58.979ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60037
24192024-12-06T20:49:58.979ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60037 req_id = d62a5786-8a5c-4f3a-9ffe-27fb20b1f76a response_code = 200 uri = /vpc-routes
24202024-12-06T20:49:59.045ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 values = ExternalIpGatewayMap { mappings: {} }
24212024-12-06T20:49:59.045ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60037 req_id = f85090b3-1b5d-40a2-8c53-9fbc4fddcf29 response_code = 204 uri = /eip-gateways
24222024-12-06T20:49:59.054ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60037 req_id = 1d2d214e-0256-43b1-a408-c2e87c8ae0e8 response_code = 204 uri = /vpc-routes
24232024-12-06T20:49:59.135ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57713
24242024-12-06T20:49:59.135ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24252024-12-06T20:49:59.174ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24262024-12-06T20:49:59.233ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98352 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:57713 req_id = aeae886c-3be0-45dc-8e32-5c83d99c5235 response_code = 204 uri = /switch-ports
24272024-12-06T20:49:59.233ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45926
24282024-12-06T20:49:59.233ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45758
24292024-12-06T20:49:59.233ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40223
24302024-12-06T20:49:59.234ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 236 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40223 req_id = 5a4be482-84dc-4460-9933-4fdcbf2a0a5e response_code = 200 uri = /v2p
24312024-12-06T20:49:59.234ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 218 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57713 req_id = 4910bdb2-05da-461c-a5fb-0b74474e9271 response_code = 200 uri = /network-bootstore-config
24322024-12-06T20:49:59.234ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 185 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45926 req_id = c83523f5-5364-4050-89d7-a1bcc021d808 response_code = 200 uri = /vpc-routes
24332024-12-06T20:49:59.234ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 201 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45758 req_id = b7f9d65d-271a-4296-9283-181eecd983ec response_code = 200 uri = /v2p
24342024-12-06T20:49:59.281ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 values = ExternalIpGatewayMap { mappings: {} }
24352024-12-06T20:49:59.281ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45926 req_id = 785fae12-bb74-44fc-ab2b-28d917defce4 response_code = 204 uri = /eip-gateways
24362024-12-06T20:49:59.290ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45926 req_id = f640dc63-0ac7-4e44-9ccf-f467d1b655ba response_code = 204 uri = /vpc-routes
24372024-12-06T20:49:59.315ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33133
24382024-12-06T20:49:59.315ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24392024-12-06T20:49:59.355ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24402024-12-06T20:49:59.412ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97009 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:33133 req_id = 8713d941-125b-4ffa-84b2-5e767b20e93e response_code = 204 uri = /switch-ports
24412024-12-06T20:49:59.413ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33133 req_id = f8aac371-400d-4c18-82ca-8e51066d8d3c response_code = 200 uri = /network-bootstore-config
24422024-12-06T20:50:00.320ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33772
24432024-12-06T20:50:00.320ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33772 req_id = d5248860-86fe-4380-9939-fe61d4bd50ee response_code = 200 uri = /vpc-routes
24442024-12-06T20:50:00.337ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 values = ExternalIpGatewayMap { mappings: {} }
24452024-12-06T20:50:00.337ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33772 req_id = 52884a85-8d45-440c-a4a5-914052f0711d response_code = 204 uri = /eip-gateways
24462024-12-06T20:50:00.453ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55902
24472024-12-06T20:50:00.453ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55902 req_id = 61c114b2-8ec4-40f9-a7c7-ac4df03c283e response_code = 200 uri = /v2p
24482024-12-06T20:50:00.459ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33772 req_id = cc094160-5171-49a6-b9cb-e290f7d3ea3b response_code = 204 uri = /vpc-routes
24492024-12-06T20:50:00.522ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36987
24502024-12-06T20:50:00.522ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24512024-12-06T20:50:00.561ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24522024-12-06T20:50:00.619ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96678 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:36987 req_id = 27735726-f808-4441-9c1c-faf5ad8c63fd response_code = 204 uri = /switch-ports
24532024-12-06T20:50:00.619ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36987 req_id = f744979e-e5b2-43c5-8ac1-82fce256f545 response_code = 200 uri = /network-bootstore-config
24542024-12-06T20:50:19.308ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:197
24552024-12-06T20:50:19.308ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
24562024-12-06T20:50:19.338ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 7149, tv_nsec: 677372080 } time_to_next_cleanup = 599.99999504s
24572024-12-06T20:50:20.631ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:42695
24582024-12-06T20:50:20.631ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:42695 req_id = 88323abf-a65f-4de5-9a74-1fa281d5789a response_code = 200 uri = /baseboard
24592024-12-06T20:50:27.418ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6623 local_addr = [fd00:1122:3344:101::1]:45033 method = GET remote_addr = [fd00:1122:3344:101::d]:44003 req_id = dc768f98-27ce-4e00-af0b-8c27bb1e2c3e response_code = 200 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 uri = /0a667526-2006-419e-9b68-c251fd138c06
24602024-12-06T20:50:29.212ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43624
24612024-12-06T20:50:29.212ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43624 req_id = 43bee7d2-ccfb-41dc-b123-7855cc4e9a1c response_code = 200 uri = /vpc-routes
24622024-12-06T20:50:29.225ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43791
24632024-12-06T20:50:29.226ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43791 req_id = 51f3139f-aa98-4712-bb70-f80dc59490ec response_code = 200 uri = /vpc-routes
24642024-12-06T20:50:29.227ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 values = ExternalIpGatewayMap { mappings: {} }
24652024-12-06T20:50:29.227ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43624 req_id = e987478e-6d22-4a06-b9e0-ff7aedd3cf6d response_code = 204 uri = /eip-gateways
24662024-12-06T20:50:29.240ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 values = ExternalIpGatewayMap { mappings: {} }
24672024-12-06T20:50:29.240ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43791 req_id = 0baf9f7c-741e-484a-88d8-594888164271 response_code = 204 uri = /eip-gateways
24682024-12-06T20:50:29.248ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 372 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43791 req_id = ce538747-6b9b-4918-a94d-4ed8a9f91b43 response_code = 204 uri = /vpc-routes
24692024-12-06T20:50:29.284ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43440
24702024-12-06T20:50:29.285ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43440 req_id = d0937bf8-a13c-451b-8b2a-6d039fbe6ac2 response_code = 200 uri = /v2p
24712024-12-06T20:50:29.287ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 180 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43624 req_id = f938757a-8fbc-4516-a0cb-78c43725ef51 response_code = 204 uri = /vpc-routes
24722024-12-06T20:50:29.345ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48210
24732024-12-06T20:50:29.345ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24742024-12-06T20:50:29.388ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24752024-12-06T20:50:29.444ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99214 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:48210 req_id = bf6f273e-b02c-4020-b42b-95517d966404 response_code = 204 uri = /switch-ports
24762024-12-06T20:50:29.444ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38160
24772024-12-06T20:50:29.444ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60425
24782024-12-06T20:50:29.445ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24792024-12-06T20:50:29.448ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3043 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38160 req_id = 6c7d15e3-3da0-4993-813e-9bd96cfe254c response_code = 200 uri = /v2p
24802024-12-06T20:50:29.467ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48210 req_id = 5e52bbd9-adbd-4370-8082-2cd18c62dbff response_code = 200 uri = /network-bootstore-config
24812024-12-06T20:50:29.479ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24822024-12-06T20:50:29.537ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93033 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:60425 req_id = d579a13e-94f0-4a8f-937b-193b7349684a response_code = 204 uri = /switch-ports
24832024-12-06T20:50:29.538ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 197 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60425 req_id = 89e70410-cf44-433c-b757-6d141429df35 response_code = 200 uri = /network-bootstore-config
24842024-12-06T20:50:30.447ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38461
24852024-12-06T20:50:30.448ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38461 req_id = aa8a4bf2-a1d1-46a3-89e4-b23f4c479404 response_code = 200 uri = /v2p
24862024-12-06T20:50:30.463ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49528
24872024-12-06T20:50:30.463ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 27 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49528 req_id = 65527291-e30f-496d-9f21-c81c6d3aa7fa response_code = 200 uri = /vpc-routes
24882024-12-06T20:50:30.509ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 values = ExternalIpGatewayMap { mappings: {} }
24892024-12-06T20:50:30.509ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49528 req_id = cfab703d-bb93-474e-82fc-b791fe585202 response_code = 204 uri = /eip-gateways
24902024-12-06T20:50:30.518ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 254 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49528 req_id = 477ca81a-f0d4-4c4c-ae2b-8709d9211862 response_code = 204 uri = /vpc-routes
24912024-12-06T20:50:30.555ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47929
24922024-12-06T20:50:30.555ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24932024-12-06T20:50:30.594ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24942024-12-06T20:50:30.651ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95720 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:47929 req_id = e14027eb-c6b6-452e-9fa4-05661b6f7e15 response_code = 204 uri = /switch-ports
24952024-12-06T20:50:30.651ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47929 req_id = 5a4dbd7d-a518-44bc-9312-b11aa4734e83 response_code = 200 uri = /network-bootstore-config
24962024-12-06T20:50:33.565ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
24972024-12-06T20:50:50.664ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:58228
24982024-12-06T20:50:50.664ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:58228 req_id = 0efce80c-1452-42d8-886f-1a52ab9e4677 response_code = 200 uri = /baseboard
24992024-12-06T20:50:57.417ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6194 local_addr = [fd00:1122:3344:101::1]:45033 method = GET remote_addr = [fd00:1122:3344:101::d]:44003 req_id = 14661ba6-3670-43c5-afa3-0a6166c15c64 response_code = 200 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 uri = /0a667526-2006-419e-9b68-c251fd138c06
25002024-12-06T20:50:58.981ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58096
25012024-12-06T20:50:58.982ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58096 req_id = 7dc6ba93-532b-4adc-82fb-dce3579b821e response_code = 200 uri = /vpc-routes
25022024-12-06T20:50:59.003ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 values = ExternalIpGatewayMap { mappings: {} }
25032024-12-06T20:50:59.003ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58096 req_id = 247784ab-5bbf-40ee-9240-b9b6b070bfd0 response_code = 204 uri = /eip-gateways
25042024-12-06T20:50:59.012ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 273 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58096 req_id = 5aac705a-caec-4661-a124-f9eb87f6525f response_code = 204 uri = /vpc-routes
25052024-12-06T20:50:59.074ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54039
25062024-12-06T20:50:59.075ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 30 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54039 req_id = 2efac52a-7368-42b9-98b1-40524553c2cc response_code = 200 uri = /vpc-routes
25072024-12-06T20:50:59.122ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 values = ExternalIpGatewayMap { mappings: {} }
25082024-12-06T20:50:59.122ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54039 req_id = 97d568de-532a-478a-b96d-3545ad9cb9db response_code = 204 uri = /eip-gateways
25092024-12-06T20:50:59.131ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58929
25102024-12-06T20:50:59.131ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25112024-12-06T20:50:59.170ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25122024-12-06T20:50:59.229ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98740 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:58929 req_id = 79ee5a4c-67b5-40e0-8e45-d9821b36ca87 response_code = 204 uri = /switch-ports
25132024-12-06T20:50:59.230ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62360
25142024-12-06T20:50:59.230ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63694
25152024-12-06T20:50:59.230ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 259 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58929 req_id = 730a158e-f221-49e5-bd51-0b2e55cb2d7c response_code = 200 uri = /network-bootstore-config
25162024-12-06T20:50:59.230ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 512 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54039 req_id = 5b6a35d3-9320-496f-bcc4-b4ef92083809 response_code = 204 uri = /vpc-routes
25172024-12-06T20:50:59.230ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 260 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62360 req_id = 613f6d0e-c200-425e-aa21-31d625323bd4 response_code = 200 uri = /v2p
25182024-12-06T20:50:59.230ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 255 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63694 req_id = 3cbd9626-d326-4814-8a5b-b4c5f6d48879 response_code = 200 uri = /v2p
25192024-12-06T20:50:59.243ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43223
25202024-12-06T20:50:59.243ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25212024-12-06T20:50:59.276ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25222024-12-06T20:50:59.327ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84486 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:43223 req_id = 073cac44-d3af-44e5-9ae2-f7f6ec75f88f response_code = 204 uri = /switch-ports
25232024-12-06T20:50:59.328ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 191 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43223 req_id = 420565e3-61e9-478f-9e91-e63786c11564 response_code = 200 uri = /network-bootstore-config
25242024-12-06T20:51:00.257ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56999
25252024-12-06T20:51:00.257ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56999 req_id = 8d2cde46-facb-44e1-9795-e65e7aa0dee6 response_code = 200 uri = /vpc-routes
25262024-12-06T20:51:00.306ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 values = ExternalIpGatewayMap { mappings: {} }
25272024-12-06T20:51:00.306ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56999 req_id = 3b78c4eb-9469-4261-a930-f9c750a396e8 response_code = 204 uri = /eip-gateways
25282024-12-06T20:51:00.320ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 167 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56999 req_id = 9dc2ee85-7c98-42c5-852f-36e5ec7a94f5 response_code = 204 uri = /vpc-routes
25292024-12-06T20:51:00.419ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33547
25302024-12-06T20:51:00.419ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25312024-12-06T20:51:00.456ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25322024-12-06T20:51:00.509ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90452 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:33547 req_id = f05d650e-11fb-406f-ad67-7ca22f9672af response_code = 204 uri = /switch-ports
25332024-12-06T20:51:00.509ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44058
25342024-12-06T20:51:00.510ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 225 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44058 req_id = 66b6d509-cb8f-42f2-8a11-3e7299177781 response_code = 200 uri = /v2p
25352024-12-06T20:51:00.510ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 225 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33547 req_id = 00cd66f8-8466-49c2-8822-6fb833b2df8b response_code = 200 uri = /network-bootstore-config
25362024-12-06T20:51:20.696ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:54977
25372024-12-06T20:51:20.697ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:54977 req_id = d3741adf-6bfb-4b41-9b0a-56f81de2b842 response_code = 200 uri = /baseboard
25382024-12-06T20:51:27.417ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6003 local_addr = [fd00:1122:3344:101::1]:45033 method = GET remote_addr = [fd00:1122:3344:101::d]:44003 req_id = 13a52661-8406-4f8a-a207-f2b5d598b508 response_code = 200 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 uri = /0a667526-2006-419e-9b68-c251fd138c06
25392024-12-06T20:51:29.100ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47036
25402024-12-06T20:51:29.100ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47036 req_id = 4e1f377b-c4b7-4563-95cb-efcbfbb4cce0 response_code = 200 uri = /vpc-routes
25412024-12-06T20:51:29.175ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 values = ExternalIpGatewayMap { mappings: {} }
25422024-12-06T20:51:29.175ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47036 req_id = 732cf0b7-ab6b-439f-977d-90a160b97f9a response_code = 204 uri = /eip-gateways
25432024-12-06T20:51:29.184ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40187
25442024-12-06T20:51:29.184ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40187 req_id = dc799b76-c777-4223-b0c6-3b533e5c8034 response_code = 200 uri = /vpc-routes
25452024-12-06T20:51:29.185ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 232 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47036 req_id = 73a3613a-2e88-4deb-b0e0-148eb02896d7 response_code = 204 uri = /vpc-routes
25462024-12-06T20:51:29.228ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 values = ExternalIpGatewayMap { mappings: {} }
25472024-12-06T20:51:29.228ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40187 req_id = a6888c08-bc57-4843-915d-838f2112ea3d response_code = 204 uri = /eip-gateways
25482024-12-06T20:51:29.237ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 184 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40187 req_id = 4d97eeee-1d96-480e-8e0e-25cb8ef087fe response_code = 204 uri = /vpc-routes
25492024-12-06T20:51:29.307ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35704
25502024-12-06T20:51:29.307ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35704 req_id = 5d97e163-9de3-42ed-b7a3-70715faa9500 response_code = 200 uri = /v2p
25512024-12-06T20:51:29.320ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63063
25522024-12-06T20:51:29.320ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25532024-12-06T20:51:29.361ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25542024-12-06T20:51:29.418ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98198 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:63063 req_id = f8f62c2f-47b6-4067-b2bd-88f0568be863 response_code = 204 uri = /switch-ports
25552024-12-06T20:51:29.418ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47420
25562024-12-06T20:51:29.419ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 251 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63063 req_id = d2be67bc-95cb-40e2-8816-7438ea46efe6 response_code = 200 uri = /network-bootstore-config
25572024-12-06T20:51:29.419ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 226 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47420 req_id = 380de2f5-a776-490c-a11c-410964a67bc8 response_code = 200 uri = /v2p
25582024-12-06T20:51:29.470ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39684
25592024-12-06T20:51:29.470ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25602024-12-06T20:51:29.501ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25612024-12-06T20:51:29.548ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77801 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:39684 req_id = 693dfad2-11d2-45c2-8236-be19b7572546 response_code = 204 uri = /switch-ports
25622024-12-06T20:51:29.548ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39684 req_id = 83d95537-0b25-43c6-a404-e672bd074ff9 response_code = 200 uri = /network-bootstore-config
25632024-12-06T20:51:30.325ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51337
25642024-12-06T20:51:30.325ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51337 req_id = 3e2c2453-5f68-47cd-a6d2-05cdbc52b8c1 response_code = 200 uri = /vpc-routes
25652024-12-06T20:51:30.345ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 values = ExternalIpGatewayMap { mappings: {} }
25662024-12-06T20:51:30.345ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51337 req_id = 2563f32f-cb32-4482-a37c-2dd2b6bbc6d3 response_code = 204 uri = /eip-gateways
25672024-12-06T20:51:30.354ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 199 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51337 req_id = c4a2da86-caa7-4b48-8771-4365f20e11e0 response_code = 204 uri = /vpc-routes
25682024-12-06T20:51:30.559ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48906
25692024-12-06T20:51:30.559ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48906 req_id = eef65a20-5075-4187-8e0d-572ce3564198 response_code = 200 uri = /v2p
25702024-12-06T20:51:30.625ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38598
25712024-12-06T20:51:30.625ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25722024-12-06T20:51:30.661ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25732024-12-06T20:51:30.719ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94523 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:38598 req_id = 407268bc-7660-42ed-b49c-86af2b3fa7b2 response_code = 204 uri = /switch-ports
25742024-12-06T20:51:30.720ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38598 req_id = 38b4900d-1480-4281-a032-12e4e6975d21 response_code = 200 uri = /network-bootstore-config
25752024-12-06T20:51:50.729ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:36340
25762024-12-06T20:51:50.730ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:36340 req_id = e32e6a8d-7c8f-44b6-a33c-fb3e09090586 response_code = 200 uri = /baseboard
25772024-12-06T20:51:57.417ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6111 local_addr = [fd00:1122:3344:101::1]:45033 method = GET remote_addr = [fd00:1122:3344:101::d]:44003 req_id = 205f3008-5de6-45ab-a8b4-dfa6ff434da7 response_code = 200 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 uri = /0a667526-2006-419e-9b68-c251fd138c06
25782024-12-06T20:51:59.082ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33578
25792024-12-06T20:51:59.082ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33578 req_id = 301356db-1f27-48e8-b6a7-da23306a4a9b response_code = 200 uri = /vpc-routes
25802024-12-06T20:51:59.136ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44756
25812024-12-06T20:51:59.136ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44756 req_id = 2a907ebf-6607-4161-8a4d-454dc8f8070d response_code = 200 uri = /vpc-routes
25822024-12-06T20:51:59.141ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 values = ExternalIpGatewayMap { mappings: {} }
25832024-12-06T20:51:59.141ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33578 req_id = 2bb64102-0bad-42d5-8011-de2a48994486 response_code = 204 uri = /eip-gateways
25842024-12-06T20:51:59.141ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63085
25852024-12-06T20:51:59.142ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63085 req_id = a85cd57c-21ff-4dfa-a4f4-726506644d3a response_code = 200 uri = /v2p
25862024-12-06T20:51:59.150ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 195 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33578 req_id = 9e4846fb-faf1-452e-9115-fcca93892009 response_code = 204 uri = /vpc-routes
25872024-12-06T20:51:59.189ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 values = ExternalIpGatewayMap { mappings: {} }
25882024-12-06T20:51:59.189ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44756 req_id = 75e14013-a114-44ee-9860-55853c8dcd5c response_code = 204 uri = /eip-gateways
25892024-12-06T20:51:59.199ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 244 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44756 req_id = a0e40da0-406b-44a8-8966-f7b948fbf3d6 response_code = 204 uri = /vpc-routes
25902024-12-06T20:51:59.208ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56996
25912024-12-06T20:51:59.208ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25922024-12-06T20:51:59.243ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25932024-12-06T20:51:59.297ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88787 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:56996 req_id = 5bf2d3da-7410-42c7-af7e-7f2e88f2bb22 response_code = 204 uri = /switch-ports
25942024-12-06T20:51:59.297ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41733
25952024-12-06T20:51:59.297ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53900
25962024-12-06T20:51:59.297ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25972024-12-06T20:51:59.297ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 296 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56996 req_id = 5cca51f5-ac3b-4e70-814f-007fb8ab3901 response_code = 200 uri = /network-bootstore-config
25982024-12-06T20:51:59.297ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 217 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41733 req_id = c8a4494e-63a7-47b6-9750-17a28932d3c7 response_code = 200 uri = /v2p
25992024-12-06T20:51:59.333ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26002024-12-06T20:51:59.387ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90001 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:53900 req_id = f3f31e6b-cd69-4e25-89d7-4fad6d10dd48 response_code = 204 uri = /switch-ports
26012024-12-06T20:51:59.388ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53900 req_id = 46371b17-69a4-44eb-9cd8-825bd21e9e43 response_code = 200 uri = /network-bootstore-config
26022024-12-06T20:52:00.286ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:32969
26032024-12-06T20:52:00.286ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:32969 req_id = 27fc8017-67ef-4524-ab61-5cf5b95d6e44 response_code = 200 uri = /vpc-routes
26042024-12-06T20:52:00.331ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51002
26052024-12-06T20:52:00.331ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51002 req_id = a9de0dbd-f3c2-46dc-a255-5812ae00facb response_code = 200 uri = /v2p
26062024-12-06T20:52:00.333ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 values = ExternalIpGatewayMap { mappings: {} }
26072024-12-06T20:52:00.333ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:32969 req_id = 5e245080-ae46-4c21-8ec5-5934bf20bf92 response_code = 204 uri = /eip-gateways
26082024-12-06T20:52:00.343ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 221 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:32969 req_id = 2617916c-4b39-413b-98f7-062a85bda1f1 response_code = 204 uri = /vpc-routes
26092024-12-06T20:52:00.379ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56626
26102024-12-06T20:52:00.379ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26112024-12-06T20:52:00.415ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26122024-12-06T20:52:00.469ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89295 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:56626 req_id = fe638556-cd64-4347-9863-df78d0dec3c9 response_code = 204 uri = /switch-ports
26132024-12-06T20:52:00.469ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56626 req_id = 3a94220c-ebdd-4348-a499-76320df99be9 response_code = 200 uri = /network-bootstore-config
26142024-12-06T20:52:20.762ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:45174
26152024-12-06T20:52:20.762ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:45174 req_id = b9c33e96-6bd7-4209-9770-5666081c6735 response_code = 200 uri = /baseboard
26162024-12-06T20:52:27.417ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6345 local_addr = [fd00:1122:3344:101::1]:45033 method = GET remote_addr = [fd00:1122:3344:101::d]:44003 req_id = a943a0bc-4150-4d73-b5ca-3cd01d512ea9 response_code = 200 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 uri = /0a667526-2006-419e-9b68-c251fd138c06
26172024-12-06T20:52:29.231ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36526
26182024-12-06T20:52:29.231ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36526 req_id = 6c33eb4b-9ffd-46e2-8336-ea3a243f3c5c response_code = 200 uri = /vpc-routes
26192024-12-06T20:52:29.240ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40879
26202024-12-06T20:52:29.240ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 24 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40879 req_id = c94ea7ce-bea6-47aa-a6b3-ff394a1cd32a response_code = 200 uri = /vpc-routes
26212024-12-06T20:52:29.279ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 values = ExternalIpGatewayMap { mappings: {} }
26222024-12-06T20:52:29.279ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36526 req_id = 8711da53-c5ed-4157-8ca4-fd39af01eecb response_code = 204 uri = /eip-gateways
26232024-12-06T20:52:29.286ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42292
26242024-12-06T20:52:29.286ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42292 req_id = e566fbda-3940-4bf9-a393-d2c431034ecc response_code = 200 uri = /v2p
26252024-12-06T20:52:29.287ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 values = ExternalIpGatewayMap { mappings: {} }
26262024-12-06T20:52:29.287ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40879 req_id = 949e1a83-11d4-43bf-8fd3-ae07bae9647b response_code = 204 uri = /eip-gateways
26272024-12-06T20:52:29.292ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 286 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36526 req_id = 487ba30a-debd-484a-8a3d-44635bbe4496 response_code = 204 uri = /vpc-routes
26282024-12-06T20:52:29.297ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 191 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40879 req_id = 6f4ebccb-d401-4593-a6c5-7637caa487ef response_code = 204 uri = /vpc-routes
26292024-12-06T20:52:29.378ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44151
26302024-12-06T20:52:29.378ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26312024-12-06T20:52:29.416ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26322024-12-06T20:52:29.472ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94169 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:44151 req_id = b6aa2b2a-963f-4212-b138-d3660758394d response_code = 204 uri = /switch-ports
26332024-12-06T20:52:29.476ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44151 req_id = abb708b4-044d-443f-b95d-28c45cfa0c1c response_code = 200 uri = /network-bootstore-config
26342024-12-06T20:52:29.477ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60210
26352024-12-06T20:52:29.478ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60210 req_id = 83330401-c3c3-4350-b06b-37d16734e88e response_code = 200 uri = /v2p
26362024-12-06T20:52:29.554ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42888
26372024-12-06T20:52:29.554ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26382024-12-06T20:52:29.590ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26392024-12-06T20:52:29.649ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95408 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:42888 req_id = 8162c516-dbfe-458d-9292-553bf80fd4a2 response_code = 204 uri = /switch-ports
26402024-12-06T20:52:29.649ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42888 req_id = 08c19cfa-2eab-4e80-ba6b-9404b738f15c response_code = 200 uri = /network-bootstore-config
26412024-12-06T20:52:30.305ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54399
26422024-12-06T20:52:30.305ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54399 req_id = 9a1d86cd-6920-466f-a8e7-7d2dd36db90a response_code = 200 uri = /vpc-routes
26432024-12-06T20:52:30.356ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 values = ExternalIpGatewayMap { mappings: {} }
26442024-12-06T20:52:30.356ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54399 req_id = 1fce0711-6c68-41d2-9c8f-f04b0d476660 response_code = 204 uri = /eip-gateways
26452024-12-06T20:52:30.365ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 249 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54399 req_id = 82ffd28a-efd4-4f35-ab60-d8eb84730928 response_code = 204 uri = /vpc-routes
26462024-12-06T20:52:30.468ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43507
26472024-12-06T20:52:30.468ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26482024-12-06T20:52:30.510ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26492024-12-06T20:52:30.564ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95552 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:43507 req_id = f0dd910e-c612-4dd7-bddc-8b8e7b3b2135 response_code = 204 uri = /switch-ports
26502024-12-06T20:52:30.564ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52112
26512024-12-06T20:52:30.564ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 193 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52112 req_id = bee6dae8-3466-48b4-bfea-fa90313ae399 response_code = 200 uri = /v2p
26522024-12-06T20:52:30.564ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 265 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43507 req_id = 6ed1fffb-a966-460e-8d00-d9b51146da30 response_code = 200 uri = /network-bootstore-config
26532024-12-06T20:52:50.793ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:38291
26542024-12-06T20:52:50.793ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 28 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:38291 req_id = eb0a9c3f-5fe5-4e02-b809-b30e582aee70 response_code = 200 uri = /baseboard
26552024-12-06T20:52:57.417ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6924 local_addr = [fd00:1122:3344:101::1]:45033 method = GET remote_addr = [fd00:1122:3344:101::d]:44003 req_id = c31a8f41-aa8e-4418-9aa7-22f8b39c1f11 response_code = 200 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 uri = /0a667526-2006-419e-9b68-c251fd138c06
26562024-12-06T20:52:59.090ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35724
26572024-12-06T20:52:59.090ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35724 req_id = 69d4b32f-009f-435e-be7b-ac199758b481 response_code = 200 uri = /vpc-routes
26582024-12-06T20:52:59.138ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39562
26592024-12-06T20:52:59.138ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39562 req_id = 561432b3-0e6f-407b-a643-99e4fbb73e91 response_code = 200 uri = /vpc-routes
26602024-12-06T20:52:59.143ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 values = ExternalIpGatewayMap { mappings: {} }
26612024-12-06T20:52:59.143ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35724 req_id = 25c6c6a3-2929-4c48-b566-fc5ac6890310 response_code = 204 uri = /eip-gateways
26622024-12-06T20:52:59.149ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61594
26632024-12-06T20:52:59.149ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61594 req_id = ecfe07c8-1ca1-4c24-80dc-4ded423890c9 response_code = 200 uri = /v2p
26642024-12-06T20:52:59.155ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 values = ExternalIpGatewayMap { mappings: {} }
26652024-12-06T20:52:59.155ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39562 req_id = 15c3d4c3-99f3-4875-811b-4ed1d66fd98f response_code = 204 uri = /eip-gateways
26662024-12-06T20:52:59.155ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 257 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35724 req_id = 926ae0d8-e5b1-428c-983f-32c8e739e64b response_code = 204 uri = /vpc-routes
26672024-12-06T20:52:59.165ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 223 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39562 req_id = 1c325d35-80ac-414a-88f2-4316910c74c9 response_code = 204 uri = /vpc-routes
26682024-12-06T20:52:59.252ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56980
26692024-12-06T20:52:59.252ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26702024-12-06T20:52:59.301ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26712024-12-06T20:52:59.355ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103212 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:56980 req_id = 8f53abef-86ff-4bd2-b189-29b6a7b6cc4a response_code = 204 uri = /switch-ports
26722024-12-06T20:52:59.355ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52296
26732024-12-06T20:52:59.355ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64928
26742024-12-06T20:52:59.355ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 240 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56980 req_id = 9a4c33ea-c7ff-4f81-aff3-c54143b1d177 response_code = 200 uri = /network-bootstore-config
26752024-12-06T20:52:59.355ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 227 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64928 req_id = 19483f2f-68c3-400e-bb0d-bc976f83a40e response_code = 200 uri = /v2p
26762024-12-06T20:52:59.355ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26772024-12-06T20:52:59.392ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26782024-12-06T20:52:59.444ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88907 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:52296 req_id = a559f551-65b3-4613-be48-1cff027e414f response_code = 204 uri = /switch-ports
26792024-12-06T20:52:59.445ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52296 req_id = 60e49bff-ffa5-4195-a15f-6b0bda2f3fcf response_code = 200 uri = /network-bootstore-config
26802024-12-06T20:53:00.320ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39778
26812024-12-06T20:53:00.320ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39778 req_id = cfa9c300-51c3-4022-8a7d-b036ab440100 response_code = 200 uri = /vpc-routes
26822024-12-06T20:53:00.365ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 values = ExternalIpGatewayMap { mappings: {} }
26832024-12-06T20:53:00.365ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39778 req_id = 9bba7c3e-e1fa-4850-ab58-44557f7effb4 response_code = 204 uri = /eip-gateways
26842024-12-06T20:53:00.375ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39778 req_id = 201daa8b-bff3-42ff-a8ea-b68ff28d4766 response_code = 204 uri = /vpc-routes
26852024-12-06T20:53:00.416ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60897
26862024-12-06T20:53:00.416ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26872024-12-06T20:53:00.455ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26882024-12-06T20:53:00.506ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89730 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:60897 req_id = 34178eee-f48c-4f88-9414-1b0b8f4eb33b response_code = 204 uri = /switch-ports
26892024-12-06T20:53:00.506ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61628
26902024-12-06T20:53:00.507ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 203 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60897 req_id = e9668b55-6272-4252-9853-ec01384819e5 response_code = 200 uri = /network-bootstore-config
26912024-12-06T20:53:00.507ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61628 req_id = 8f8599b8-8848-4959-afbb-7b98bd5ea101 response_code = 200 uri = /v2p
26922024-12-06T20:53:20.826ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:40454
26932024-12-06T20:53:20.826ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:40454 req_id = e3f9def3-6e49-44ef-aea0-4683628db2d3 response_code = 200 uri = /baseboard
26942024-12-06T20:53:27.418ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7609 local_addr = [fd00:1122:3344:101::1]:45033 method = GET remote_addr = [fd00:1122:3344:101::d]:44003 req_id = 4ed786e7-c6b5-4a53-89ce-34659e92bab4 response_code = 200 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 uri = /0a667526-2006-419e-9b68-c251fd138c06
26952024-12-06T20:53:29.240ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54032
26962024-12-06T20:53:29.240ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54032 req_id = bbb02816-2bef-41b6-8ead-e7b4d47976bd response_code = 200 uri = /vpc-routes
26972024-12-06T20:53:29.252ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34276
26982024-12-06T20:53:29.252ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34276 req_id = ebba0c87-abfb-4e6b-9752-ddc85848eb57 response_code = 200 uri = /vpc-routes
26992024-12-06T20:53:29.307ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 values = ExternalIpGatewayMap { mappings: {} }
27002024-12-06T20:53:29.307ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54032 req_id = b8aec684-5f30-4ac5-9c1b-9ad4d02eae87 response_code = 204 uri = /eip-gateways
27012024-12-06T20:53:29.328ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 values = ExternalIpGatewayMap { mappings: {} }
27022024-12-06T20:53:29.328ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34276 req_id = bac601e7-3fad-41a4-878c-38a9fe8903a4 response_code = 204 uri = /eip-gateways
27032024-12-06T20:53:29.343ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 284 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34276 req_id = 3d6d3fb5-bc7e-4a5f-adf2-80661f4820a3 response_code = 204 uri = /vpc-routes
27042024-12-06T20:53:29.363ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65359
27052024-12-06T20:53:29.363ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65359 req_id = e6a7a87a-9af2-4339-bb89-876fc63c0d05 response_code = 200 uri = /v2p
27062024-12-06T20:53:29.364ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33178
27072024-12-06T20:53:29.364ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27082024-12-06T20:53:29.408ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27092024-12-06T20:53:29.471ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106406 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:33178 req_id = 1027e0c3-c2ef-43ce-aa05-a4f44d3f8935 response_code = 204 uri = /switch-ports
27102024-12-06T20:53:29.471ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65078
27112024-12-06T20:53:29.471ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 304 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33178 req_id = 14cc49bd-b8d7-41eb-a34c-c0a377785baf response_code = 200 uri = /network-bootstore-config
27122024-12-06T20:53:29.472ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27132024-12-06T20:53:29.477ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5816 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54032 req_id = 40b6a05f-8074-401c-9c14-320a11d58cd4 response_code = 204 uri = /vpc-routes
27142024-12-06T20:53:29.511ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27152024-12-06T20:53:29.536ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41899
27162024-12-06T20:53:29.537ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 195 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41899 req_id = d6e06138-62f3-46c8-9e12-f32306abeb7e response_code = 200 uri = /v2p
27172024-12-06T20:53:29.563ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91458 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:65078 req_id = bddd220c-6644-4045-b10d-e7ba74c61776 response_code = 204 uri = /switch-ports
27182024-12-06T20:53:29.563ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65078 req_id = 60a5291f-3b3a-4d0b-a0ec-c0e5e946a0c3 response_code = 200 uri = /network-bootstore-config
27192024-12-06T20:53:30.471ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43399
27202024-12-06T20:53:30.471ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43399 req_id = 6918e78a-9012-4cd3-b150-eb2a9c9093fb response_code = 200 uri = /vpc-routes
27212024-12-06T20:53:30.518ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 values = ExternalIpGatewayMap { mappings: {} }
27222024-12-06T20:53:30.518ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43399 req_id = 6b0eb2bd-9c4d-49cf-a469-b6d3bec2a9e6 response_code = 204 uri = /eip-gateways
27232024-12-06T20:53:30.527ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 250 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43399 req_id = f4e89ed2-11ba-4557-a97d-bd7a753f41bd response_code = 204 uri = /vpc-routes
27242024-12-06T20:53:30.577ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36233
27252024-12-06T20:53:30.577ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36233 req_id = c6aa3581-1c9a-4c3b-af65-1b1fcdfd4ccc response_code = 200 uri = /v2p
27262024-12-06T20:53:30.623ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41347
27272024-12-06T20:53:30.623ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27282024-12-06T20:53:30.662ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27292024-12-06T20:53:30.721ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97795 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:41347 req_id = d72d45b0-91c6-45bb-ad1e-64e16dbf4a64 response_code = 204 uri = /switch-ports
27302024-12-06T20:53:30.725ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41347 req_id = cf91320c-e82e-4b1a-ad9d-a20d957aa854 response_code = 200 uri = /network-bootstore-config
27312024-12-06T20:53:50.859ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:57677
27322024-12-06T20:53:50.860ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:57677 req_id = 535d3576-43ea-498b-859e-bf15080bfc4a response_code = 200 uri = /baseboard
27332024-12-06T20:53:57.416ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6629 local_addr = [fd00:1122:3344:101::1]:45033 method = GET remote_addr = [fd00:1122:3344:101::d]:44003 req_id = 4f4389b5-0d80-434e-91da-c83bf2d2cf88 response_code = 200 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 uri = /0a667526-2006-419e-9b68-c251fd138c06
27342024-12-06T20:53:59.084ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37167
27352024-12-06T20:53:59.084ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37167 req_id = 5bbe872e-c38f-40c3-a9b0-d1361bb525b3 response_code = 200 uri = /vpc-routes
27362024-12-06T20:53:59.121ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56876
27372024-12-06T20:53:59.121ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 23 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56876 req_id = 67f96152-26ba-4c01-b7af-c77c9372bfa5 response_code = 200 uri = /vpc-routes
27382024-12-06T20:53:59.128ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 values = ExternalIpGatewayMap { mappings: {} }
27392024-12-06T20:53:59.128ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37167 req_id = dced7903-b330-459f-a618-1e457fa2c9aa response_code = 204 uri = /eip-gateways
27402024-12-06T20:53:59.156ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33643
27412024-12-06T20:53:59.157ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33643 req_id = b023c359-50c7-4530-b2ea-e01be5632f91 response_code = 200 uri = /v2p
27422024-12-06T20:53:59.159ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41258
27432024-12-06T20:53:59.159ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27442024-12-06T20:53:59.203ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27452024-12-06T20:53:59.260ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100545 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:41258 req_id = 4ea8f7ee-6810-4821-9b46-a57ace59d7c6 response_code = 204 uri = /switch-ports
27462024-12-06T20:53:59.260ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57224
27472024-12-06T20:53:59.260ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 values = ExternalIpGatewayMap { mappings: {} }
27482024-12-06T20:53:59.260ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56876 req_id = ba09aa0e-ab90-4d49-9eea-913120226097 response_code = 204 uri = /eip-gateways
27492024-12-06T20:53:59.260ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36422
27502024-12-06T20:53:59.260ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 297 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41258 req_id = ac9bed45-f2d6-4f62-9f38-f8cda9a9aa59 response_code = 200 uri = /network-bootstore-config
27512024-12-06T20:53:59.260ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27522024-12-06T20:53:59.261ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 232 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57224 req_id = 81be97a9-6ed9-4bb4-9290-9feca4410499 response_code = 200 uri = /v2p
27532024-12-06T20:53:59.261ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 381 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37167 req_id = c06ccb39-7e4b-4367-ae30-d935ae87e2a2 response_code = 204 uri = /vpc-routes
27542024-12-06T20:53:59.270ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 388 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56876 req_id = c42f37b6-99a2-4327-9652-a69e43ddba31 response_code = 204 uri = /vpc-routes
27552024-12-06T20:53:59.298ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27562024-12-06T20:53:59.354ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93210 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:36422 req_id = 4f129623-3d1b-4289-b516-01740a005ee6 response_code = 204 uri = /switch-ports
27572024-12-06T20:53:59.354ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36422 req_id = 4cef1f59-c043-49e6-a0de-145032b09932 response_code = 200 uri = /network-bootstore-config
27582024-12-06T20:54:00.290ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34552
27592024-12-06T20:54:00.290ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34552 req_id = 98d37fbc-d288-4530-835d-08fc2577fe61 response_code = 200 uri = /vpc-routes
27602024-12-06T20:54:00.340ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 values = ExternalIpGatewayMap { mappings: {} }
27612024-12-06T20:54:00.340ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34552 req_id = b70f4330-1980-4196-84f9-4d51613b7850 response_code = 204 uri = /eip-gateways
27622024-12-06T20:54:00.349ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 185 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34552 req_id = 5904c0fd-35a9-4d1e-b7b5-19b451c465d0 response_code = 204 uri = /vpc-routes
27632024-12-06T20:54:00.382ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55148
27642024-12-06T20:54:00.382ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27652024-12-06T20:54:00.419ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27662024-12-06T20:54:00.473ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90909 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:55148 req_id = 2401d4f5-619f-4685-93e5-889007ad6291 response_code = 204 uri = /switch-ports
27672024-12-06T20:54:00.473ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57637
27682024-12-06T20:54:00.474ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 275 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55148 req_id = 9d770eee-0877-43cd-8163-39d83cf86a0e response_code = 200 uri = /network-bootstore-config
27692024-12-06T20:54:00.474ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 254 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57637 req_id = 3ea2188d-453c-4be4-a2a0-98f2693722f3 response_code = 200 uri = /v2p
27702024-12-06T20:54:20.892ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:40198
27712024-12-06T20:54:20.892ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:40198 req_id = edf1ffc3-4dc0-462c-bdad-e791461e853f response_code = 200 uri = /baseboard
27722024-12-06T20:54:27.416ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6141 local_addr = [fd00:1122:3344:101::1]:45033 method = GET remote_addr = [fd00:1122:3344:101::d]:44003 req_id = 3f4e3a27-a657-4313-b2dd-70fd0ed4bb86 response_code = 200 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 uri = /0a667526-2006-419e-9b68-c251fd138c06
27732024-12-06T20:54:29.322ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54513
27742024-12-06T20:54:29.322ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54513 req_id = 19cd7f1f-1486-4953-87e0-9da021e9f6b5 response_code = 200 uri = /vpc-routes
27752024-12-06T20:54:29.364ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46507
27762024-12-06T20:54:29.364ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46507 req_id = 08a2fc6e-3b88-44cd-97b6-e9f5421b2713 response_code = 200 uri = /vpc-routes
27772024-12-06T20:54:29.378ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 values = ExternalIpGatewayMap { mappings: {} }
27782024-12-06T20:54:29.378ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54513 req_id = d9841548-bbf3-40fa-b757-4031dac5d89f response_code = 204 uri = /eip-gateways
27792024-12-06T20:54:29.431ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45347
27802024-12-06T20:54:29.431ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
27812024-12-06T20:54:29.431ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
27822024-12-06T20:54:29.431ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b9ab18cf-4dd7-46c3-920e-833f181cfe8b/config/omicron-zones.json file = common/src/ledger.rs:177
27832024-12-06T20:54:29.431ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 values = ExternalIpGatewayMap { mappings: {} }
27842024-12-06T20:54:29.431ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46507 req_id = fef77e00-54e8-46da-9f6f-494fe6b3b0ad response_code = 204 uri = /eip-gateways
27852024-12-06T20:54:29.431ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/5a719d2c-fbf6-41ef-af9f-e6b70820ebd4/config/omicron-zones.json file = common/src/ledger.rs:177
27862024-12-06T20:54:29.446ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 500 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46507 req_id = d2db2801-765d-40ae-afd0-8277611ed835 response_code = 204 uri = /vpc-routes
27872024-12-06T20:54:29.449ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 50f60e54-9000-4b4d-8705-841b133128b0 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27882024-12-06T20:54:29.449ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_50f60e54-9000-4b4d-8705-841b133128b0
27892024-12-06T20:54:29.480ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 99dfd90b-ff92-45e8-a73e-ada9e3f552c8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27902024-12-06T20:54:29.480ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_99dfd90b-ff92-45e8-a73e-ada9e3f552c8
27912024-12-06T20:54:29.484ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57222
27922024-12-06T20:54:29.484ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62192
27932024-12-06T20:54:29.484ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 356 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57222 req_id = 0c6f4138-704c-4c12-b602-622b7006ac16 response_code = 200 uri = /v2p
27942024-12-06T20:54:29.484ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27952024-12-06T20:54:29.489ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1253 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54513 req_id = 16e9fe89-61ac-4f89-a2f6-023e30b5e306 response_code = 204 uri = /vpc-routes
27962024-12-06T20:54:29.512ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3b3acf4c-a316-45ce-a055-ef8d6c8acdff (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27972024-12-06T20:54:29.512ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_3b3acf4c-a316-45ce-a055-ef8d6c8acdff
27982024-12-06T20:54:29.519ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64438
27992024-12-06T20:54:29.522ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47237
28002024-12-06T20:54:29.522ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47237 req_id = 3aec8669-9d9b-4408-a3ce-5a9e015f116b response_code = 200 uri = /v2p
28012024-12-06T20:54:29.530ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
28022024-12-06T20:54:29.539ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5f5a9c7a-eec2-4e86-a02e-9238700fe7ab (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28032024-12-06T20:54:29.539ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_5f5a9c7a-eec2-4e86-a02e-9238700fe7ab
28042024-12-06T20:54:29.568ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8e389ddd-65e9-4954-ab37-e305d4d4e112 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28052024-12-06T20:54:29.568ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_8e389ddd-65e9-4954-ab37-e305d4d4e112
28062024-12-06T20:54:29.595ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f3f86fa8-b3a1-409b-95c8-f426058deed7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28072024-12-06T20:54:29.595ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_f3f86fa8-b3a1-409b-95c8-f426058deed7
28082024-12-06T20:54:29.600ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
28092024-12-06T20:54:29.600ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115757 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:62192 req_id = e75e9ede-bef7-4a68-adff-96a00bc20eb7 response_code = 204 uri = /switch-ports
28102024-12-06T20:54:29.604ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 740 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62192 req_id = 3e10852c-2ad4-4ab5-8d45-438fd9854380 response_code = 200 uri = /network-bootstore-config
28112024-12-06T20:54:29.621ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2f3ff39c-4b18-4b96-8fb8-fbd672d6202f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28122024-12-06T20:54:29.621ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_2f3ff39c-4b18-4b96-8fb8-fbd672d6202f
28132024-12-06T20:54:29.638ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41790
28142024-12-06T20:54:29.639ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 525aa886-e2b8-42b8-b1c9-cbf16e16e174, kind: Service { id: 59b92633-3550-4af1-b628-503b6bafd00d }, name: Name("external-dns-59b92633-3550-4af1-b628-503b6bafd00d"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 169])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7ff7e7d1-13cc-4538-9fce-dfd74792a288, kind: Service { id: 9d99eda0-389f-44c6-94ee-e9e7a03c9733 }, name: Name("external-dns-9d99eda0-389f-44c6-94ee-e9e7a03c9733"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 221, 96])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 176e274c-5ddd-4aa2-b53c-05e8fe632337, kind: Service { id: 3965e738-3305-4fcd-9da0-4c6e0ce7edc1 }, name: Name("nexus-3965e738-3305-4fcd-9da0-4c6e0ce7edc1"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 170, 95])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 75143dec-1fa4-42e5-a888-c77d19a4a83f, kind: Service { id: e9fe68b0-d53c-4161-a621-681677d5b0d6 }, name: Name("nexus-e9fe68b0-d53c-4161-a621-681677d5b0d6"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 243, 69])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9a966830-c35d-4c5c-bab6-585ffc135908, kind: Service { id: fd12fb4f-e62d-4cab-a4bd-2024f2546d3b }, name: Name("nexus-fd12fb4f-e62d-4cab-a4bd-2024f2546d3b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 247, 18])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
28152024-12-06T20:54:29.639ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28162024-12-06T20:54:29.639ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
28172024-12-06T20:54:29.639ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
28182024-12-06T20:54:29.639ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28192024-12-06T20:54:29.639ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28202024-12-06T20:54:29.639ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28212024-12-06T20:54:29.639ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28222024-12-06T20:54:29.642ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3702 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41790 req_id = 494da710-5129-4789-a329-7d63e730ec0f response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
28232024-12-06T20:54:29.645ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 33ce0168-de47-475b-9a15-5a0cd6252cb6 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28242024-12-06T20:54:29.645ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_33ce0168-de47-475b-9a15-5a0cd6252cb6
28252024-12-06T20:54:29.667ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 43474e0b-a6d6-4842-bf66-1060f52875b1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28262024-12-06T20:54:29.667ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_43474e0b-a6d6-4842-bf66-1060f52875b1
28272024-12-06T20:54:29.681ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 250409 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45347 req_id = 2f3832c2-f69d-40e8-a674-41ef6a96f187 response_code = 200 uri = /inventory
28282024-12-06T20:54:29.697ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56887
28292024-12-06T20:54:29.698ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 525aa886-e2b8-42b8-b1c9-cbf16e16e174, kind: Service { id: 59b92633-3550-4af1-b628-503b6bafd00d }, name: Name("external-dns-59b92633-3550-4af1-b628-503b6bafd00d"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 169])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7ff7e7d1-13cc-4538-9fce-dfd74792a288, kind: Service { id: 9d99eda0-389f-44c6-94ee-e9e7a03c9733 }, name: Name("external-dns-9d99eda0-389f-44c6-94ee-e9e7a03c9733"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 221, 96])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 176e274c-5ddd-4aa2-b53c-05e8fe632337, kind: Service { id: 3965e738-3305-4fcd-9da0-4c6e0ce7edc1 }, name: Name("nexus-3965e738-3305-4fcd-9da0-4c6e0ce7edc1"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 170, 95])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 75143dec-1fa4-42e5-a888-c77d19a4a83f, kind: Service { id: e9fe68b0-d53c-4161-a621-681677d5b0d6 }, name: Name("nexus-e9fe68b0-d53c-4161-a621-681677d5b0d6"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 243, 69])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9a966830-c35d-4c5c-bab6-585ffc135908, kind: Service { id: fd12fb4f-e62d-4cab-a4bd-2024f2546d3b }, name: Name("nexus-fd12fb4f-e62d-4cab-a4bd-2024f2546d3b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 247, 18])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
28302024-12-06T20:54:29.698ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28312024-12-06T20:54:29.698ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
28322024-12-06T20:54:29.698ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28332024-12-06T20:54:29.698ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28342024-12-06T20:54:29.698ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28352024-12-06T20:54:29.698ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28362024-12-06T20:54:29.698ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 507 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56887 req_id = 40937823-1889-4b8b-9de2-3e1f89903b83 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
28372024-12-06T20:54:29.699ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 179200 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:64438 req_id = 6085aab4-1bd2-492a-a0ad-b428d966dbcf response_code = 204 uri = /switch-ports
28382024-12-06T20:54:29.699ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64438 req_id = 767d3e22-ad1f-4ecb-a152-4f9608d51f95 response_code = 200 uri = /network-bootstore-config
28392024-12-06T20:54:30.354ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58842
28402024-12-06T20:54:30.354ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
28412024-12-06T20:54:30.354ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
28422024-12-06T20:54:30.354ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b9ab18cf-4dd7-46c3-920e-833f181cfe8b/config/omicron-zones.json file = common/src/ledger.rs:177
28432024-12-06T20:54:30.354ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/5a719d2c-fbf6-41ef-af9f-e6b70820ebd4/config/omicron-zones.json file = common/src/ledger.rs:177
28442024-12-06T20:54:30.366ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 50f60e54-9000-4b4d-8705-841b133128b0 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28452024-12-06T20:54:30.366ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_50f60e54-9000-4b4d-8705-841b133128b0
28462024-12-06T20:54:30.391ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 99dfd90b-ff92-45e8-a73e-ada9e3f552c8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28472024-12-06T20:54:30.391ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_99dfd90b-ff92-45e8-a73e-ada9e3f552c8
28482024-12-06T20:54:30.412ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3b3acf4c-a316-45ce-a055-ef8d6c8acdff (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28492024-12-06T20:54:30.412ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_3b3acf4c-a316-45ce-a055-ef8d6c8acdff
28502024-12-06T20:54:30.435ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5f5a9c7a-eec2-4e86-a02e-9238700fe7ab (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28512024-12-06T20:54:30.435ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_5f5a9c7a-eec2-4e86-a02e-9238700fe7ab
28522024-12-06T20:54:30.456ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8e389ddd-65e9-4954-ab37-e305d4d4e112 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28532024-12-06T20:54:30.456ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_8e389ddd-65e9-4954-ab37-e305d4d4e112
28542024-12-06T20:54:30.476ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f3f86fa8-b3a1-409b-95c8-f426058deed7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28552024-12-06T20:54:30.476ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_f3f86fa8-b3a1-409b-95c8-f426058deed7
28562024-12-06T20:54:30.482ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42956
28572024-12-06T20:54:30.482ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42956 req_id = c915f546-c1a4-4f5f-9f7a-d85a617ee565 response_code = 200 uri = /vpc-routes
28582024-12-06T20:54:30.495ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2f3ff39c-4b18-4b96-8fb8-fbd672d6202f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28592024-12-06T20:54:30.495ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_2f3ff39c-4b18-4b96-8fb8-fbd672d6202f
28602024-12-06T20:54:30.514ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 33ce0168-de47-475b-9a15-5a0cd6252cb6 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28612024-12-06T20:54:30.514ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_33ce0168-de47-475b-9a15-5a0cd6252cb6
28622024-12-06T20:54:30.527ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59909
28632024-12-06T20:54:30.528ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 238 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59909 req_id = 59c385c7-37e0-4bf5-b18a-1d03b322f70d response_code = 200 uri = /v2p
28642024-12-06T20:54:30.534ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 43474e0b-a6d6-4842-bf66-1060f52875b1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28652024-12-06T20:54:30.534ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_43474e0b-a6d6-4842-bf66-1060f52875b1
28662024-12-06T20:54:30.545ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 191669 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58842 req_id = b2757485-b1e1-4cfa-a539-a097233ca084 response_code = 200 uri = /inventory
28672024-12-06T20:54:30.575ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 values = ExternalIpGatewayMap { mappings: {} }
28682024-12-06T20:54:30.575ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42956 req_id = 652f676e-e005-4653-840e-209cfd200183 response_code = 204 uri = /eip-gateways
28692024-12-06T20:54:30.585ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 430 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42956 req_id = 552e3e7c-0be9-4404-8c07-f7a210fa1668 response_code = 204 uri = /vpc-routes
28702024-12-06T20:54:30.795ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48554
28712024-12-06T20:54:30.796ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 525aa886-e2b8-42b8-b1c9-cbf16e16e174, kind: Service { id: 59b92633-3550-4af1-b628-503b6bafd00d }, name: Name("external-dns-59b92633-3550-4af1-b628-503b6bafd00d"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 169])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7ff7e7d1-13cc-4538-9fce-dfd74792a288, kind: Service { id: 9d99eda0-389f-44c6-94ee-e9e7a03c9733 }, name: Name("external-dns-9d99eda0-389f-44c6-94ee-e9e7a03c9733"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 221, 96])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 176e274c-5ddd-4aa2-b53c-05e8fe632337, kind: Service { id: 3965e738-3305-4fcd-9da0-4c6e0ce7edc1 }, name: Name("nexus-3965e738-3305-4fcd-9da0-4c6e0ce7edc1"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 170, 95])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 75143dec-1fa4-42e5-a888-c77d19a4a83f, kind: Service { id: e9fe68b0-d53c-4161-a621-681677d5b0d6 }, name: Name("nexus-e9fe68b0-d53c-4161-a621-681677d5b0d6"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 243, 69])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9a966830-c35d-4c5c-bab6-585ffc135908, kind: Service { id: fd12fb4f-e62d-4cab-a4bd-2024f2546d3b }, name: Name("nexus-fd12fb4f-e62d-4cab-a4bd-2024f2546d3b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 247, 18])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
28722024-12-06T20:54:30.796ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28732024-12-06T20:54:30.796ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
28742024-12-06T20:54:30.796ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28752024-12-06T20:54:30.796ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28762024-12-06T20:54:30.796ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28772024-12-06T20:54:30.796ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28782024-12-06T20:54:30.796ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 254 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48554 req_id = 9db450c1-e7b3-4cb6-8a51-9a14dde3d319 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
28792024-12-06T20:54:30.802ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38170
28802024-12-06T20:54:30.803ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
28812024-12-06T20:54:30.803ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
28822024-12-06T20:54:30.803ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b9ab18cf-4dd7-46c3-920e-833f181cfe8b/config/omicron-zones.json file = common/src/ledger.rs:177
28832024-12-06T20:54:30.803ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/5a719d2c-fbf6-41ef-af9f-e6b70820ebd4/config/omicron-zones.json file = common/src/ledger.rs:177
28842024-12-06T20:54:30.814ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 50f60e54-9000-4b4d-8705-841b133128b0 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28852024-12-06T20:54:30.814ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_50f60e54-9000-4b4d-8705-841b133128b0
28862024-12-06T20:54:30.821ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48051
28872024-12-06T20:54:30.821ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
28882024-12-06T20:54:30.837ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 99dfd90b-ff92-45e8-a73e-ada9e3f552c8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28892024-12-06T20:54:30.837ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_99dfd90b-ff92-45e8-a73e-ada9e3f552c8
28902024-12-06T20:54:30.857ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
28912024-12-06T20:54:30.860ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3b3acf4c-a316-45ce-a055-ef8d6c8acdff (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28922024-12-06T20:54:30.860ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_3b3acf4c-a316-45ce-a055-ef8d6c8acdff
28932024-12-06T20:54:30.883ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5f5a9c7a-eec2-4e86-a02e-9238700fe7ab (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28942024-12-06T20:54:30.883ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_5f5a9c7a-eec2-4e86-a02e-9238700fe7ab
28952024-12-06T20:54:30.905ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8e389ddd-65e9-4954-ab37-e305d4d4e112 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28962024-12-06T20:54:30.905ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_8e389ddd-65e9-4954-ab37-e305d4d4e112
28972024-12-06T20:54:30.914ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92909 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48051 req_id = 825a7059-fd54-437c-8269-3680cf3ed732 response_code = 204 uri = /switch-ports
28982024-12-06T20:54:30.914ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48051 req_id = 5d5fb451-601f-410c-854b-e1f26b205995 response_code = 200 uri = /network-bootstore-config
28992024-12-06T20:54:30.926ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f3f86fa8-b3a1-409b-95c8-f426058deed7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29002024-12-06T20:54:30.926ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_f3f86fa8-b3a1-409b-95c8-f426058deed7
29012024-12-06T20:54:30.946ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2f3ff39c-4b18-4b96-8fb8-fbd672d6202f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29022024-12-06T20:54:30.946ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_2f3ff39c-4b18-4b96-8fb8-fbd672d6202f
29032024-12-06T20:54:30.968ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 33ce0168-de47-475b-9a15-5a0cd6252cb6 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29042024-12-06T20:54:30.968ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_33ce0168-de47-475b-9a15-5a0cd6252cb6
29052024-12-06T20:54:30.988ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 43474e0b-a6d6-4842-bf66-1060f52875b1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29062024-12-06T20:54:30.988ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_43474e0b-a6d6-4842-bf66-1060f52875b1
29072024-12-06T20:54:31.001ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 198636 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38170 req_id = fa6035d3-1b9a-4585-b0a9-eb73ffa69ce6 response_code = 200 uri = /inventory
29082024-12-06T20:54:50.926ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:41893
29092024-12-06T20:54:50.926ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:41893 req_id = bd4dca14-11c9-408f-9ed0-91f370d7c014 response_code = 200 uri = /baseboard
29102024-12-06T20:54:57.417ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7237 local_addr = [fd00:1122:3344:101::1]:45033 method = GET remote_addr = [fd00:1122:3344:101::d]:44003 req_id = 096c4554-0bc2-4c2c-930a-d43484d70bd5 response_code = 200 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 uri = /0a667526-2006-419e-9b68-c251fd138c06
29112024-12-06T20:54:59.012ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56600
29122024-12-06T20:54:59.012ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56600 req_id = 18a90af6-fccf-47e7-a781-8a3e3759c21c response_code = 200 uri = /vpc-routes
29132024-12-06T20:54:59.090ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 values = ExternalIpGatewayMap { mappings: {} }
29142024-12-06T20:54:59.090ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56600 req_id = 102b7f85-58a9-40a5-9679-3728b455f10e response_code = 204 uri = /eip-gateways
29152024-12-06T20:54:59.103ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 206 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56600 req_id = 2089168e-dd63-46c5-bda6-4da9ea59a84b response_code = 204 uri = /vpc-routes
29162024-12-06T20:54:59.122ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33161
29172024-12-06T20:54:59.123ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33161 req_id = 10ade34d-6465-4f04-b6a9-696ed10eadc8 response_code = 200 uri = /vpc-routes
29182024-12-06T20:54:59.141ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 values = ExternalIpGatewayMap { mappings: {} }
29192024-12-06T20:54:59.141ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33161 req_id = f639ac20-6122-4559-b932-8c487d3807ed response_code = 204 uri = /eip-gateways
29202024-12-06T20:54:59.152ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 325 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33161 req_id = ebfe99a5-62f8-4e3a-b4c6-f88005329e2a response_code = 204 uri = /vpc-routes
29212024-12-06T20:54:59.195ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45731
29222024-12-06T20:54:59.196ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 208 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45731 req_id = 24063f26-a853-454b-aae9-afe4828d0a9c response_code = 200 uri = /v2p
29232024-12-06T20:54:59.208ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49813
29242024-12-06T20:54:59.208ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
29252024-12-06T20:54:59.214ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61010
29262024-12-06T20:54:59.233ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48110
29272024-12-06T20:54:59.233ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 184 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48110 req_id = efb0e39e-2ed6-4a28-82f4-49c58be4f28c response_code = 200 uri = /v2p
29282024-12-06T20:54:59.247ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
29292024-12-06T20:54:59.301ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
29302024-12-06T20:54:59.301ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92584 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:49813 req_id = 772bab28-32f4-42fa-a8ce-a3b92627b426 response_code = 204 uri = /switch-ports
29312024-12-06T20:54:59.305ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 718 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49813 req_id = a6999d81-0a33-4920-8079-03f420cf299d response_code = 200 uri = /network-bootstore-config
29322024-12-06T20:54:59.335ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
29332024-12-06T20:54:59.389ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 174897 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:61010 req_id = de42e36f-1849-4962-bf61-5aa5aa7ef98a response_code = 204 uri = /switch-ports
29342024-12-06T20:54:59.389ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61010 req_id = 3689d9c6-945c-4592-b0e6-2a72f473d196 response_code = 200 uri = /network-bootstore-config
29352024-12-06T20:55:00.349ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58605
29362024-12-06T20:55:00.349ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58605 req_id = 2181f5d7-16ec-4cec-8a72-0b4ee7a08ab6 response_code = 200 uri = /vpc-routes
29372024-12-06T20:55:00.395ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 values = ExternalIpGatewayMap { mappings: {} }
29382024-12-06T20:55:00.395ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58605 req_id = 31022f65-20aa-410e-85d6-624303a1e22d response_code = 204 uri = /eip-gateways
29392024-12-06T20:55:00.404ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58605 req_id = a587cbbd-c760-4080-aa2b-083e0d6ad56c response_code = 204 uri = /vpc-routes
29402024-12-06T20:55:00.452ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58995
29412024-12-06T20:55:00.452ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58995 req_id = 07f52bea-006c-4712-b76c-07583ee2445d response_code = 200 uri = /v2p
29422024-12-06T20:55:00.484ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50580
29432024-12-06T20:55:00.484ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
29442024-12-06T20:55:00.522ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
29452024-12-06T20:55:00.577ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92053 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:50580 req_id = 81d15a72-efc5-4767-8bfb-ba16ed1e084a response_code = 204 uri = /switch-ports
29462024-12-06T20:55:00.577ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50580 req_id = 5c005cec-cbf5-43ac-aac6-d2792627138c response_code = 200 uri = /network-bootstore-config
29472024-12-06T20:55:20.958ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:47137
29482024-12-06T20:55:20.958ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:47137 req_id = 99c61617-c1b6-49bd-99d2-b32b10228b74 response_code = 200 uri = /baseboard
29492024-12-06T20:55:27.417ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7915 local_addr = [fd00:1122:3344:101::1]:45033 method = GET remote_addr = [fd00:1122:3344:101::d]:44003 req_id = b2ecd761-95ad-42a3-8994-7f1c5ac68ec1 response_code = 200 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 uri = /0a667526-2006-419e-9b68-c251fd138c06
29502024-12-06T20:55:29.237ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42214
29512024-12-06T20:55:29.238ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42214 req_id = f09c279b-d708-4ed7-b527-013c3e72f59b response_code = 200 uri = /vpc-routes
29522024-12-06T20:55:29.249ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33392
29532024-12-06T20:55:29.249ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33392 req_id = 1bda601a-071d-4697-bc31-b3e4a7b44e26 response_code = 200 uri = /vpc-routes
29542024-12-06T20:55:29.264ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 values = ExternalIpGatewayMap { mappings: {} }
29552024-12-06T20:55:29.264ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42214 req_id = d36a9611-74ab-406a-8942-bb4a443de84b response_code = 204 uri = /eip-gateways
29562024-12-06T20:55:29.277ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 361 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42214 req_id = eee24760-bfcb-4bc8-8608-53689370c584 response_code = 204 uri = /vpc-routes
29572024-12-06T20:55:29.316ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 values = ExternalIpGatewayMap { mappings: {} }
29582024-12-06T20:55:29.316ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33392 req_id = 7fa827ba-5b2c-4912-ae02-ba40b44491de response_code = 204 uri = /eip-gateways
29592024-12-06T20:55:29.328ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 266 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33392 req_id = 0114785c-4631-415d-9f55-d8703274aa84 response_code = 204 uri = /vpc-routes
29602024-12-06T20:55:29.335ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61371
29612024-12-06T20:55:29.335ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61371 req_id = ca3cac4e-c304-4612-ac90-8941a24bb036 response_code = 200 uri = /v2p
29622024-12-06T20:55:29.419ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44196
29632024-12-06T20:55:29.419ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44196 req_id = 1782f574-8564-40df-a75d-5f6a42a90937 response_code = 200 uri = /v2p
29642024-12-06T20:55:29.448ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44343
29652024-12-06T20:55:29.448ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
29662024-12-06T20:55:29.486ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
29672024-12-06T20:55:29.543ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95500 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:44343 req_id = cbf81758-d139-4024-9d19-13882080e141 response_code = 204 uri = /switch-ports
29682024-12-06T20:55:29.544ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60879
29692024-12-06T20:55:29.544ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 224 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44343 req_id = 72dce35c-12a0-4363-82fe-5f3419b00c4a response_code = 200 uri = /network-bootstore-config
29702024-12-06T20:55:29.544ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
29712024-12-06T20:55:29.581ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
29722024-12-06T20:55:29.633ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89281 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:60879 req_id = d9ddb79a-eb6f-471f-9365-bb4f02cd4079 response_code = 204 uri = /switch-ports
29732024-12-06T20:55:29.633ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60879 req_id = f474ce1e-a22e-4b40-b70f-47763748058d response_code = 200 uri = /network-bootstore-config
29742024-12-06T20:55:30.269ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57599
29752024-12-06T20:55:30.270ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57599 req_id = ee8dc0d8-5e50-4ef8-8d02-38f5e214251a response_code = 200 uri = /vpc-routes
29762024-12-06T20:55:30.353ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 values = ExternalIpGatewayMap { mappings: {} }
29772024-12-06T20:55:30.353ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57599 req_id = a57a6ccd-4941-4cdd-bfc5-bb276f5f1cbe response_code = 204 uri = /eip-gateways
29782024-12-06T20:55:30.362ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 199 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57599 req_id = cf3a4443-d53f-4d78-8b71-74d6dff0b28a response_code = 204 uri = /vpc-routes
29792024-12-06T20:55:30.556ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61867
29802024-12-06T20:55:30.556ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61867 req_id = 4a6cedb2-fbc1-4eec-8afa-3900e411aae3 response_code = 200 uri = /v2p
29812024-12-06T20:55:30.580ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60265
29822024-12-06T20:55:30.580ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
29832024-12-06T20:55:30.616ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
29842024-12-06T20:55:30.671ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90481 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:60265 req_id = 2ab0ef66-0f4c-4cab-a58c-57e627cc628f response_code = 204 uri = /switch-ports
29852024-12-06T20:55:30.671ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60265 req_id = e8746ea7-982c-4b66-8826-d29878c1eb0f response_code = 200 uri = /network-bootstore-config
29862024-12-06T20:55:33.563ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
29872024-12-06T20:55:50.991ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:35048
29882024-12-06T20:55:50.991ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:35048 req_id = fad9f704-9475-42da-aaba-eeecd23f6a99 response_code = 200 uri = /baseboard
29892024-12-06T20:55:57.415ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6391 local_addr = [fd00:1122:3344:101::1]:45033 method = GET remote_addr = [fd00:1122:3344:101::d]:44003 req_id = c83388cb-1828-43aa-8a8a-ade52f0a1c4a response_code = 200 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 uri = /0a667526-2006-419e-9b68-c251fd138c06
29902024-12-06T20:55:59.059ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53789
29912024-12-06T20:55:59.059ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53789 req_id = 4013f87c-3e91-4563-b4fb-c0da607cc8cc response_code = 200 uri = /vpc-routes
29922024-12-06T20:55:59.106ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 values = ExternalIpGatewayMap { mappings: {} }
29932024-12-06T20:55:59.106ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53789 req_id = c94d56d8-99d8-405d-badc-28eca15dd38a response_code = 204 uri = /eip-gateways
29942024-12-06T20:55:59.115ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 200 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53789 req_id = 69fb7f96-9bd8-4da9-8b87-4f33d40d32d5 response_code = 204 uri = /vpc-routes
29952024-12-06T20:55:59.137ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47960
29962024-12-06T20:55:59.137ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 29 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47960 req_id = b579b822-3afe-44df-802e-cc966d1dc83d response_code = 200 uri = /vpc-routes
29972024-12-06T20:55:59.153ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 values = ExternalIpGatewayMap { mappings: {} }
29982024-12-06T20:55:59.153ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47960 req_id = 53897223-9138-410d-938f-06f39590a031 response_code = 204 uri = /eip-gateways
29992024-12-06T20:55:59.161ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 214 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47960 req_id = 327a6b3d-19e5-4cf6-9a88-ad56fae49413 response_code = 204 uri = /vpc-routes
30002024-12-06T20:55:59.186ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34173
30012024-12-06T20:55:59.186ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34173 req_id = 703f2b03-89a1-42f9-b3fb-03bd255dc842 response_code = 200 uri = /v2p
30022024-12-06T20:55:59.233ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42014
30032024-12-06T20:55:59.233ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
30042024-12-06T20:55:59.271ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
30052024-12-06T20:55:59.326ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92837 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:42014 req_id = 93377b06-35f2-42b6-8640-2ea1dd1c8473 response_code = 204 uri = /switch-ports
30062024-12-06T20:55:59.326ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42014 req_id = 015cd14c-57f9-4d08-bddf-9ad38fdf38e6 response_code = 200 uri = /network-bootstore-config
30072024-12-06T20:55:59.328ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53835
30082024-12-06T20:55:59.328ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 183 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53835 req_id = 10865f57-8ed4-4a65-b771-1272ea29bdff response_code = 200 uri = /v2p
30092024-12-06T20:55:59.366ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58786
30102024-12-06T20:55:59.366ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
30112024-12-06T20:55:59.402ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
30122024-12-06T20:55:59.456ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89716 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:58786 req_id = e872d2a0-15c0-4915-b459-b9c8db4a5f28 response_code = 204 uri = /switch-ports
30132024-12-06T20:55:59.456ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58786 req_id = 1a69a7c3-60f5-4c64-a4a3-169ffa630a04 response_code = 200 uri = /network-bootstore-config
30142024-12-06T20:56:00.288ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54744
30152024-12-06T20:56:00.289ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54744 req_id = 1f2e42e6-bf1e-43b4-8267-094579d1a4f4 response_code = 200 uri = /vpc-routes
30162024-12-06T20:56:00.334ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 values = ExternalIpGatewayMap { mappings: {} }
30172024-12-06T20:56:00.334ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54744 req_id = 0b8f3a04-02eb-4381-8e9e-922768b5fcfc response_code = 204 uri = /eip-gateways
30182024-12-06T20:56:00.345ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 270 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54744 req_id = f0c831ad-d846-4661-a07b-e0f2e08533ab response_code = 204 uri = /vpc-routes
30192024-12-06T20:56:00.373ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61023
30202024-12-06T20:56:00.373ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61023 req_id = f8eb09b9-96ae-47cc-8e6f-67ac2a97f5cd response_code = 200 uri = /v2p
30212024-12-06T20:56:00.400ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41527
30222024-12-06T20:56:00.400ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
30232024-12-06T20:56:00.441ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
30242024-12-06T20:56:00.497ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96634 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:41527 req_id = 1685facd-7a03-491c-aef9-eabde1158e37 response_code = 204 uri = /switch-ports
30252024-12-06T20:56:00.497ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41527 req_id = eb5d2974-ecbc-4bb6-9362-d988d2f35c68 response_code = 200 uri = /network-bootstore-config
30262024-12-06T20:56:21.025ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:47378
30272024-12-06T20:56:21.025ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:47378 req_id = 4d85de6a-f6f4-4707-a3af-7f54308800ac response_code = 200 uri = /baseboard
30282024-12-06T20:56:27.415ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6212 local_addr = [fd00:1122:3344:101::1]:45033 method = GET remote_addr = [fd00:1122:3344:101::d]:44003 req_id = f4c59ff6-66a3-4ae0-ab77-a3255f8fd1b4 response_code = 200 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 uri = /0a667526-2006-419e-9b68-c251fd138c06
30292024-12-06T20:56:29.253ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48246
30302024-12-06T20:56:29.253ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48246 req_id = 539cecde-18dd-4ce3-a568-f987de60bd53 response_code = 200 uri = /vpc-routes
30312024-12-06T20:56:29.292ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65414
30322024-12-06T20:56:29.292ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65414 req_id = cf32664c-27f0-4ca2-b1e1-b53840c380ec response_code = 200 uri = /vpc-routes
30332024-12-06T20:56:29.308ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 values = ExternalIpGatewayMap { mappings: {} }
30342024-12-06T20:56:29.308ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48246 req_id = fdda050c-fbb2-4441-bff2-4d988d86942b response_code = 204 uri = /eip-gateways
30352024-12-06T20:56:29.319ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 210 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48246 req_id = 80ede898-8165-4025-94ee-0a3569fa6aa7 response_code = 204 uri = /vpc-routes
30362024-12-06T20:56:29.382ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51051
30372024-12-06T20:56:29.383ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51051 req_id = 76fe522a-9354-4975-8a28-0d78fe82b0ac response_code = 200 uri = /v2p
30382024-12-06T20:56:29.412ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64567
30392024-12-06T20:56:29.413ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64567 req_id = 2c50f851-877e-40f8-9cde-e8e0dea31d59 response_code = 200 uri = /v2p
30402024-12-06T20:56:29.430ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34201
30412024-12-06T20:56:29.431ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
30422024-12-06T20:56:29.485ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
30432024-12-06T20:56:29.567ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 136817 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:34201 req_id = 8f40c852-6c9a-4f39-ba53-dc56b5d413c0 response_code = 204 uri = /switch-ports
30442024-12-06T20:56:29.568ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57120
30452024-12-06T20:56:29.568ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 values = ExternalIpGatewayMap { mappings: {} }
30462024-12-06T20:56:29.568ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 196 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65414 req_id = d2910d0c-d2cc-4f9e-b4aa-9590335049ac response_code = 204 uri = /eip-gateways
30472024-12-06T20:56:29.568ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
30482024-12-06T20:56:29.573ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4803 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34201 req_id = 379f0e88-85dd-48a9-a61a-3e1179614859 response_code = 200 uri = /network-bootstore-config
30492024-12-06T20:56:29.580ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 342 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65414 req_id = 0a75cb61-5ea4-4049-9043-d614b873fe3a response_code = 204 uri = /vpc-routes
30502024-12-06T20:56:29.608ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
30512024-12-06T20:56:29.663ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95216 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:57120 req_id = 01c1ba55-9daf-44ae-b327-6ded8472f81b response_code = 204 uri = /switch-ports
30522024-12-06T20:56:29.663ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57120 req_id = 32c8b7b7-fe99-4c1f-806f-9461114c7462 response_code = 200 uri = /network-bootstore-config
30532024-12-06T20:56:30.410ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51569
30542024-12-06T20:56:30.410ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51569 req_id = b55445bf-8ace-4580-a5dd-12f862a3fcce response_code = 200 uri = /vpc-routes
30552024-12-06T20:56:30.453ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 values = ExternalIpGatewayMap { mappings: {} }
30562024-12-06T20:56:30.453ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51569 req_id = 9a1410a3-a076-4d55-929d-27a802690bb9 response_code = 204 uri = /eip-gateways
30572024-12-06T20:56:30.504ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56257
30582024-12-06T20:56:30.504ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56257 req_id = cccf07d4-fe47-45aa-8c8f-fb70e5f31ae3 response_code = 200 uri = /v2p
30592024-12-06T20:56:30.510ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 206 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51569 req_id = 7455b516-d202-42c1-8f94-784c91e7a22d response_code = 204 uri = /vpc-routes
30602024-12-06T20:56:30.599ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64065
30612024-12-06T20:56:30.599ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
30622024-12-06T20:56:30.640ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
30632024-12-06T20:56:30.699ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100110 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:64065 req_id = 0af73673-689b-4a81-9b0b-32cdc649765e response_code = 204 uri = /switch-ports
30642024-12-06T20:56:30.700ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 245 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64065 req_id = 68acc690-e59a-4d89-8114-824bc68cf879 response_code = 200 uri = /network-bootstore-config
30652024-12-06T20:56:43.931ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55982
30662024-12-06T20:56:43.932ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 230 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55982 req_id = 142b346c-cfab-49ef-9e0d-470bbb060d8a response_code = 200 uri = /v2p
30672024-12-06T20:56:43.932ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:874 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(6629825) }
30682024-12-06T20:56:43.932ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 623 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55982 req_id = 0fb90d58-426e-44f7-b7d0-eb0ccbd715b9 response_code = 204 uri = /v2p
30692024-12-06T20:56:44.044ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51077
30702024-12-06T20:56:44.048ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:555 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 6b2b7eab-a7a3-488e-8a11-aefb815fdab9, kind: Instance { id: 8e6b6db4-837f-4eb1-b0b2-b51d7f30c978 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(6629825), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6b2b7eab-a7a3-488e-8a11-aefb815fdab9, kind: Instance { id: 8e6b6db4-837f-4eb1-b0b2-b51d7f30c978 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(6629825), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6b2b7eab-a7a3-488e-8a11-aefb815fdab9, kind: Instance { id: 8e6b6db4-837f-4eb1-b0b2-b51d7f30c978 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(6629825), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(6629825))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6b2b7eab-a7a3-488e-8a11-aefb815fdab9, kind: Instance { id: 8e6b6db4-837f-4eb1-b0b2-b51d7f30c978 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(6629825), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [InstanceDisk { disk_id: 36b9a86e-4428-46b6-96f7-e6da9758d580, slot: 0, read_only: false, vcr_json: .., name: "disk-e6e9dab6045" }], boot_settings: Some(InstanceBootSettings { order: [36b9a86e-4428-46b6-96f7-e6da9758d580] }), cloud_init_bytes: Some(..) } instance_id = 8e6b6db4-837f-4eb1-b0b2-b51d7f30c978 metadata = InstanceMetadata { silo_id: 435e56bf-fa70-439f-8ad1-7c07c9948190, project_id: b8c9ca73-67e6-4aea-b6fc-902530f58ce8 } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = 92607f49-ba1c-4ddf-87a1-60c0c155ce79 vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-12-06T20:56:44.041563511Z }
30712024-12-06T20:56:44.048ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:588 instance_id = 8e6b6db4-837f-4eb1-b0b2-b51d7f30c978 migration_id = None propolis_id = 92607f49-ba1c-4ddf-87a1-60c0c155ce79
30722024-12-06T20:56:44.048ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1476 instance_id = 8e6b6db4-837f-4eb1-b0b2-b51d7f30c978 migration_id = None propolis_id = 92607f49-ba1c-4ddf-87a1-60c0c155ce79 state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 6b2b7eab-a7a3-488e-8a11-aefb815fdab9, kind: Instance { id: 8e6b6db4-837f-4eb1-b0b2-b51d7f30c978 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(6629825), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6b2b7eab-a7a3-488e-8a11-aefb815fdab9, kind: Instance { id: 8e6b6db4-837f-4eb1-b0b2-b51d7f30c978 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(6629825), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6b2b7eab-a7a3-488e-8a11-aefb815fdab9, kind: Instance { id: 8e6b6db4-837f-4eb1-b0b2-b51d7f30c978 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(6629825), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(6629825))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6b2b7eab-a7a3-488e-8a11-aefb815fdab9, kind: Instance { id: 8e6b6db4-837f-4eb1-b0b2-b51d7f30c978 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(6629825), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [InstanceDisk { disk_id: 36b9a86e-4428-46b6-96f7-e6da9758d580, slot: 0, read_only: false, vcr_json: .., name: "disk-e6e9dab6045" }], boot_settings: Some(InstanceBootSettings { order: [36b9a86e-4428-46b6-96f7-e6da9758d580] }), cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-12-06T20:56:44.041563511Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
30732024-12-06T20:56:44.048ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4650 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51077 req_id = e6f556aa-8ea0-47c7-9bd6-b88d4ac3ded2 response_code = 200 uri = /vmms/92607f49-ba1c-4ddf-87a1-60c0c155ce79
30742024-12-06T20:56:44.158ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38825
30752024-12-06T20:56:44.159ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1040 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38825 req_id = 22c13751-8c7d-4ab7-b7c5-4911fdd91a3f response_code = 200 uri = /vmms/92607f49-ba1c-4ddf-87a1-60c0c155ce79/state
30762024-12-06T20:56:44.159ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 6629825 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
30772024-12-06T20:56:44.159ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
30782024-12-06T20:56:44.195ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_92607f49-ba1c-4ddf-87a1-60c0c155ce79 file = illumos-utils/src/zone.rs:325 instance_id = 8e6b6db4-837f-4eb1-b0b2-b51d7f30c978 propolis_id = 92607f49-ba1c-4ddf-87a1-60c0c155ce79
30792024-12-06T20:56:44.219ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_92607f49-ba1c-4ddf-87a1-60c0c155ce79 file = illumos-utils/src/zone.rs:363 instance_id = 8e6b6db4-837f-4eb1-b0b2-b51d7f30c978 propolis_id = 92607f49-ba1c-4ddf-87a1-60c0c155ce79
30802024-12-06T20:56:44.235ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35577
30812024-12-06T20:56:44.235ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35577 req_id = be6e50a5-866f-41dc-a5af-215dc4b51bc3 response_code = 200 uri = /vpc-routes
30822024-12-06T20:56:44.259ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 values = ExternalIpGatewayMap { mappings: {6b2b7eab-a7a3-488e-8a11-aefb815fdab9: {10.151.2.176: {8dd4f499-a809-40eb-9cb9-0aeb312d5997}, 10.151.2.175: {8dd4f499-a809-40eb-9cb9-0aeb312d5997}}} }
30832024-12-06T20:56:45.444ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_92607f49-ba1c-4ddf-87a1-60c0c155ce79: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = 8e6b6db4-837f-4eb1-b0b2-b51d7f30c978 propolis_id = 92607f49-ba1c-4ddf-87a1-60c0c155ce79
30842024-12-06T20:56:45.445ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_92607f49-ba1c-4ddf-87a1-60c0c155ce79 zone file = illumos-utils/src/running_zone.rs:488 instance_id = 8e6b6db4-837f-4eb1-b0b2-b51d7f30c978 propolis_id = 92607f49-ba1c-4ddf-87a1-60c0c155ce79 zone = oxz_propolis-server_92607f49-ba1c-4ddf-87a1-60c0c155ce79
30852024-12-06T20:56:45.650ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_92607f49-ba1c-4ddf-87a1-60c0c155ce79") failed: Property not found. retry in 59.194073ms file = illumos-utils/src/svc.rs:36 instance_id = 8e6b6db4-837f-4eb1-b0b2-b51d7f30c978 propolis_id = 92607f49-ba1c-4ddf-87a1-60c0c155ce79 zone = oxz_propolis-server_92607f49-ba1c-4ddf-87a1-60c0c155ce79
30862024-12-06T20:56:45.725ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_92607f49-ba1c-4ddf-87a1-60c0c155ce79") failed: Property not found. retry in 116.254392ms file = illumos-utils/src/svc.rs:36 instance_id = 8e6b6db4-837f-4eb1-b0b2-b51d7f30c978 propolis_id = 92607f49-ba1c-4ddf-87a1-60c0c155ce79 zone = oxz_propolis-server_92607f49-ba1c-4ddf-87a1-60c0c155ce79
30872024-12-06T20:56:45.856ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_92607f49-ba1c-4ddf-87a1-60c0c155ce79") failed: Property not found. retry in 262.450946ms file = illumos-utils/src/svc.rs:36 instance_id = 8e6b6db4-837f-4eb1-b0b2-b51d7f30c978 propolis_id = 92607f49-ba1c-4ddf-87a1-60c0c155ce79 zone = oxz_propolis-server_92607f49-ba1c-4ddf-87a1-60c0c155ce79
30882024-12-06T20:56:46.133ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_92607f49-ba1c-4ddf-87a1-60c0c155ce79") failed: Property not found. retry in 254.941663ms file = illumos-utils/src/svc.rs:36 instance_id = 8e6b6db4-837f-4eb1-b0b2-b51d7f30c978 propolis_id = 92607f49-ba1c-4ddf-87a1-60c0c155ce79 zone = oxz_propolis-server_92607f49-ba1c-4ddf-87a1-60c0c155ce79
30892024-12-06T20:56:46.400ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_92607f49-ba1c-4ddf-87a1-60c0c155ce79") failed: Property not found. retry in 684.15246ms file = illumos-utils/src/svc.rs:36 instance_id = 8e6b6db4-837f-4eb1-b0b2-b51d7f30c978 propolis_id = 92607f49-ba1c-4ddf-87a1-60c0c155ce79 zone = oxz_propolis-server_92607f49-ba1c-4ddf-87a1-60c0c155ce79
30902024-12-06T20:56:47.100ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_92607f49-ba1c-4ddf-87a1-60c0c155ce79") failed: Property not found. retry in 521.984569ms file = illumos-utils/src/svc.rs:36 instance_id = 8e6b6db4-837f-4eb1-b0b2-b51d7f30c978 propolis_id = 92607f49-ba1c-4ddf-87a1-60c0c155ce79 zone = oxz_propolis-server_92607f49-ba1c-4ddf-87a1-60c0c155ce79
30912024-12-06T20:56:47.634ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_92607f49-ba1c-4ddf-87a1-60c0c155ce79") failed: Property not found. retry in 1.467610233s file = illumos-utils/src/svc.rs:36 instance_id = 8e6b6db4-837f-4eb1-b0b2-b51d7f30c978 propolis_id = 92607f49-ba1c-4ddf-87a1-60c0c155ce79 zone = oxz_propolis-server_92607f49-ba1c-4ddf-87a1-60c0c155ce79
30922024-12-06T20:56:49.113ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_92607f49-ba1c-4ddf-87a1-60c0c155ce79") failed: Property not found. retry in 524.653982ms file = illumos-utils/src/svc.rs:36 instance_id = 8e6b6db4-837f-4eb1-b0b2-b51d7f30c978 propolis_id = 92607f49-ba1c-4ddf-87a1-60c0c155ce79 zone = oxz_propolis-server_92607f49-ba1c-4ddf-87a1-60c0c155ce79
30932024-12-06T20:56:49.648ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_92607f49-ba1c-4ddf-87a1-60c0c155ce79") failed: Property not found. retry in 1.453951713s file = illumos-utils/src/svc.rs:36 instance_id = 8e6b6db4-837f-4eb1-b0b2-b51d7f30c978 propolis_id = 92607f49-ba1c-4ddf-87a1-60c0c155ce79 zone = oxz_propolis-server_92607f49-ba1c-4ddf-87a1-60c0c155ce79
30942024-12-06T20:56:51.058ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:53820
30952024-12-06T20:56:51.058ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:53820 req_id = 3082ecd2-276b-4459-ae0c-f03807ef294c response_code = 200 uri = /baseboard
30962024-12-06T20:56:51.131ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_92607f49-ba1c-4ddf-87a1-60c0c155ce79 file = sled-agent/src/instance.rs:1981 instance_id = 8e6b6db4-837f-4eb1-b0b2-b51d7f30c978 propolis_id = 92607f49-ba1c-4ddf-87a1-60c0c155ce79
30972024-12-06T20:56:51.140ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:1990 instance_id = 8e6b6db4-837f-4eb1-b0b2-b51d7f30c978 propolis_id = 92607f49-ba1c-4ddf-87a1-60c0c155ce79
30982024-12-06T20:56:51.177ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:2014 instance_id = 8e6b6db4-837f-4eb1-b0b2-b51d7f30c978 propolis_id = 92607f49-ba1c-4ddf-87a1-60c0c155ce79
30992024-12-06T20:56:51.318ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:1127 instance_id = 8e6b6db4-837f-4eb1-b0b2-b51d7f30c978 propolis_id = 92607f49-ba1c-4ddf-87a1-60c0c155ce79
31002024-12-06T20:56:51.318ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1243 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
31012024-12-06T20:56:51.319ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7060151 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35577 req_id = 5ef02006-7b4c-4533-8fc9-00e61599a7b0 response_code = 204 uri = /eip-gateways
31022024-12-06T20:56:51.319ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2024-12-06T20:56:51.319576399Z } file = sled-agent/src/instance.rs:780 instance_id = 8e6b6db4-837f-4eb1-b0b2-b51d7f30c978 propolis_id = 92607f49-ba1c-4ddf-87a1-60c0c155ce79
31032024-12-06T20:56:51.319ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 8e6b6db4-837f-4eb1-b0b2-b51d7f30c978 new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-12-06T20:56:51.319576399Z } propolis_id = 92607f49-ba1c-4ddf-87a1-60c0c155ce79
31042024-12-06T20:56:51.320ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 8e6b6db4-837f-4eb1-b0b2-b51d7f30c978 propolis_id = 92607f49-ba1c-4ddf-87a1-60c0c155ce79 state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-12-06T20:56:51.319576399Z }, migration_in: None, migration_out: None }
31052024-12-06T20:56:51.358ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2024-12-06T20:56:51.358804901Z } file = sled-agent/src/instance.rs:780 instance_id = 8e6b6db4-837f-4eb1-b0b2-b51d7f30c978 propolis_id = 92607f49-ba1c-4ddf-87a1-60c0c155ce79
31062024-12-06T20:56:51.358ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 8e6b6db4-837f-4eb1-b0b2-b51d7f30c978 new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-12-06T20:56:51.358804901Z } propolis_id = 92607f49-ba1c-4ddf-87a1-60c0c155ce79
31072024-12-06T20:56:51.358ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 8e6b6db4-837f-4eb1-b0b2-b51d7f30c978 propolis_id = 92607f49-ba1c-4ddf-87a1-60c0c155ce79 state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-12-06T20:56:51.358804901Z }, migration_in: None, migration_out: None }
31082024-12-06T20:56:51.396ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 364 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35577 req_id = e483b5a5-b1e0-4bef-85ed-5a2b49d85104 response_code = 204 uri = /vpc-routes
31092024-12-06T20:56:57.416ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7052 local_addr = [fd00:1122:3344:101::1]:45033 method = GET remote_addr = [fd00:1122:3344:101::d]:44003 req_id = aea3be73-0433-4a3a-b5e1-80153ce60213 response_code = 200 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 uri = /0a667526-2006-419e-9b68-c251fd138c06
31102024-12-06T20:56:59.067ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52513
31112024-12-06T20:56:59.068ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1194 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52513 req_id = 857b3776-179b-4e14-b8ef-e6df6cffa05c response_code = 200 uri = /vmms/92607f49-ba1c-4ddf-87a1-60c0c155ce79/state
31122024-12-06T20:56:59.108ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60257
31132024-12-06T20:56:59.108ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60257 req_id = 480179dd-674c-430a-891c-4a422ce1917e response_code = 200 uri = /vpc-routes
31142024-12-06T20:56:59.116ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58809
31152024-12-06T20:56:59.116ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58809 req_id = 9e465527-9338-4cff-8e67-9808376d62ee response_code = 200 uri = /vpc-routes
31162024-12-06T20:56:59.160ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41667
31172024-12-06T20:56:59.160ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41667 req_id = 6c631c09-206e-40bd-9eed-d702c271bc05 response_code = 200 uri = /vmms/92607f49-ba1c-4ddf-87a1-60c0c155ce79/state
31182024-12-06T20:56:59.163ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 values = ExternalIpGatewayMap { mappings: {6b2b7eab-a7a3-488e-8a11-aefb815fdab9: {10.151.2.175: {8dd4f499-a809-40eb-9cb9-0aeb312d5997}, 10.151.2.176: {8dd4f499-a809-40eb-9cb9-0aeb312d5997}}} }
31192024-12-06T20:56:59.163ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58809 req_id = e8b44506-19f1-4f36-88c6-99414c4b408a response_code = 204 uri = /eip-gateways
31202024-12-06T20:56:59.183ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 233 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58809 req_id = bd07c311-3100-491d-bc46-70318da29e65 response_code = 204 uri = /vpc-routes
31212024-12-06T20:56:59.194ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45795
31222024-12-06T20:56:59.194ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45795 req_id = 6c2af43b-4d2c-4981-9a45-28aecb6d19a2 response_code = 200 uri = /v2p
31232024-12-06T20:56:59.212ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 values = ExternalIpGatewayMap { mappings: {6b2b7eab-a7a3-488e-8a11-aefb815fdab9: {10.151.2.175: {8dd4f499-a809-40eb-9cb9-0aeb312d5997}, 10.151.2.176: {8dd4f499-a809-40eb-9cb9-0aeb312d5997}}} }
31242024-12-06T20:56:59.212ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60257 req_id = 8aa83009-00e8-4835-836f-4968dba394e9 response_code = 204 uri = /eip-gateways
31252024-12-06T20:56:59.228ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62166
31262024-12-06T20:56:59.228ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
31272024-12-06T20:56:59.268ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
31282024-12-06T20:56:59.319ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91043 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:62166 req_id = 8c3174fc-302a-43c0-92f5-c8ca41620db9 response_code = 204 uri = /switch-ports
31292024-12-06T20:56:59.319ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63212
31302024-12-06T20:56:59.319ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
31312024-12-06T20:56:59.323ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3890 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62166 req_id = 48afbc98-4e8d-4afc-ac85-b0efafb28295 response_code = 200 uri = /network-bootstore-config
31322024-12-06T20:56:59.323ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4094 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60257 req_id = 5f691c29-b2d9-42a2-b9ef-a4d778bf5970 response_code = 204 uri = /vpc-routes
31332024-12-06T20:56:59.356ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
31342024-12-06T20:56:59.371ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57832
31352024-12-06T20:56:59.371ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 210 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57832 req_id = baa89c19-d37b-4dfa-bf7d-a4f574f14371 response_code = 200 uri = /v2p
31362024-12-06T20:56:59.409ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90055 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:63212 req_id = 49867d54-fdfd-4907-b8f5-bb47c5ae66b5 response_code = 204 uri = /switch-ports
31372024-12-06T20:56:59.409ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63212 req_id = 863cc937-19f4-4984-be07-44dfa945678d response_code = 200 uri = /network-bootstore-config
31382024-12-06T20:57:00.305ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42549
31392024-12-06T20:57:00.305ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42549 req_id = 8df7cec9-a799-4b80-b164-fcc09d8a84a5 response_code = 200 uri = /vmms/92607f49-ba1c-4ddf-87a1-60c0c155ce79/state
31402024-12-06T20:57:00.333ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35325
31412024-12-06T20:57:00.333ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35325 req_id = 9cc39675-d1ee-4b7d-8ae6-80605935a47a response_code = 200 uri = /vpc-routes
31422024-12-06T20:57:00.375ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 values = ExternalIpGatewayMap { mappings: {6b2b7eab-a7a3-488e-8a11-aefb815fdab9: {10.151.2.175: {8dd4f499-a809-40eb-9cb9-0aeb312d5997}, 10.151.2.176: {8dd4f499-a809-40eb-9cb9-0aeb312d5997}}} }
31432024-12-06T20:57:00.375ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35325 req_id = e4c74006-70cf-44e9-ace3-ccdff2d9f4c9 response_code = 204 uri = /eip-gateways
31442024-12-06T20:57:00.392ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 237 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35325 req_id = 9f7662e3-02ec-406f-972d-d47ba27431b5 response_code = 204 uri = /vpc-routes
31452024-12-06T20:57:00.432ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58477
31462024-12-06T20:57:00.432ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58477 req_id = d855e6d6-a081-453d-bc92-03140e9c7657 response_code = 200 uri = /v2p
31472024-12-06T20:57:00.444ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38154
31482024-12-06T20:57:00.444ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
31492024-12-06T20:57:00.482ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
31502024-12-06T20:57:00.540ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95739 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:38154 req_id = 328022d1-7f14-4904-b170-0bedf8c6b177 response_code = 204 uri = /switch-ports
31512024-12-06T20:57:00.540ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38154 req_id = 0593441a-d736-479d-8060-b28e502fb24f response_code = 200 uri = /network-bootstore-config
31522024-12-06T20:57:01.711ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58013
31532024-12-06T20:57:01.712ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 577 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58013 req_id = 903f716a-10f6-4fc4-8ed8-64f899da253a response_code = 200 uri = /vmms/92607f49-ba1c-4ddf-87a1-60c0c155ce79/state
31542024-12-06T20:57:01.712ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2024-12-06T20:57:01.712105619Z } file = sled-agent/src/instance.rs:780 instance_id = 8e6b6db4-837f-4eb1-b0b2-b51d7f30c978 propolis_id = 92607f49-ba1c-4ddf-87a1-60c0c155ce79
31552024-12-06T20:57:01.712ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 8e6b6db4-837f-4eb1-b0b2-b51d7f30c978 new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-12-06T20:57:01.712105619Z } propolis_id = 92607f49-ba1c-4ddf-87a1-60c0c155ce79
31562024-12-06T20:57:01.712ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 8e6b6db4-837f-4eb1-b0b2-b51d7f30c978 propolis_id = 92607f49-ba1c-4ddf-87a1-60c0c155ce79 state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-12-06T20:57:01.712105619Z }, migration_in: None, migration_out: None }
31572024-12-06T20:57:01.755ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2024-12-06T20:57:01.755764115Z } file = sled-agent/src/instance.rs:780 instance_id = 8e6b6db4-837f-4eb1-b0b2-b51d7f30c978 propolis_id = 92607f49-ba1c-4ddf-87a1-60c0c155ce79
31582024-12-06T20:57:01.755ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 8e6b6db4-837f-4eb1-b0b2-b51d7f30c978 new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-12-06T20:57:01.755764115Z } propolis_id = 92607f49-ba1c-4ddf-87a1-60c0c155ce79
31592024-12-06T20:57:01.755ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:816 instance_id = 8e6b6db4-837f-4eb1-b0b2-b51d7f30c978 propolis_id = 92607f49-ba1c-4ddf-87a1-60c0c155ce79
31602024-12-06T20:57:01.755ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
31612024-12-06T20:57:01.755ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 17960770255418723476 n_samples = 6 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
31622024-12-06T20:57:01.756ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 14619538027921845154 n_samples = 6 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
31632024-12-06T20:57:01.756ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
31642024-12-06T20:57:01.756ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/5a719d2c-fbf6-41ef-af9f-e6b70820ebd4/debug/bundle/zone", "/pool/int/b9ab18cf-4dd7-46c3-920e-833f181cfe8b/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/50f60e54-9000-4b4d-8705-841b133128b0/crypt/debug", "/pool/ext/99dfd90b-ff92-45e8-a73e-ada9e3f552c8/crypt/debug", "/pool/ext/3b3acf4c-a316-45ce-a055-ef8d6c8acdff/crypt/debug", "/pool/ext/5f5a9c7a-eec2-4e86-a02e-9238700fe7ab/crypt/debug", "/pool/ext/8e389ddd-65e9-4954-ab37-e305d4d4e112/crypt/debug", "/pool/ext/f3f86fa8-b3a1-409b-95c8-f426058deed7/crypt/debug", "/pool/ext/2f3ff39c-4b18-4b96-8fb8-fbd672d6202f/crypt/debug", "/pool/ext/33ce0168-de47-475b-9a15-5a0cd6252cb6/crypt/debug", "/pool/ext/43474e0b-a6d6-4842-bf66-1060f52875b1/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_92607f49-ba1c-4ddf-87a1-60c0c155ce79
31652024-12-06T20:57:02.383ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1142 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_92607f49-ba1c-4ddf-87a1-60c0c155ce79", bundle_id: 9142dbb1-c13d-49cb-b7fc-2719e1238b53 }, time_created: 2024-12-06T20:57:01.757222813Z, version: 0, cause: TerminatedInstance }
31662024-12-06T20:57:02.384ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_92607f49-ba1c-4ddf-87a1-60c0c155ce79 file = sled-agent/src/instance.rs:1227 instance_id = 8e6b6db4-837f-4eb1-b0b2-b51d7f30c978 propolis_id = 92607f49-ba1c-4ddf-87a1-60c0c155ce79
31672024-12-06T20:57:04.143ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:279 instance_id = 8e6b6db4-837f-4eb1-b0b2-b51d7f30c978 propolis_id = 92607f49-ba1c-4ddf-87a1-60c0c155ce79
31682024-12-06T20:57:04.160ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(6629825), kind: System }
31692024-12-06T20:57:04.160ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(6629825), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
31702024-12-06T20:57:04.161ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 8e6b6db4-837f-4eb1-b0b2-b51d7f30c978 propolis_id = 92607f49-ba1c-4ddf-87a1-60c0c155ce79 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-06T20:57:04.161173837Z }, migration_in: None, migration_out: None }
31712024-12-06T20:57:04.254ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 8e6b6db4-837f-4eb1-b0b2-b51d7f30c978 propolis_id = 92607f49-ba1c-4ddf-87a1-60c0c155ce79 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-06T20:57:04.161173837Z }, migration_in: None, migration_out: None }
31722024-12-06T20:57:04.258ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:1164 instance_id = 8e6b6db4-837f-4eb1-b0b2-b51d7f30c978 propolis_id = 92607f49-ba1c-4ddf-87a1-60c0c155ce79
31732024-12-06T20:57:04.860ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48134
31742024-12-06T20:57:04.860ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48134 req_id = fbfef146-84d6-457a-b655-a12bde0f3fba response_code = 200 uri = /vpc-routes
31752024-12-06T20:57:04.875ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 values = ExternalIpGatewayMap { mappings: {} }
31762024-12-06T20:57:04.875ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1243 sled_id = 0a667526-2006-419e-9b68-c251fd138c06
31772024-12-06T20:57:04.875ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48134 req_id = a0ead83c-5124-4c1b-ac44-53e57b790b11 response_code = 204 uri = /eip-gateways
31782024-12-06T20:57:04.882ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 202 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48134 req_id = 0b372581-57df-44cc-ac62-bbe6732b7c9a response_code = 204 uri = /vpc-routes
31792024-12-06T20:57:04.996ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36259
31802024-12-06T20:57:04.996ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36259 req_id = fb2d1c38-49ae-443e-8ed2-20a397006008 response_code = 200 uri = /v2p
31812024-12-06T20:57:06.143ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36766
31822024-12-06T20:57:06.144ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 169 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36766 req_id = b0f974f9-ebd8-4767-8f20-9827354e9676 response_code = 200 uri = /v2p
31832024-12-06T20:57:06.195ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36272
31842024-12-06T20:57:06.195ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36272 req_id = 05405fcb-847d-4bbf-ae43-e6b4ad0685cd response_code = 200 uri = /vpc-routes
31852024-12-06T20:57:06.209ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 values = ExternalIpGatewayMap { mappings: {} }
31862024-12-06T20:57:06.209ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36272 req_id = 1cfb8f8a-c427-4eb0-a043-44807e05179b response_code = 204 uri = /eip-gateways
31872024-12-06T20:57:06.216ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 246 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36272 req_id = c4d7046b-6a88-4cec-a38b-7d9ca9fcaa04 response_code = 204 uri = /vpc-routes
31882024-12-06T20:57:06.995ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55556
31892024-12-06T20:57:06.995ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55556 req_id = da23c4b9-7704-461c-a482-900fabd78b89 response_code = 200 uri = /vpc-routes
31902024-12-06T20:57:07.008ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 values = ExternalIpGatewayMap { mappings: {} }
31912024-12-06T20:57:07.008ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55556 req_id = 5a8a5f2f-25cc-467f-91af-c82369720aaa response_code = 204 uri = /eip-gateways
31922024-12-06T20:57:07.015ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55556 req_id = 6f062495-acb3-449a-90b4-b69777552e2d response_code = 204 uri = /vpc-routes