Max level shown:
1 [ Nov 27 20:44:42 Enabled. ]
2 [ Nov 27 20:44:42 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Nov 27 20:44:42 Method "start" exited with status 0. ]
4 [ Nov 27 20:44:42 Rereading configuration. ]
5 [ Nov 27 20:44:42 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72024-11-27T20:44:42.817ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:113
82024-11-27T20:44:42.817ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92024-11-27T20:44:42.869ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102024-11-27T20:44:42.869ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112024-11-27T20:44:42.984ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122024-11-27T20:44:42.993ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132024-11-27T20:44:43.001ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142024-11-27T20:44:43.604ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:9fb2::, width: 64 }
152024-11-27T20:44:43.747ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
162024-11-27T20:44:43.747ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
172024-11-27T20:44:43.747ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
182024-11-27T20:44:43.747ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192024-11-27T20:44:43.747ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:717
202024-11-27T20:44:43.747ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:520
212024-11-27T20:44:43.751ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "buskin", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:624
222024-11-27T20:44:43.751ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:766
232024-11-27T20:44:43.751ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
242024-11-27T20:44:43.751ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:825
252024-11-27T20:44:43.751ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
262024-11-27T20:44:43.751ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272024-11-27T20:44:43.751ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
282024-11-27T20:44:43.751ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292024-11-27T20:44:43.751ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302024-11-27T20:44:43.763ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:367
312024-11-27T20:44:43.763ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 71828714-15a3-4f82-918a-cbabee4531fa (zpool)
322024-11-27T20:44:43.860ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 71828714-15a3-4f82-918a-cbabee4531fa (zpool), kind: Internal }
332024-11-27T20:44:44.336ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:603
342024-11-27T20:44:44.336ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
352024-11-27T20:44:44.336ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362024-11-27T20:44:44.336ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372024-11-27T20:44:44.336ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
382024-11-27T20:44:44.336ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392024-11-27T20:44:44.336ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402024-11-27T20:44:44.345ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:367
412024-11-27T20:44:44.345ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = f58570a3-13b1-4b0c-ac0c-e8a0652f7ced (zpool)
422024-11-27T20:44:44.433ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: f58570a3-13b1-4b0c-ac0c-e8a0652f7ced (zpool), kind: Internal }
432024-11-27T20:44:44.904ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
442024-11-27T20:44:44.904ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 71828714-15a3-4f82-918a-cbabee4531fa (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f58570a3-13b1-4b0c-ac0c-e8a0652f7ced (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
452024-11-27T20:44:44.904ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
462024-11-27T20:44:44.904ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
472024-11-27T20:44:44.904ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
482024-11-27T20:44:44.904ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
492024-11-27T20:44:44.904ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
502024-11-27T20:44:44.904ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 71828714-15a3-4f82-918a-cbabee4531fa (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f58570a3-13b1-4b0c-ac0c-e8a0652f7ced (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
512024-11-27T20:44:44.904ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
522024-11-27T20:44:44.904ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
532024-11-27T20:44:44.904ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
542024-11-27T20:44:44.904ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
552024-11-27T20:44:44.904ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
562024-11-27T20:44:44.904ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 71828714-15a3-4f82-918a-cbabee4531fa (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f58570a3-13b1-4b0c-ac0c-e8a0652f7ced (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
572024-11-27T20:44:44.904ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
582024-11-27T20:44:44.904ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
592024-11-27T20:44:44.904ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
602024-11-27T20:44:44.904ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
612024-11-27T20:44:44.904ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
622024-11-27T20:44:44.904ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 71828714-15a3-4f82-918a-cbabee4531fa (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f58570a3-13b1-4b0c-ac0c-e8a0652f7ced (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
632024-11-27T20:44:44.904ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
642024-11-27T20:44:44.904ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
652024-11-27T20:44:44.904ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
662024-11-27T20:44:44.904ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
672024-11-27T20:44:44.904ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
682024-11-27T20:44:44.904ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 71828714-15a3-4f82-918a-cbabee4531fa (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f58570a3-13b1-4b0c-ac0c-e8a0652f7ced (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
692024-11-27T20:44:44.904ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
702024-11-27T20:44:44.904ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
712024-11-27T20:44:44.904ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
722024-11-27T20:44:44.904ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
732024-11-27T20:44:44.904ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
742024-11-27T20:44:44.904ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 71828714-15a3-4f82-918a-cbabee4531fa (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f58570a3-13b1-4b0c-ac0c-e8a0652f7ced (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
752024-11-27T20:44:44.904ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
762024-11-27T20:44:44.904ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
772024-11-27T20:44:44.904ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
782024-11-27T20:44:44.904ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
792024-11-27T20:44:44.904ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
802024-11-27T20:44:44.904ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
812024-11-27T20:44:44.904ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
822024-11-27T20:44:44.904ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 71828714-15a3-4f82-918a-cbabee4531fa (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f58570a3-13b1-4b0c-ac0c-e8a0652f7ced (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
832024-11-27T20:44:44.904ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
842024-11-27T20:44:44.904ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
852024-11-27T20:44:44.904ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
862024-11-27T20:44:44.904ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
872024-11-27T20:44:44.904ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
882024-11-27T20:44:44.904ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 71828714-15a3-4f82-918a-cbabee4531fa (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f58570a3-13b1-4b0c-ac0c-e8a0652f7ced (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
892024-11-27T20:44:44.904ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
902024-11-27T20:44:44.904ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
912024-11-27T20:44:44.904ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
922024-11-27T20:44:44.904ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
932024-11-27T20:44:44.904ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
942024-11-27T20:44:44.904ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 71828714-15a3-4f82-918a-cbabee4531fa (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f58570a3-13b1-4b0c-ac0c-e8a0652f7ced (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
952024-11-27T20:44:44.904ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
962024-11-27T20:44:44.904ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
972024-11-27T20:44:44.904ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
982024-11-27T20:44:44.904ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
992024-11-27T20:44:44.904ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 71828714-15a3-4f82-918a-cbabee4531fa (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f58570a3-13b1-4b0c-ac0c-e8a0652f7ced (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
1002024-11-27T20:44:44.904ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1012024-11-27T20:44:44.904ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
1022024-11-27T20:44:44.904ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1032024-11-27T20:44:44.904ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1042024-11-27T20:44:44.904ZINFOSledAgent (bootstore): No ledger in /pool/int/71828714-15a3-4f82-918a-cbabee4531fa/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1052024-11-27T20:44:44.904ZINFOSledAgent (bootstore): No ledger in /pool/int/f58570a3-13b1-4b0c-ac0c-e8a0652f7ced/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1062024-11-27T20:44:44.904ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-buskin-i86pc
1072024-11-27T20:44:44.904ZINFOSledAgent (bootstore): No ledger in /pool/int/71828714-15a3-4f82-918a-cbabee4531fa/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1082024-11-27T20:44:44.904ZINFOSledAgent (bootstore): No ledger in /pool/int/f58570a3-13b1-4b0c-ac0c-e8a0652f7ced/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1092024-11-27T20:44:44.904ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-buskin-i86pc
1102024-11-27T20:44:44.904ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1112024-11-27T20:44:44.905ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1122024-11-27T20:44:44.916ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:736
1132024-11-27T20:44:44.916ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1353, tv_nsec: 429325341 } time_to_next_cleanup = 599.999948489s
1142024-11-27T20:44:44.916ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3947
1152024-11-27T20:44:44.916ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1162024-11-27T20:44:44.916ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/71828714-15a3-4f82-918a-cbabee4531fa/config/sled-agent-request.json file = common/src/ledger.rs:188
1172024-11-27T20:44:44.919ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/f58570a3-13b1-4b0c-ac0c-e8a0652f7ced/config/sled-agent-request.json file = common/src/ledger.rs:188
1182024-11-27T20:44:44.919ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80
1192024-11-27T20:44:44.921ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:9fb2::1]:12346
1202024-11-27T20:44:44.921ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.1.164, last: 10.151.1.173, }, ), ], external_dns_ips: [ 10.151.1.164, 10.151.1.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1187
1212024-11-27T20:44:44.921ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1222024-11-27T20:44:44.921ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1232024-11-27T20:44:44.922ZINFOSledAgent (RSS): No ledger in /pool/int/71828714-15a3-4f82-918a-cbabee4531fa/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1242024-11-27T20:44:44.922ZINFOSledAgent (RSS): No ledger in /pool/int/f58570a3-13b1-4b0c-ac0c-e8a0652f7ced/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1252024-11-27T20:44:44.922ZINFOSledAgent (RSS): RSS configuration has not been fully applied yet file = sled-agent/src/rack_setup/service.rs:1250
1262024-11-27T20:44:44.922ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1272024-11-27T20:44:44.922ZINFOSledAgent (RSS): No ledger in /pool/int/71828714-15a3-4f82-918a-cbabee4531fa/config/rss-sled-plan.json file = common/src/ledger.rs:188
1282024-11-27T20:44:44.922ZINFOSledAgent (RSS): No ledger in /pool/int/f58570a3-13b1-4b0c-ac0c-e8a0652f7ced/config/rss-sled-plan.json file = common/src/ledger.rs:188
1292024-11-27T20:44:44.922ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1292
1302024-11-27T20:44:44.922ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:156
1312024-11-27T20:44:44.922ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:9fb2::1 file = sled-agent/src/rack_setup/plan/sled.rs:129
1322024-11-27T20:44:44.922ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1332024-11-27T20:44:44.922ZINFOSledAgent (RSS): Writing ledger to /pool/int/71828714-15a3-4f82-918a-cbabee4531fa/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:199
1342024-11-27T20:44:44.922ZINFOSledAgent (RSS): Writing ledger to /pool/int/f58570a3-13b1-4b0c-ac0c-e8a0652f7ced/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:199
1352024-11-27T20:44:44.922ZINFOSledAgent (RSS): Sled plan written to storage: Plan { rack_id: 0f7812c1-7dc7-4ef4-bd3e-c3ab0830f824, sleds: { [fdb0:18c0:4d0d:9fb2::1]:12346: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 0f17ab63-f38a-412f-a653-029795d7304e (sled), rack_id: 0f7812c1-7dc7-4ef4-bd3e-c3ab0830f824, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64, }, }, }, }, }, config: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.1.164, last: 10.151.1.173, }, ), ], external_dns_ips: [ 10.151.1.164, 10.151.1.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, }, } file = sled-agent/src/rack_setup/plan/sled.rs:176
1362024-11-27T20:44:44.922ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1326
1372024-11-27T20:44:44.922ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
1382024-11-27T20:44:44.922ZINFOSledAgent (bootstore): Writing ledger to /pool/int/71828714-15a3-4f82-918a-cbabee4531fa/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
1392024-11-27T20:44:44.923ZINFOSledAgent (bootstore): Writing ledger to /pool/int/f58570a3-13b1-4b0c-ac0c-e8a0652f7ced/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
1402024-11-27T20:44:44.923ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
1412024-11-27T20:44:44.923ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 0f17ab63-f38a-412f-a653-029795d7304e (sled), rack_id: 0f7812c1-7dc7-4ef4-bd3e-c3ab0830f824, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
1422024-11-27T20:44:44.923ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4244
1432024-11-27T20:44:44.923ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4644
1442024-11-27T20:44:44.928ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/client.rs:50
1452024-11-27T20:44:44.934ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1462024-11-27T20:44:44.934ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1472024-11-27T20:44:44.938ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1482024-11-27T20:44:44.938ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1492024-11-27T20:44:44.939ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:42258
1502024-11-27T20:44:44.939ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 0f17ab63-f38a-412f-a653-029795d7304e (sled), rack_id: 0f7812c1-7dc7-4ef4-bd3e-c3ab0830f824, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:362
1512024-11-27T20:44:44.939ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:377
1522024-11-27T20:44:44.939ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1532024-11-27T20:44:44.939ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1542024-11-27T20:44:44.939ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:603
1552024-11-27T20:44:44.939ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:809
1562024-11-27T20:44:44.939ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1572024-11-27T20:44:44.939ZINFOSledAgent (StorageManager): No ledger in /pool/int/71828714-15a3-4f82-918a-cbabee4531fa/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1582024-11-27T20:44:44.939ZINFOSledAgent (StorageManager): No ledger in /pool/int/f58570a3-13b1-4b0c-ac0c-e8a0652f7ced/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1592024-11-27T20:44:44.939ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:798
1602024-11-27T20:44:44.939ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:826
1612024-11-27T20:44:44.939ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:592
1622024-11-27T20:44:44.939ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1632024-11-27T20:44:44.939ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:697 result = DisksManagementResult { status: [] }
1642024-11-27T20:44:44.955ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1652024-11-27T20:44:44.975ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:325
1662024-11-27T20:44:44.992ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:363
1672024-11-27T20:44:45.002ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:415 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e
1682024-11-27T20:44:45.002ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1692024-11-27T20:44:45.002ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:427 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e
1702024-11-27T20:44:45.002ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1712024-11-27T20:44:45.005ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 64.604233ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "401636fb-1af9-4b4b-8508-3f97eaeb61ce", "content-length": "124", "date": "Wed, 27 Nov 2024 20:44:44 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "401636fb-1af9-4b4b-8508-3f97eaeb61ce" } file = clients/ddm-admin-client/src/lib.rs:177
1722024-11-27T20:44:45.016ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_71828714-15a3-4f82-918a-cbabee4531fa/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1732024-11-27T20:44:45.039ZINFOSledAgent: successfully created encrypted zvol: name="oxi_71828714-15a3-4f82-918a-cbabee4531fa/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1742024-11-27T20:44:45.040ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_71828714-15a3-4f82-918a-cbabee4531fa/swap" file = sled-agent/src/swap_device.rs:96
1752024-11-27T20:44:45.045ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:442 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e
1762024-11-27T20:44:45.045ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:128
1772024-11-27T20:44:45.045ZINFOSledAgent (BackingFs): Ensuring dataset oxi_71828714-15a3-4f82-918a-cbabee4531fa/backing/fmd file = sled-agent/src/backing_fs.rs:138
1782024-11-27T20:44:45.071ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1792024-11-27T20:44:45.072ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 163.094019ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "1c8fbf49-4de3-4f93-bee4-8bc0ba9f89b9", "content-length": "124", "date": "Wed, 27 Nov 2024 20:44:44 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "1c8fbf49-4de3-4f93-bee4-8bc0ba9f89b9" } file = clients/ddm-admin-client/src/lib.rs:177
1802024-11-27T20:44:45.129ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:173
1812024-11-27T20:44:45.236ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1822024-11-27T20:44:45.236ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 206.410549ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "1f52381b-c817-4c03-b05b-e00b4daaef33", "content-length": "124", "date": "Wed, 27 Nov 2024 20:44:44 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "1f52381b-c817-4c03-b05b-e00b4daaef33" } file = clients/ddm-admin-client/src/lib.rs:177
1832024-11-27T20:44:45.348ZINFOSledAgent (BackingFs): Mounting oxi_71828714-15a3-4f82-918a-cbabee4531fa/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:181
1842024-11-27T20:44:45.360ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:189
1852024-11-27T20:44:45.360ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:189
1862024-11-27T20:44:45.360ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:189
1872024-11-27T20:44:45.360ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:195
1882024-11-27T20:44:45.445ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1892024-11-27T20:44:45.445ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 173.075304ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "bdc44a79-c66a-46da-9d39-abe2cec33086", "content-length": "124", "date": "Wed, 27 Nov 2024 20:44:44 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "bdc44a79-c66a-46da-9d39-abe2cec33086" } file = clients/ddm-admin-client/src/lib.rs:177
1902024-11-27T20:44:45.619ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1912024-11-27T20:44:45.620ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 152.21113ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "ed7ccc15-b0ae-41ef-941c-0063ceec3dfd", "content-length": "124", "date": "Wed, 27 Nov 2024 20:44:44 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "ed7ccc15-b0ae-41ef-941c-0063ceec3dfd" } file = clients/ddm-admin-client/src/lib.rs:177
1922024-11-27T20:44:45.773ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1932024-11-27T20:44:45.773ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 302.97378ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "4efcc0f1-4169-44c2-9ecf-4d2927725adb", "content-length": "124", "date": "Wed, 27 Nov 2024 20:44:44 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "4efcc0f1-4169-44c2-9ecf-4d2927725adb" } file = clients/ddm-admin-client/src/lib.rs:177
1942024-11-27T20:44:46.078ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1952024-11-27T20:44:46.093ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:93 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e
1962024-11-27T20:44:46.098ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:35289 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e
1972024-11-27T20:44:46.098ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e
1982024-11-27T20:44:46.098ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:35289 file = oximeter/producer/src/lib.rs:279 interval = 30s producer_id = 0f17ab63-f38a-412f-a653-029795d7304e sled_id = 0f17ab63-f38a-412f-a653-029795d7304e
1992024-11-27T20:44:46.099ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 282.88066ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e
2002024-11-27T20:44:46.100ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e
2012024-11-27T20:44:46.101ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e
2022024-11-27T20:44:46.101ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:920 underlay_address = fd00:1122:3344:101::1
2032024-11-27T20:44:46.101ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
2042024-11-27T20:44:46.383ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 555.600504ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e
2052024-11-27T20:44:46.940ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.17895083s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e
2062024-11-27T20:44:48.121ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.770362269s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e
2072024-11-27T20:44:48.644ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2668
2082024-11-27T20:44:48.644ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2913
2092024-11-27T20:44:48.644ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2538
2102024-11-27T20:44:48.644ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2585
2112024-11-27T20:44:48.645ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:2994
2122024-11-27T20:44:48.645ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3039
2132024-11-27T20:44:48.646ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2838
2142024-11-27T20:44:48.648ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2579
2152024-11-27T20:44:48.648ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='65890b1c-a0cb-4d47-9b7f-0973325cd722'/> <propval type="astring" name="rack_id" value='0f7812c1-7dc7-4ef4-bd3e-c3ab0830f824'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:9fb2::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:fe8f:1ad0'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:9fb2::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"buskin","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="rack_id" value='0f7812c1-7dc7-4ef4-bd3e-c3ab0830f824'/> <propval type="astring" name="sled_id" value='0f17ab63-f38a-412f-a653-029795d7304e'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='buskin'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="host" value='[::1]'/> <propval type="astring" name="port" value='12224'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='buskin'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='0f17ab63-f38a-412f-a653-029795d7304e'/> <propval type="astring" name="rack_uuid" value='0f7812c1-7dc7-4ef4-bd3e-c3ab0830f824'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='0f17ab63-f38a-412f-a653-029795d7304e'/> <propval type="astring" name="rack_uuid" value='0f7812c1-7dc7-4ef4-bd3e-c3ab0830f824'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2162024-11-27T20:44:48.648ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_switch
2172024-11-27T20:44:48.874ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 64.534727ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2182024-11-27T20:44:49.083ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 125.077193ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2192024-11-27T20:44:49.293ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 244.440354ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2202024-11-27T20:44:49.660ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 365.086924ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2212024-11-27T20:44:49.894ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 5.731681465s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e
2222024-11-27T20:44:50.061ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 683.310677ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2232024-11-27T20:44:50.889ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.452345775s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2242024-11-27T20:44:52.454ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 507.765602ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2252024-11-27T20:44:53.133ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 662.522305ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2262024-11-27T20:44:53.844ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.071489134s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2272024-11-27T20:44:55.340ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/0f17ab63-f38a-412f-a653-029795d7304e) file = sled-agent/src/nexus.rs:527 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e
2282024-11-27T20:44:55.370ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2292024-11-27T20:44:55.370ZINFOSledAgent (dropshot (Repo Depot)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12348 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e
2302024-11-27T20:44:55.371ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12345
2312024-11-27T20:44:55.371ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:432
2322024-11-27T20:44:55.371ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2332024-11-27T20:44:55.371ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/71828714-15a3-4f82-918a-cbabee4531fa/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2342024-11-27T20:44:55.372ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/f58570a3-13b1-4b0c-ac0c-e8a0652f7ced/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2352024-11-27T20:44:55.372ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2362024-11-27T20:44:55.372ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some(None), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None }], bgp: [], bfd: [] })))
2372024-11-27T20:44:55.372ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3947
2382024-11-27T20:44:55.372ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:42258
2392024-11-27T20:44:55.576ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:9fb2::1]:12346
2402024-11-27T20:44:55.577ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
2412024-11-27T20:44:55.577ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2422024-11-27T20:44:55.577ZINFOSledAgent (RSS): No ledger in /pool/int/71828714-15a3-4f82-918a-cbabee4531fa/config/rss-service-plan-v5.json file = common/src/ledger.rs:188
2432024-11-27T20:44:55.577ZINFOSledAgent (RSS): No ledger in /pool/int/f58570a3-13b1-4b0c-ac0c-e8a0652f7ced/config/rss-service-plan-v5.json file = common/src/ledger.rs:188
2442024-11-27T20:44:55.577ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2452024-11-27T20:44:55.577ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2462024-11-27T20:44:55.577ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2472024-11-27T20:44:55.577ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2482024-11-27T20:44:55.582ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4268 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2492024-11-27T20:44:55.582ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:4284
2502024-11-27T20:44:55.582ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:534 zone = oxz_switch
2512024-11-27T20:44:55.811ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 6.827401084s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e
2522024-11-27T20:44:55.846ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60618
2532024-11-27T20:44:55.846ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2542024-11-27T20:44:55.846ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2552024-11-27T20:44:55.846ZINFOSledAgent (ServiceManager): No ledger in /pool/int/71828714-15a3-4f82-918a-cbabee4531fa/config/omicron-zones.json file = common/src/ledger.rs:188
2562024-11-27T20:44:55.846ZINFOSledAgent (ServiceManager): No ledger in /pool/int/f58570a3-13b1-4b0c-ac0c-e8a0652f7ced/config/omicron-zones.json file = common/src/ledger.rs:188
2572024-11-27T20:44:55.846ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 289 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:60618 req_id = 8e41a6d3-7540-4bd1-9e17-e00d21952853 response_code = 200 uri = /inventory
2582024-11-27T20:44:55.879ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:38091
2592024-11-27T20:44:55.879ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:38091 req_id = f6e7156d-94d4-4f72-b1e4-acc4c5552912 response_code = 200 uri = /sled-role
2602024-11-27T20:44:55.880ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2612024-11-27T20:44:55.881ZINFOSledAgent (RSS): Writing ledger to /pool/int/71828714-15a3-4f82-918a-cbabee4531fa/config/.rss-service-plan-v5.json.tmp file = common/src/ledger.rs:199
2622024-11-27T20:44:55.881ZINFOSledAgent (RSS): Writing ledger to /pool/int/f58570a3-13b1-4b0c-ac0c-e8a0652f7ced/config/.rss-service-plan-v5.json.tmp file = common/src/ledger.rs:199
2632024-11-27T20:44:55.881ZINFOSledAgent (RSS): Service plan written to storage file = sled-agent/src/rack_setup/plan/service.rs:982
2642024-11-27T20:44:55.913ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 4c3c8588-5f41-43b1-b413-7cf1fae1ff04 (physical_disk), pool_id: ff99775c-fb56-419e-aef8-9c8117494384 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: dda84001-ca38-467f-ae41-3a0cc9de9e76 (physical_disk), pool_id: 54375e11-a569-4c64-8c24-c6dfba089c32 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 96f6b25b-3b40-451c-9e39-cd819bba9475 (physical_disk), pool_id: a7344162-b09f-4fab-9022-409ee4ca9964 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: bc1b9717-5399-407f-8a82-0122b41b6a63 (physical_disk), pool_id: 37e32039-a8dd-4947-8c19-c28ef6335cf2 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 93cf7fd0-5bdf-4feb-9f92-e01a1d770f28 (physical_disk), pool_id: c3225150-4706-46cb-9890-c4e173582acb (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: ccd220be-d49e-4ad2-bd2e-c5a3995d8f86 (physical_disk), pool_id: 4393a6b4-1740-4ce1-b6df-2d78fb8128b9 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: b901dc4d-8c2f-40d5-acd6-b773708c83a3 (physical_disk), pool_id: bd1e9859-f391-4410-ac6a-94d84a761bf8 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 48028c22-7544-42a0-8aef-cea0c0617369 (physical_disk), pool_id: f94a6d1b-9178-4c13-817f-a77b6a6cd97e (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 0e38acdb-7e23-4e99-8d05-71df1980e85a (physical_disk), pool_id: 0b66aa68-555b-43d3-99fd-94013fc7fb74 (zpool) }] } file = sled-agent/src/rack_setup/service.rs:369 sled_address = [fd00:1122:3344:101::1]:12345
2652024-11-27T20:44:55.914ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46668
2662024-11-27T20:44:55.914ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:896 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e
2672024-11-27T20:44:55.914ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 4c3c8588-5f41-43b1-b413-7cf1fae1ff04 (physical_disk), pool_id: ff99775c-fb56-419e-aef8-9c8117494384 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: dda84001-ca38-467f-ae41-3a0cc9de9e76 (physical_disk), pool_id: 54375e11-a569-4c64-8c24-c6dfba089c32 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 96f6b25b-3b40-451c-9e39-cd819bba9475 (physical_disk), pool_id: a7344162-b09f-4fab-9022-409ee4ca9964 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: bc1b9717-5399-407f-8a82-0122b41b6a63 (physical_disk), pool_id: 37e32039-a8dd-4947-8c19-c28ef6335cf2 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 93cf7fd0-5bdf-4feb-9f92-e01a1d770f28 (physical_disk), pool_id: c3225150-4706-46cb-9890-c4e173582acb (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: ccd220be-d49e-4ad2-bd2e-c5a3995d8f86 (physical_disk), pool_id: 4393a6b4-1740-4ce1-b6df-2d78fb8128b9 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: b901dc4d-8c2f-40d5-acd6-b773708c83a3 (physical_disk), pool_id: bd1e9859-f391-4410-ac6a-94d84a761bf8 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 48028c22-7544-42a0-8aef-cea0c0617369 (physical_disk), pool_id: f94a6d1b-9178-4c13-817f-a77b6a6cd97e (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 0e38acdb-7e23-4e99-8d05-71df1980e85a (physical_disk), pool_id: 0b66aa68-555b-43d3-99fd-94013fc7fb74 (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:603
2682024-11-27T20:44:55.914ZINFOSledAgent (StorageManager): No ledger in /pool/int/71828714-15a3-4f82-918a-cbabee4531fa/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2692024-11-27T20:44:55.914ZINFOSledAgent (StorageManager): No ledger in /pool/int/f58570a3-13b1-4b0c-ac0c-e8a0652f7ced/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2702024-11-27T20:44:55.914ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:1171 request = omicron_physical_disks_ensure
2712024-11-27T20:44:55.914ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2722024-11-27T20:44:55.914ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2732024-11-27T20:44:55.914ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2742024-11-27T20:44:55.914ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2752024-11-27T20:44:56.062ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:367
2762024-11-27T20:44:56.062ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = ff99775c-fb56-419e-aef8-9c8117494384 (zpool)
2772024-11-27T20:44:56.274ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e
2782024-11-27T20:44:56.275ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10801473587821902893 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e
2792024-11-27T20:44:56.276ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9544658036638116349 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e
2802024-11-27T20:44:56.371ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: ff99775c-fb56-419e-aef8-9c8117494384 (zpool), kind: External }
2812024-11-27T20:44:56.375ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/0f17ab63-f38a-412f-a653-029795d7304e) file = sled-agent/src/probe_manager.rs:231 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e
2822024-11-27T20:44:56.379ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:240
2832024-11-27T20:44:56.379ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:242
2842024-11-27T20:44:56.379ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:246
2852024-11-27T20:44:56.379ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:248
2862024-11-27T20:44:56.379ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2872024-11-27T20:44:56.380ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2882024-11-27T20:44:56.380ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
2892024-11-27T20:44:56.415ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2902024-11-27T20:44:56.423ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_ff99775c-fb56-419e-aef8-9c8117494384/crypt/zone file = sled-storage/src/dataset.rs:303
2912024-11-27T20:44:56.598ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_ff99775c-fb56-419e-aef8-9c8117494384 file = sled-storage/src/dataset.rs:389
2922024-11-27T20:44:56.606ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
2932024-11-27T20:44:56.606ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
2942024-11-27T20:44:56.606ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
2952024-11-27T20:44:56.606ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2962024-11-27T20:44:56.606ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2972024-11-27T20:44:56.618ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:367
2982024-11-27T20:44:56.618ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 54375e11-a569-4c64-8c24-c6dfba089c32 (zpool)
2992024-11-27T20:44:56.711ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 54375e11-a569-4c64-8c24-c6dfba089c32 (zpool), kind: External }
3002024-11-27T20:44:56.720ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:240
3012024-11-27T20:44:56.720ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:242
3022024-11-27T20:44:56.720ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:246
3032024-11-27T20:44:56.720ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:248
3042024-11-27T20:44:56.720ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
3052024-11-27T20:44:56.720ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
3062024-11-27T20:44:56.720ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3072024-11-27T20:44:56.757ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3082024-11-27T20:44:56.765ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_54375e11-a569-4c64-8c24-c6dfba089c32/crypt/zone file = sled-storage/src/dataset.rs:303
3092024-11-27T20:44:56.938ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_54375e11-a569-4c64-8c24-c6dfba089c32 file = sled-storage/src/dataset.rs:389
3102024-11-27T20:44:56.946ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
3112024-11-27T20:44:56.946ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
3122024-11-27T20:44:56.946ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
3132024-11-27T20:44:56.946ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3142024-11-27T20:44:56.946ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3152024-11-27T20:44:56.956ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:367
3162024-11-27T20:44:56.956ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = a7344162-b09f-4fab-9022-409ee4ca9964 (zpool)
3172024-11-27T20:44:57.053ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: a7344162-b09f-4fab-9022-409ee4ca9964 (zpool), kind: External }
3182024-11-27T20:44:57.062ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:240
3192024-11-27T20:44:57.062ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:242
3202024-11-27T20:44:57.062ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:246
3212024-11-27T20:44:57.062ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:248
3222024-11-27T20:44:57.062ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3232024-11-27T20:44:57.062ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3242024-11-27T20:44:57.062ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3252024-11-27T20:44:57.097ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3262024-11-27T20:44:57.106ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_a7344162-b09f-4fab-9022-409ee4ca9964/crypt/zone file = sled-storage/src/dataset.rs:303
3272024-11-27T20:44:57.276ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_a7344162-b09f-4fab-9022-409ee4ca9964 file = sled-storage/src/dataset.rs:389
3282024-11-27T20:44:57.284ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3292024-11-27T20:44:57.284ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3302024-11-27T20:44:57.284ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3312024-11-27T20:44:57.284ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3322024-11-27T20:44:57.284ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3332024-11-27T20:44:57.293ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:367
3342024-11-27T20:44:57.293ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 37e32039-a8dd-4947-8c19-c28ef6335cf2 (zpool)
3352024-11-27T20:44:57.391ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 37e32039-a8dd-4947-8c19-c28ef6335cf2 (zpool), kind: External }
3362024-11-27T20:44:57.399ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:240
3372024-11-27T20:44:57.399ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:242
3382024-11-27T20:44:57.399ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:246
3392024-11-27T20:44:57.399ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:248
3402024-11-27T20:44:57.399ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3412024-11-27T20:44:57.399ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3422024-11-27T20:44:57.399ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3432024-11-27T20:44:57.403ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/0f17ab63-f38a-412f-a653-029795d7304e) file = sled-agent/src/probe_manager.rs:231 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e
3442024-11-27T20:44:57.435ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3452024-11-27T20:44:57.445ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_37e32039-a8dd-4947-8c19-c28ef6335cf2/crypt/zone file = sled-storage/src/dataset.rs:303
3462024-11-27T20:44:57.623ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_37e32039-a8dd-4947-8c19-c28ef6335cf2 file = sled-storage/src/dataset.rs:389
3472024-11-27T20:44:57.630ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3482024-11-27T20:44:57.630ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3492024-11-27T20:44:57.630ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3502024-11-27T20:44:57.630ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3512024-11-27T20:44:57.630ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3522024-11-27T20:44:57.640ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:367
3532024-11-27T20:44:57.640ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = c3225150-4706-46cb-9890-c4e173582acb (zpool)
3542024-11-27T20:44:57.736ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: c3225150-4706-46cb-9890-c4e173582acb (zpool), kind: External }
3552024-11-27T20:44:57.744ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:240
3562024-11-27T20:44:57.744ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:242
3572024-11-27T20:44:57.744ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:246
3582024-11-27T20:44:57.744ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:248
3592024-11-27T20:44:57.744ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3602024-11-27T20:44:57.744ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3612024-11-27T20:44:57.744ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3622024-11-27T20:44:57.778ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3632024-11-27T20:44:57.786ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_c3225150-4706-46cb-9890-c4e173582acb/crypt/zone file = sled-storage/src/dataset.rs:303
3642024-11-27T20:44:57.960ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_c3225150-4706-46cb-9890-c4e173582acb file = sled-storage/src/dataset.rs:389
3652024-11-27T20:44:57.969ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3662024-11-27T20:44:57.969ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3672024-11-27T20:44:57.969ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3682024-11-27T20:44:57.969ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3692024-11-27T20:44:57.969ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3702024-11-27T20:44:57.978ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:367
3712024-11-27T20:44:57.978ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 4393a6b4-1740-4ce1-b6df-2d78fb8128b9 (zpool)
3722024-11-27T20:44:58.076ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 4393a6b4-1740-4ce1-b6df-2d78fb8128b9 (zpool), kind: External }
3732024-11-27T20:44:58.084ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:240
3742024-11-27T20:44:58.084ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:242
3752024-11-27T20:44:58.084ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:246
3762024-11-27T20:44:58.084ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:248
3772024-11-27T20:44:58.084ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3782024-11-27T20:44:58.085ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3792024-11-27T20:44:58.085ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3802024-11-27T20:44:58.120ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3812024-11-27T20:44:58.128ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_4393a6b4-1740-4ce1-b6df-2d78fb8128b9/crypt/zone file = sled-storage/src/dataset.rs:303
3822024-11-27T20:44:58.300ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_4393a6b4-1740-4ce1-b6df-2d78fb8128b9 file = sled-storage/src/dataset.rs:389
3832024-11-27T20:44:58.308ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3842024-11-27T20:44:58.308ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3852024-11-27T20:44:58.308ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3862024-11-27T20:44:58.308ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3872024-11-27T20:44:58.308ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3882024-11-27T20:44:58.317ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:367
3892024-11-27T20:44:58.317ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = bd1e9859-f391-4410-ac6a-94d84a761bf8 (zpool)
3902024-11-27T20:44:58.418ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: bd1e9859-f391-4410-ac6a-94d84a761bf8 (zpool), kind: External }
3912024-11-27T20:44:58.426ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:240
3922024-11-27T20:44:58.426ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:242
3932024-11-27T20:44:58.426ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:246
3942024-11-27T20:44:58.426ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:248
3952024-11-27T20:44:58.426ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3962024-11-27T20:44:58.426ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3972024-11-27T20:44:58.426ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3982024-11-27T20:44:58.430ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/0f17ab63-f38a-412f-a653-029795d7304e) file = sled-agent/src/probe_manager.rs:231 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e
3992024-11-27T20:44:58.463ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4002024-11-27T20:44:58.470ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_bd1e9859-f391-4410-ac6a-94d84a761bf8/crypt/zone file = sled-storage/src/dataset.rs:303
4012024-11-27T20:44:58.638ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_bd1e9859-f391-4410-ac6a-94d84a761bf8 file = sled-storage/src/dataset.rs:389
4022024-11-27T20:44:58.646ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
4032024-11-27T20:44:58.646ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
4042024-11-27T20:44:58.646ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
4052024-11-27T20:44:58.646ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4062024-11-27T20:44:58.646ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
4072024-11-27T20:44:58.656ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:367
4082024-11-27T20:44:58.656ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = f94a6d1b-9178-4c13-817f-a77b6a6cd97e (zpool)
4092024-11-27T20:44:58.752ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: f94a6d1b-9178-4c13-817f-a77b6a6cd97e (zpool), kind: External }
4102024-11-27T20:44:58.760ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:240
4112024-11-27T20:44:58.760ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:242
4122024-11-27T20:44:58.760ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:246
4132024-11-27T20:44:58.760ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:248
4142024-11-27T20:44:58.760ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4152024-11-27T20:44:58.760ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4162024-11-27T20:44:58.760ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
4172024-11-27T20:44:58.811ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4182024-11-27T20:44:58.820ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_f94a6d1b-9178-4c13-817f-a77b6a6cd97e/crypt/zone file = sled-storage/src/dataset.rs:303
4192024-11-27T20:44:59.000ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_f94a6d1b-9178-4c13-817f-a77b6a6cd97e file = sled-storage/src/dataset.rs:389
4202024-11-27T20:44:59.009ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
4212024-11-27T20:44:59.009ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4222024-11-27T20:44:59.009ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4232024-11-27T20:44:59.009ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4242024-11-27T20:44:59.009ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4252024-11-27T20:44:59.019ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:367
4262024-11-27T20:44:59.019ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 0b66aa68-555b-43d3-99fd-94013fc7fb74 (zpool)
4272024-11-27T20:44:59.114ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 0b66aa68-555b-43d3-99fd-94013fc7fb74 (zpool), kind: External }
4282024-11-27T20:44:59.123ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:240
4292024-11-27T20:44:59.123ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:242
4302024-11-27T20:44:59.123ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:246
4312024-11-27T20:44:59.123ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:248
4322024-11-27T20:44:59.123ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4332024-11-27T20:44:59.123ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4342024-11-27T20:44:59.123ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
4352024-11-27T20:44:59.158ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4362024-11-27T20:44:59.166ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_0b66aa68-555b-43d3-99fd-94013fc7fb74/crypt/zone file = sled-storage/src/dataset.rs:303
4372024-11-27T20:44:59.338ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_0b66aa68-555b-43d3-99fd-94013fc7fb74 file = sled-storage/src/dataset.rs:389
4382024-11-27T20:44:59.346ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4392024-11-27T20:44:59.346ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4402024-11-27T20:44:59.346ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/71828714-15a3-4f82-918a-cbabee4531fa/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4412024-11-27T20:44:59.346ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(2), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 71828714-15a3-4f82-918a-cbabee4531fa (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f58570a3-13b1-4b0c-ac0c-e8a0652f7ced (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: ff99775c-fb56-419e-aef8-9c8117494384 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 54375e11-a569-4c64-8c24-c6dfba089c32 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a7344162-b09f-4fab-9022-409ee4ca9964 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 37e32039-a8dd-4947-8c19-c28ef6335cf2 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: c3225150-4706-46cb-9890-c4e173582acb (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 4393a6b4-1740-4ce1-b6df-2d78fb8128b9 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: bd1e9859-f391-4410-ac6a-94d84a761bf8 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f94a6d1b-9178-4c13-817f-a77b6a6cd97e (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 0b66aa68-555b-43d3-99fd-94013fc7fb74 (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4422024-11-27T20:44:59.346ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
4432024-11-27T20:44:59.346ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
4442024-11-27T20:44:59.346ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/f58570a3-13b1-4b0c-ac0c-e8a0652f7ced/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4452024-11-27T20:44:59.346ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:900 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e
4462024-11-27T20:44:59.346ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
4472024-11-27T20:44:59.346ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:926 generation = Generation(2) sled_id = 0f17ab63-f38a-412f-a653-029795d7304e
4482024-11-27T20:44:59.346ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:931 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e
4492024-11-27T20:44:59.346ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:936 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e
4502024-11-27T20:44:59.346ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:122 gen = Generation(2) sled_id = 0f17ab63-f38a-412f-a653-029795d7304e
4512024-11-27T20:44:59.346ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:942 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e
4522024-11-27T20:44:59.346ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(2)
4532024-11-27T20:44:59.346ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:947 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e
4542024-11-27T20:44:59.346ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3432726 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:46668 req_id = 943f7c6f-7e26-4731-af1c-10a2b1503c93 response_code = 200 uri = /omicron-physical-disks
4552024-11-27T20:44:59.378ZINFOSledAgent (RSS): attempting to set up sled's datasets: DatasetsConfig { generation: Generation(1), datasets: {07939fe4-4312-4242-8a70-4864882a3485 (dataset): DatasetConfig { id: 07939fe4-4312-4242-8a70-4864882a3485 (dataset), name: DatasetName { pool_name: ZpoolName { id: a7344162-b09f-4fab-9022-409ee4ca9964 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_e9e56728-efea-4219-afac-d4b3fc62d122" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 09727dd8-6607-4b80-8a40-8252aa059e8a (dataset): DatasetConfig { id: 09727dd8-6607-4b80-8a40-8252aa059e8a (dataset), name: DatasetName { pool_name: ZpoolName { id: ff99775c-fb56-419e-aef8-9c8117494384 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 09fc2e67-de18-4ac8-8519-678e8a70e254 (dataset): DatasetConfig { id: 09fc2e67-de18-4ac8-8519-678e8a70e254 (dataset), name: DatasetName { pool_name: ZpoolName { id: c3225150-4706-46cb-9890-c4e173582acb (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_930271d3-e3bf-4a49-aafa-99fc0d6522b0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0a52088a-1a40-42ce-8f62-1b16b6fab002 (dataset): DatasetConfig { id: 0a52088a-1a40-42ce-8f62-1b16b6fab002 (dataset), name: DatasetName { pool_name: ZpoolName { id: c3225150-4706-46cb-9890-c4e173582acb (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0bcd572b-b784-45a5-a3eb-9b3d24bf105d (dataset): DatasetConfig { id: 0bcd572b-b784-45a5-a3eb-9b3d24bf105d (dataset), name: DatasetName { pool_name: ZpoolName { id: f94a6d1b-9178-4c13-817f-a77b6a6cd97e (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 187aa9ed-8d48-499b-a2ab-aec5b3f7ab7d (dataset): DatasetConfig { id: 187aa9ed-8d48-499b-a2ab-aec5b3f7ab7d (dataset), name: DatasetName { pool_name: ZpoolName { id: 0b66aa68-555b-43d3-99fd-94013fc7fb74 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_fb7409be-e1e9-41dc-ba28-37cdd7b9c8d6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1a3d5142-2a1f-41d1-b2cb-e20a254df7a8 (dataset): DatasetConfig { id: 1a3d5142-2a1f-41d1-b2cb-e20a254df7a8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 37e32039-a8dd-4947-8c19-c28ef6335cf2 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1b246d04-a1f5-4200-9591-f0311b6dc364 (dataset): DatasetConfig { id: 1b246d04-a1f5-4200-9591-f0311b6dc364 (dataset), name: DatasetName { pool_name: ZpoolName { id: c3225150-4706-46cb-9890-c4e173582acb (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 1bc032b5-dcce-4c8c-887d-426eb8e88715 (dataset): DatasetConfig { id: 1bc032b5-dcce-4c8c-887d-426eb8e88715 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4393a6b4-1740-4ce1-b6df-2d78fb8128b9 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_b620ee63-750b-4cff-b1e4-2bb3459911f2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1e549b75-4ce1-4a0f-999a-056b7b397ec7 (dataset): DatasetConfig { id: 1e549b75-4ce1-4a0f-999a-056b7b397ec7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 37e32039-a8dd-4947-8c19-c28ef6335cf2 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 279cbc4f-e243-4dfa-a889-20d6456bf649 (dataset): DatasetConfig { id: 279cbc4f-e243-4dfa-a889-20d6456bf649 (dataset), name: DatasetName { pool_name: ZpoolName { id: a7344162-b09f-4fab-9022-409ee4ca9964 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_e70e832a-d23d-4681-854d-05e6b3b433d8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2bf0fb46-3880-40e9-9bfe-4f6797c6d96b (dataset): DatasetConfig { id: 2bf0fb46-3880-40e9-9bfe-4f6797c6d96b (dataset), name: DatasetName { pool_name: ZpoolName { id: ff99775c-fb56-419e-aef8-9c8117494384 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_ae973228-9cf8-450f-8ac4-7d740fc62ad6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2d4b67ba-7663-4cb6-a96b-1bed3e33a45f (dataset): DatasetConfig { id: 2d4b67ba-7663-4cb6-a96b-1bed3e33a45f (dataset), name: DatasetName { pool_name: ZpoolName { id: bd1e9859-f391-4410-ac6a-94d84a761bf8 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_1765ccc4-2c06-4c6d-ae19-b79c0f7578bc" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 37adeb39-a068-4936-9182-27f86e1b2b38 (dataset): DatasetConfig { id: 37adeb39-a068-4936-9182-27f86e1b2b38 (dataset), name: DatasetName { pool_name: ZpoolName { id: 54375e11-a569-4c64-8c24-c6dfba089c32 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_52f03443-0950-44b1-839a-35fd71795350" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3849e0bb-7c5e-4b9f-a7e6-bf15836a4439 (dataset): DatasetConfig { id: 3849e0bb-7c5e-4b9f-a7e6-bf15836a4439 (dataset), name: DatasetName { pool_name: ZpoolName { id: bd1e9859-f391-4410-ac6a-94d84a761bf8 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 3acdb65f-4150-4710-86e2-632cc6f57722 (dataset): DatasetConfig { id: 3acdb65f-4150-4710-86e2-632cc6f57722 (dataset), name: DatasetName { pool_name: ZpoolName { id: 54375e11-a569-4c64-8c24-c6dfba089c32 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3f25ca19-2f6e-474c-a021-68cb43c97a90 (dataset): DatasetConfig { id: 3f25ca19-2f6e-474c-a021-68cb43c97a90 (dataset), name: DatasetName { pool_name: ZpoolName { id: 37e32039-a8dd-4947-8c19-c28ef6335cf2 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 47153aa6-352a-4196-840a-285caddca68c (dataset): DatasetConfig { id: 47153aa6-352a-4196-840a-285caddca68c (dataset), name: DatasetName { pool_name: ZpoolName { id: 0b66aa68-555b-43d3-99fd-94013fc7fb74 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 47688289-f38e-40b6-937c-87864516ed31 (dataset): DatasetConfig { id: 47688289-f38e-40b6-937c-87864516ed31 (dataset), name: DatasetName { pool_name: ZpoolName { id: ff99775c-fb56-419e-aef8-9c8117494384 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_85b62460-1774-4b0f-80ef-e51e72587837" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4edbc297-70bb-471e-8b5d-ec3626367534 (dataset): DatasetConfig { id: 4edbc297-70bb-471e-8b5d-ec3626367534 (dataset), name: DatasetName { pool_name: ZpoolName { id: 54375e11-a569-4c64-8c24-c6dfba089c32 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_4436f451-3d3d-4865-8a88-b09e2df9d2a4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 503210c1-3116-4691-8c3b-ccc97583f574 (dataset): DatasetConfig { id: 503210c1-3116-4691-8c3b-ccc97583f574 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0b66aa68-555b-43d3-99fd-94013fc7fb74 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_3153c6ff-7972-4eff-961c-d5e1d29efabc" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 53ed1bfd-de1a-4b22-9a29-84536aeecf4f (dataset): DatasetConfig { id: 53ed1bfd-de1a-4b22-9a29-84536aeecf4f (dataset), name: DatasetName { pool_name: ZpoolName { id: 4393a6b4-1740-4ce1-b6df-2d78fb8128b9 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 5df425a5-7877-4861-be34-5b960b404407 (dataset): DatasetConfig { id: 5df425a5-7877-4861-be34-5b960b404407 (dataset), name: DatasetName { pool_name: ZpoolName { id: 54375e11-a569-4c64-8c24-c6dfba089c32 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6286eeef-44b2-40d6-af9f-d73525116b6a (dataset): DatasetConfig { id: 6286eeef-44b2-40d6-af9f-d73525116b6a (dataset), name: DatasetName { pool_name: ZpoolName { id: 0b66aa68-555b-43d3-99fd-94013fc7fb74 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 64ffc124-c29c-4451-b115-eee3c00e1718 (dataset): DatasetConfig { id: 64ffc124-c29c-4451-b115-eee3c00e1718 (dataset), name: DatasetName { pool_name: ZpoolName { id: a7344162-b09f-4fab-9022-409ee4ca9964 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_b9b36699-cb8e-411f-8a7f-fdeca8531636" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 692f31dc-e5aa-44d6-ad63-e6b5d57aec35 (dataset): DatasetConfig { id: 692f31dc-e5aa-44d6-ad63-e6b5d57aec35 (dataset), name: DatasetName { pool_name: ZpoolName { id: ff99775c-fb56-419e-aef8-9c8117494384 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_ef029baa-d573-494d-9698-1690c9c57399" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6abd950b-65fe-4278-affe-c9807ab302d7 (dataset): DatasetConfig { id: 6abd950b-65fe-4278-affe-c9807ab302d7 (dataset), name: DatasetName { pool_name: ZpoolName { id: bd1e9859-f391-4410-ac6a-94d84a761bf8 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6c4db371-2052-4eae-850f-e437c081f9e9 (dataset): DatasetConfig { id: 6c4db371-2052-4eae-850f-e437c081f9e9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4393a6b4-1740-4ce1-b6df-2d78fb8128b9 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 71dac8cb-fc2f-4ee3-8e01-4da29eda3a71 (dataset): DatasetConfig { id: 71dac8cb-fc2f-4ee3-8e01-4da29eda3a71 (dataset), name: DatasetName { pool_name: ZpoolName { id: f94a6d1b-9178-4c13-817f-a77b6a6cd97e (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 72fab6f5-5521-4fe4-aaf9-47bb989bf247 (dataset): DatasetConfig { id: 72fab6f5-5521-4fe4-aaf9-47bb989bf247 (dataset), name: DatasetName { pool_name: ZpoolName { id: 54375e11-a569-4c64-8c24-c6dfba089c32 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_ead0ca80-fe91-4d95-9487-ba1d84aaa1ee" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7bde7a95-be20-4616-84b5-eb59ab1796bf (dataset): DatasetConfig { id: 7bde7a95-be20-4616-84b5-eb59ab1796bf (dataset), name: DatasetName { pool_name: ZpoolName { id: 54375e11-a569-4c64-8c24-c6dfba089c32 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_16dcdd3a-0d94-4143-9ea2-af6be74d7fdc" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7c7cb94f-df36-4430-bd7d-23f755f4b665 (dataset): DatasetConfig { id: 7c7cb94f-df36-4430-bd7d-23f755f4b665 (dataset), name: DatasetName { pool_name: ZpoolName { id: c3225150-4706-46cb-9890-c4e173582acb (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7d568e52-e839-4ecb-9bac-29ea71aaf4d2 (dataset): DatasetConfig { id: 7d568e52-e839-4ecb-9bac-29ea71aaf4d2 (dataset), name: DatasetName { pool_name: ZpoolName { id: a7344162-b09f-4fab-9022-409ee4ca9964 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 82c2201f-3275-4f45-857e-166dc089aa7d (dataset): DatasetConfig { id: 82c2201f-3275-4f45-857e-166dc089aa7d (dataset), name: DatasetName { pool_name: ZpoolName { id: 54375e11-a569-4c64-8c24-c6dfba089c32 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 87bc3401-f1dc-409a-997d-52b2c2aeeca3 (dataset): DatasetConfig { id: 87bc3401-f1dc-409a-997d-52b2c2aeeca3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 54375e11-a569-4c64-8c24-c6dfba089c32 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 894b782d-c6c6-4f8f-a71e-04d4877b1aaa (dataset): DatasetConfig { id: 894b782d-c6c6-4f8f-a71e-04d4877b1aaa (dataset), name: DatasetName { pool_name: ZpoolName { id: c3225150-4706-46cb-9890-c4e173582acb (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 89a22a99-d354-433d-9fdb-3939824db8e4 (dataset): DatasetConfig { id: 89a22a99-d354-433d-9fdb-3939824db8e4 (dataset), name: DatasetName { pool_name: ZpoolName { id: a7344162-b09f-4fab-9022-409ee4ca9964 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 92261fc7-496d-424a-8eaa-59c2c389d983 (dataset): DatasetConfig { id: 92261fc7-496d-424a-8eaa-59c2c389d983 (dataset), name: DatasetName { pool_name: ZpoolName { id: bd1e9859-f391-4410-ac6a-94d84a761bf8 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_916dfff1-8c7a-4ee9-859d-b29aab2b839b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a0166da1-43a0-4564-98f5-9a16648e4f74 (dataset): DatasetConfig { id: a0166da1-43a0-4564-98f5-9a16648e4f74 (dataset), name: DatasetName { pool_name: ZpoolName { id: 37e32039-a8dd-4947-8c19-c28ef6335cf2 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_72f05dc1-8d0f-4e04-8ddd-f6bfa1bef6a7" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a5550400-8f49-4239-abab-7dd277fe028c (dataset): DatasetConfig { id: a5550400-8f49-4239-abab-7dd277fe028c (dataset), name: DatasetName { pool_name: ZpoolName { id: bd1e9859-f391-4410-ac6a-94d84a761bf8 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_c3958fcf-f239-469b-9c1a-085eb2a46574" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a72a7592-4c1c-4ab7-bc75-bcaad5e625e2 (dataset): DatasetConfig { id: a72a7592-4c1c-4ab7-bc75-bcaad5e625e2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 54375e11-a569-4c64-8c24-c6dfba089c32 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b16ad6ed-1644-4097-bf5e-23839a100315 (dataset): DatasetConfig { id: b16ad6ed-1644-4097-bf5e-23839a100315 (dataset), name: DatasetName { pool_name: ZpoolName { id: ff99775c-fb56-419e-aef8-9c8117494384 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_a189f197-7882-4220-a741-c3ab48d1538d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b22762cf-c4a3-481b-9aa7-4ee459c81d27 (dataset): DatasetConfig { id: b22762cf-c4a3-481b-9aa7-4ee459c81d27 (dataset), name: DatasetName { pool_name: ZpoolName { id: ff99775c-fb56-419e-aef8-9c8117494384 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b8084e79-2e6a-465b-a739-8d28322a2691 (dataset): DatasetConfig { id: b8084e79-2e6a-465b-a739-8d28322a2691 (dataset), name: DatasetName { pool_name: ZpoolName { id: f94a6d1b-9178-4c13-817f-a77b6a6cd97e (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_a687ab65-8cb5-438f-b716-9c6d0acfbb6d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b80f38b1-09e6-4bbd-b2bf-8b66ed4ef10b (dataset): DatasetConfig { id: b80f38b1-09e6-4bbd-b2bf-8b66ed4ef10b (dataset), name: DatasetName { pool_name: ZpoolName { id: a7344162-b09f-4fab-9022-409ee4ca9964 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ba0baf5d-e143-426b-9085-0fe223542d64 (dataset): DatasetConfig { id: ba0baf5d-e143-426b-9085-0fe223542d64 (dataset), name: DatasetName { pool_name: ZpoolName { id: ff99775c-fb56-419e-aef8-9c8117494384 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c38ef379-829b-40e9-902b-fabded9dd865 (dataset): DatasetConfig { id: c38ef379-829b-40e9-902b-fabded9dd865 (dataset), name: DatasetName { pool_name: ZpoolName { id: bd1e9859-f391-4410-ac6a-94d84a761bf8 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ca3bbc4b-e132-44fa-9a02-062340ef27cc (dataset): DatasetConfig { id: ca3bbc4b-e132-44fa-9a02-062340ef27cc (dataset), name: DatasetName { pool_name: ZpoolName { id: 54375e11-a569-4c64-8c24-c6dfba089c32 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_d13b0217-c0a6-4eaa-8098-4068c753e7f8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cd705dde-6853-49e3-898a-f2085fd4bc00 (dataset): DatasetConfig { id: cd705dde-6853-49e3-898a-f2085fd4bc00 (dataset), name: DatasetName { pool_name: ZpoolName { id: c3225150-4706-46cb-9890-c4e173582acb (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_624b70de-5c05-41d7-9bc7-d6788785179f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d21ded48-c333-4035-8124-a0ca71f8b621 (dataset): DatasetConfig { id: d21ded48-c333-4035-8124-a0ca71f8b621 (dataset), name: DatasetName { pool_name: ZpoolName { id: ff99775c-fb56-419e-aef8-9c8117494384 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_3821992c-1524-497b-81ca-b1baf49b4776" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, def5f9a2-e9df-4e02-aaa3-5aaef9a75c30 (dataset): DatasetConfig { id: def5f9a2-e9df-4e02-aaa3-5aaef9a75c30 (dataset), name: DatasetName { pool_name: ZpoolName { id: 54375e11-a569-4c64-8c24-c6dfba089c32 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e2e72eb5-e78e-4ca9-bbc5-eff2fa762d61 (dataset): DatasetConfig { id: e2e72eb5-e78e-4ca9-bbc5-eff2fa762d61 (dataset), name: DatasetName { pool_name: ZpoolName { id: a7344162-b09f-4fab-9022-409ee4ca9964 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e6767141-f064-49c6-bdbe-d5f0ad01af0c (dataset): DatasetConfig { id: e6767141-f064-49c6-bdbe-d5f0ad01af0c (dataset), name: DatasetName { pool_name: ZpoolName { id: f94a6d1b-9178-4c13-817f-a77b6a6cd97e (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e683ef43-574e-482f-9de2-1bdaed1dfb05 (dataset): DatasetConfig { id: e683ef43-574e-482f-9de2-1bdaed1dfb05 (dataset), name: DatasetName { pool_name: ZpoolName { id: ff99775c-fb56-419e-aef8-9c8117494384 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ecf0d559-9be7-42d6-9a02-6382df081603 (dataset): DatasetConfig { id: ecf0d559-9be7-42d6-9a02-6382df081603 (dataset), name: DatasetName { pool_name: ZpoolName { id: ff99775c-fb56-419e-aef8-9c8117494384 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, eda16795-e96e-4d71-9e8f-d43f1118d4de (dataset): DatasetConfig { id: eda16795-e96e-4d71-9e8f-d43f1118d4de (dataset), name: DatasetName { pool_name: ZpoolName { id: a7344162-b09f-4fab-9022-409ee4ca9964 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, eeeaccfe-43a4-48ac-84f4-54ba8270b16d (dataset): DatasetConfig { id: eeeaccfe-43a4-48ac-84f4-54ba8270b16d (dataset), name: DatasetName { pool_name: ZpoolName { id: ff99775c-fb56-419e-aef8-9c8117494384 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_013acbf3-0dbe-4a2b-96c6-c6e57d0f9f5e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f322e915-8fca-4f3e-8fe6-54c2b20ef446 (dataset): DatasetConfig { id: f322e915-8fca-4f3e-8fe6-54c2b20ef446 (dataset), name: DatasetName { pool_name: ZpoolName { id: 37e32039-a8dd-4947-8c19-c28ef6335cf2 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_36882fd9-de52-45bb-ad54-8d8a7a8975d3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f4a0dacd-8a2c-4ad7-a1e8-1cf4227c9e40 (dataset): DatasetConfig { id: f4a0dacd-8a2c-4ad7-a1e8-1cf4227c9e40 (dataset), name: DatasetName { pool_name: ZpoolName { id: 37e32039-a8dd-4947-8c19-c28ef6335cf2 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f6b36dbb-41bb-4c3c-bc46-690cad73fa34 (dataset): DatasetConfig { id: f6b36dbb-41bb-4c3c-bc46-690cad73fa34 (dataset), name: DatasetName { pool_name: ZpoolName { id: ff99775c-fb56-419e-aef8-9c8117494384 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f7b42518-ab15-486a-8f2d-1b273a91a673 (dataset): DatasetConfig { id: f7b42518-ab15-486a-8f2d-1b273a91a673 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0b66aa68-555b-43d3-99fd-94013fc7fb74 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_77818842-4ce3-4fbc-b24e-bfe02c4a0922" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f82ef7e3-e0c5-4b4c-93be-9d4a8b7c2331 (dataset): DatasetConfig { id: f82ef7e3-e0c5-4b4c-93be-9d4a8b7c2331 (dataset), name: DatasetName { pool_name: ZpoolName { id: c3225150-4706-46cb-9890-c4e173582acb (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_28a08a69-cd1e-46f3-83b9-e52da0fd36e5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fa2de44f-bfce-4156-be10-ef840a01fab6 (dataset): DatasetConfig { id: fa2de44f-bfce-4156-be10-ef840a01fab6 (dataset), name: DatasetName { pool_name: ZpoolName { id: ff99775c-fb56-419e-aef8-9c8117494384 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_dea39fd9-f9ae-4cd4-a4be-75231f93c875" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fc4f4f33-96a2-4562-bd52-7e006c12728a (dataset): DatasetConfig { id: fc4f4f33-96a2-4562-bd52-7e006c12728a (dataset), name: DatasetName { pool_name: ZpoolName { id: 4393a6b4-1740-4ce1-b6df-2d78fb8128b9 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fd20d9f0-0193-47d0-b9bb-24e9e7c7aa5c (dataset): DatasetConfig { id: fd20d9f0-0193-47d0-b9bb-24e9e7c7aa5c (dataset), name: DatasetName { pool_name: ZpoolName { id: 0b66aa68-555b-43d3-99fd-94013fc7fb74 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ff1218b5-698c-470e-9b41-be2daa8f852d (dataset): DatasetConfig { id: ff1218b5-698c-470e-9b41-be2daa8f852d (dataset), name: DatasetName { pool_name: ZpoolName { id: ff99775c-fb56-419e-aef8-9c8117494384 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} } file = sled-agent/src/rack_setup/service.rs:444 sled_address = [fd00:1122:3344:101::1]:12345
4562024-11-27T20:44:59.378ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40677
4572024-11-27T20:44:59.379ZINFOSledAgent: datasets ensure file = sled-agent/src/sled_agent.rs:862 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e
4582024-11-27T20:44:59.381ZINFOSledAgent (StorageManager): Received DatasetsEnsure { config: DatasetsConfig { generation: Generation(1), datasets: {07939fe4-4312-4242-8a70-4864882a3485 (dataset): DatasetConfig { id: 07939fe4-4312-4242-8a70-4864882a3485 (dataset), name: DatasetName { pool_name: ZpoolName { id: a7344162-b09f-4fab-9022-409ee4ca9964 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_e9e56728-efea-4219-afac-d4b3fc62d122" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 09727dd8-6607-4b80-8a40-8252aa059e8a (dataset): DatasetConfig { id: 09727dd8-6607-4b80-8a40-8252aa059e8a (dataset), name: DatasetName { pool_name: ZpoolName { id: ff99775c-fb56-419e-aef8-9c8117494384 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 09fc2e67-de18-4ac8-8519-678e8a70e254 (dataset): DatasetConfig { id: 09fc2e67-de18-4ac8-8519-678e8a70e254 (dataset), name: DatasetName { pool_name: ZpoolName { id: c3225150-4706-46cb-9890-c4e173582acb (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_930271d3-e3bf-4a49-aafa-99fc0d6522b0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0a52088a-1a40-42ce-8f62-1b16b6fab002 (dataset): DatasetConfig { id: 0a52088a-1a40-42ce-8f62-1b16b6fab002 (dataset), name: DatasetName { pool_name: ZpoolName { id: c3225150-4706-46cb-9890-c4e173582acb (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0bcd572b-b784-45a5-a3eb-9b3d24bf105d (dataset): DatasetConfig { id: 0bcd572b-b784-45a5-a3eb-9b3d24bf105d (dataset), name: DatasetName { pool_name: ZpoolName { id: f94a6d1b-9178-4c13-817f-a77b6a6cd97e (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 187aa9ed-8d48-499b-a2ab-aec5b3f7ab7d (dataset): DatasetConfig { id: 187aa9ed-8d48-499b-a2ab-aec5b3f7ab7d (dataset), name: DatasetName { pool_name: ZpoolName { id: 0b66aa68-555b-43d3-99fd-94013fc7fb74 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_fb7409be-e1e9-41dc-ba28-37cdd7b9c8d6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1a3d5142-2a1f-41d1-b2cb-e20a254df7a8 (dataset): DatasetConfig { id: 1a3d5142-2a1f-41d1-b2cb-e20a254df7a8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 37e32039-a8dd-4947-8c19-c28ef6335cf2 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1b246d04-a1f5-4200-9591-f0311b6dc364 (dataset): DatasetConfig { id: 1b246d04-a1f5-4200-9591-f0311b6dc364 (dataset), name: DatasetName { pool_name: ZpoolName { id: c3225150-4706-46cb-9890-c4e173582acb (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 1bc032b5-dcce-4c8c-887d-426eb8e88715 (dataset): DatasetConfig { id: 1bc032b5-dcce-4c8c-887d-426eb8e88715 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4393a6b4-1740-4ce1-b6df-2d78fb8128b9 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_b620ee63-750b-4cff-b1e4-2bb3459911f2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1e549b75-4ce1-4a0f-999a-056b7b397ec7 (dataset): DatasetConfig { id: 1e549b75-4ce1-4a0f-999a-056b7b397ec7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 37e32039-a8dd-4947-8c19-c28ef6335cf2 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 279cbc4f-e243-4dfa-a889-20d6456bf649 (dataset): DatasetConfig { id: 279cbc4f-e243-4dfa-a889-20d6456bf649 (dataset), name: DatasetName { pool_name: ZpoolName { id: a7344162-b09f-4fab-9022-409ee4ca9964 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_e70e832a-d23d-4681-854d-05e6b3b433d8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2bf0fb46-3880-40e9-9bfe-4f6797c6d96b (dataset): DatasetConfig { id: 2bf0fb46-3880-40e9-9bfe-4f6797c6d96b (dataset), name: DatasetName { pool_name: ZpoolName { id: ff99775c-fb56-419e-aef8-9c8117494384 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_ae973228-9cf8-450f-8ac4-7d740fc62ad6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2d4b67ba-7663-4cb6-a96b-1bed3e33a45f (dataset): DatasetConfig { id: 2d4b67ba-7663-4cb6-a96b-1bed3e33a45f (dataset), name: DatasetName { pool_name: ZpoolName { id: bd1e9859-f391-4410-ac6a-94d84a761bf8 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_1765ccc4-2c06-4c6d-ae19-b79c0f7578bc" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 37adeb39-a068-4936-9182-27f86e1b2b38 (dataset): DatasetConfig { id: 37adeb39-a068-4936-9182-27f86e1b2b38 (dataset), name: DatasetName { pool_name: ZpoolName { id: 54375e11-a569-4c64-8c24-c6dfba089c32 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_52f03443-0950-44b1-839a-35fd71795350" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3849e0bb-7c5e-4b9f-a7e6-bf15836a4439 (dataset): DatasetConfig { id: 3849e0bb-7c5e-4b9f-a7e6-bf15836a4439 (dataset), name: DatasetName { pool_name: ZpoolName { id: bd1e9859-f391-4410-ac6a-94d84a761bf8 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 3acdb65f-4150-4710-86e2-632cc6f57722 (dataset): DatasetConfig { id: 3acdb65f-4150-4710-86e2-632cc6f57722 (dataset), name: DatasetName { pool_name: ZpoolName { id: 54375e11-a569-4c64-8c24-c6dfba089c32 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3f25ca19-2f6e-474c-a021-68cb43c97a90 (dataset): DatasetConfig { id: 3f25ca19-2f6e-474c-a021-68cb43c97a90 (dataset), name: DatasetName { pool_name: ZpoolName { id: 37e32039-a8dd-4947-8c19-c28ef6335cf2 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 47153aa6-352a-4196-840a-285caddca68c (dataset): DatasetConfig { id: 47153aa6-352a-4196-840a-285caddca68c (dataset), name: DatasetName { pool_name: ZpoolName { id: 0b66aa68-555b-43d3-99fd-94013fc7fb74 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 47688289-f38e-40b6-937c-87864516ed31 (dataset): DatasetConfig { id: 47688289-f38e-40b6-937c-87864516ed31 (dataset), name: DatasetName { pool_name: ZpoolName { id: ff99775c-fb56-419e-aef8-9c8117494384 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_85b62460-1774-4b0f-80ef-e51e72587837" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4edbc297-70bb-471e-8b5d-ec3626367534 (dataset): DatasetConfig { id: 4edbc297-70bb-471e-8b5d-ec3626367534 (dataset), name: DatasetName { pool_name: ZpoolName { id: 54375e11-a569-4c64-8c24-c6dfba089c32 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_4436f451-3d3d-4865-8a88-b09e2df9d2a4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 503210c1-3116-4691-8c3b-ccc97583f574 (dataset): DatasetConfig { id: 503210c1-3116-4691-8c3b-ccc97583f574 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0b66aa68-555b-43d3-99fd-94013fc7fb74 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_3153c6ff-7972-4eff-961c-d5e1d29efabc" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 53ed1bfd-de1a-4b22-9a29-84536aeecf4f (dataset): DatasetConfig { id: 53ed1bfd-de1a-4b22-9a29-84536aeecf4f (dataset), name: DatasetName { pool_name: ZpoolName { id: 4393a6b4-1740-4ce1-b6df-2d78fb8128b9 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 5df425a5-7877-4861-be34-5b960b404407 (dataset): DatasetConfig { id: 5df425a5-7877-4861-be34-5b960b404407 (dataset), name: DatasetName { pool_name: ZpoolName { id: 54375e11-a569-4c64-8c24-c6dfba089c32 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6286eeef-44b2-40d6-af9f-d73525116b6a (dataset): DatasetConfig { id: 6286eeef-44b2-40d6-af9f-d73525116b6a (dataset), name: DatasetName { pool_name: ZpoolName { id: 0b66aa68-555b-43d3-99fd-94013fc7fb74 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 64ffc124-c29c-4451-b115-eee3c00e1718 (dataset): DatasetConfig { id: 64ffc124-c29c-4451-b115-eee3c00e1718 (dataset), name: DatasetName { pool_name: ZpoolName { id: a7344162-b09f-4fab-9022-409ee4ca9964 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_b9b36699-cb8e-411f-8a7f-fdeca8531636" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 692f31dc-e5aa-44d6-ad63-e6b5d57aec35 (dataset): DatasetConfig { id: 692f31dc-e5aa-44d6-ad63-e6b5d57aec35 (dataset), name: DatasetName { pool_name: ZpoolName { id: ff99775c-fb56-419e-aef8-9c8117494384 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_ef029baa-d573-494d-9698-1690c9c57399" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6abd950b-65fe-4278-affe-c9807ab302d7 (dataset): DatasetConfig { id: 6abd950b-65fe-4278-affe-c9807ab302d7 (dataset), name: DatasetName { pool_name: ZpoolName { id: bd1e9859-f391-4410-ac6a-94d84a761bf8 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6c4db371-2052-4eae-850f-e437c081f9e9 (dataset): DatasetConfig { id: 6c4db371-2052-4eae-850f-e437c081f9e9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4393a6b4-1740-4ce1-b6df-2d78fb8128b9 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 71dac8cb-fc2f-4ee3-8e01-4da29eda3a71 (dataset): DatasetConfig { id: 71dac8cb-fc2f-4ee3-8e01-4da29eda3a71 (dataset), name: DatasetName { pool_name: ZpoolName { id: f94a6d1b-9178-4c13-817f-a77b6a6cd97e (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 72fab6f5-5521-4fe4-aaf9-47bb989bf247 (dataset): DatasetConfig { id: 72fab6f5-5521-4fe4-aaf9-47bb989bf247 (dataset), name: DatasetName { pool_name: ZpoolName { id: 54375e11-a569-4c64-8c24-c6dfba089c32 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_ead0ca80-fe91-4d95-9487-ba1d84aaa1ee" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7bde7a95-be20-4616-84b5-eb59ab1796bf (dataset): DatasetConfig { id: 7bde7a95-be20-4616-84b5-eb59ab1796bf (dataset), name: DatasetName { pool_name: ZpoolName { id: 54375e11-a569-4c64-8c24-c6dfba089c32 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_16dcdd3a-0d94-4143-9ea2-af6be74d7fdc" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7c7cb94f-df36-4430-bd7d-23f755f4b665 (dataset): DatasetConfig { id: 7c7cb94f-df36-4430-bd7d-23f755f4b665 (dataset), name: DatasetName { pool_name: ZpoolName { id: c3225150-4706-46cb-9890-c4e173582acb (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7d568e52-e839-4ecb-9bac-29ea71aaf4d2 (dataset): DatasetConfig { id: 7d568e52-e839-4ecb-9bac-29ea71aaf4d2 (dataset), name: DatasetName { pool_name: ZpoolName { id: a7344162-b09f-4fab-9022-409ee4ca9964 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 82c2201f-3275-4f45-857e-166dc089aa7d (dataset): DatasetConfig { id: 82c2201f-3275-4f45-857e-166dc089aa7d (dataset), name: DatasetName { pool_name: ZpoolName { id: 54375e11-a569-4c64-8c24-c6dfba089c32 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 87bc3401-f1dc-409a-997d-52b2c2aeeca3 (dataset): DatasetConfig { id: 87bc3401-f1dc-409a-997d-52b2c2aeeca3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 54375e11-a569-4c64-8c24-c6dfba089c32 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 894b782d-c6c6-4f8f-a71e-04d4877b1aaa (dataset): DatasetConfig { id: 894b782d-c6c6-4f8f-a71e-04d4877b1aaa (dataset), name: DatasetName { pool_name: ZpoolName { id: c3225150-4706-46cb-9890-c4e173582acb (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 89a22a99-d354-433d-9fdb-3939824db8e4 (dataset): DatasetConfig { id: 89a22a99-d354-433d-9fdb-3939824db8e4 (dataset), name: DatasetName { pool_name: ZpoolName { id: a7344162-b09f-4fab-9022-409ee4ca9964 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 92261fc7-496d-424a-8eaa-59c2c389d983 (dataset): DatasetConfig { id: 92261fc7-496d-424a-8eaa-59c2c389d983 (dataset), name: DatasetName { pool_name: ZpoolName { id: bd1e9859-f391-4410-ac6a-94d84a761bf8 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_916dfff1-8c7a-4ee9-859d-b29aab2b839b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a0166da1-43a0-4564-98f5-9a16648e4f74 (dataset): DatasetConfig { id: a0166da1-43a0-4564-98f5-9a16648e4f74 (dataset), name: DatasetName { pool_name: ZpoolName { id: 37e32039-a8dd-4947-8c19-c28ef6335cf2 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_72f05dc1-8d0f-4e04-8ddd-f6bfa1bef6a7" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a5550400-8f49-4239-abab-7dd277fe028c (dataset): DatasetConfig { id: a5550400-8f49-4239-abab-7dd277fe028c (dataset), name: DatasetName { pool_name: ZpoolName { id: bd1e9859-f391-4410-ac6a-94d84a761bf8 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_c3958fcf-f239-469b-9c1a-085eb2a46574" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a72a7592-4c1c-4ab7-bc75-bcaad5e625e2 (dataset): DatasetConfig { id: a72a7592-4c1c-4ab7-bc75-bcaad5e625e2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 54375e11-a569-4c64-8c24-c6dfba089c32 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b16ad6ed-1644-4097-bf5e-23839a100315 (dataset): DatasetConfig { id: b16ad6ed-1644-4097-bf5e-23839a100315 (dataset), name: DatasetName { pool_name: ZpoolName { id: ff99775c-fb56-419e-aef8-9c8117494384 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_a189f197-7882-4220-a741-c3ab48d1538d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b22762cf-c4a3-481b-9aa7-4ee459c81d27 (dataset): DatasetConfig { id: b22762cf-c4a3-481b-9aa7-4ee459c81d27 (dataset), name: DatasetName { pool_name: ZpoolName { id: ff99775c-fb56-419e-aef8-9c8117494384 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b8084e79-2e6a-465b-a739-8d28322a2691 (dataset): DatasetConfig { id: b8084e79-2e6a-465b-a739-8d28322a2691 (dataset), name: DatasetName { pool_name: ZpoolName { id: f94a6d1b-9178-4c13-817f-a77b6a6cd97e (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_a687ab65-8cb5-438f-b716-9c6d0acfbb6d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b80f38b1-09e6-4bbd-b2bf-8b66ed4ef10b (dataset): DatasetConfig { id: b80f38b1-09e6-4bbd-b2bf-8b66ed4ef10b (dataset), name: DatasetName { pool_name: ZpoolName { id: a7344162-b09f-4fab-9022-409ee4ca9964 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ba0baf5d-e143-426b-9085-0fe223542d64 (dataset): DatasetConfig { id: ba0baf5d-e143-426b-9085-0fe223542d64 (dataset), name: DatasetName { pool_name: ZpoolName { id: ff99775c-fb56-419e-aef8-9c8117494384 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c38ef379-829b-40e9-902b-fabded9dd865 (dataset): DatasetConfig { id: c38ef379-829b-40e9-902b-fabded9dd865 (dataset), name: DatasetName { pool_name: ZpoolName { id: bd1e9859-f391-4410-ac6a-94d84a761bf8 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ca3bbc4b-e132-44fa-9a02-062340ef27cc (dataset): DatasetConfig { id: ca3bbc4b-e132-44fa-9a02-062340ef27cc (dataset), name: DatasetName { pool_name: ZpoolName { id: 54375e11-a569-4c64-8c24-c6dfba089c32 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_d13b0217-c0a6-4eaa-8098-4068c753e7f8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cd705dde-6853-49e3-898a-f2085fd4bc00 (dataset): DatasetConfig { id: cd705dde-6853-49e3-898a-f2085fd4bc00 (dataset), name: DatasetName { pool_name: ZpoolName { id: c3225150-4706-46cb-9890-c4e173582acb (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_624b70de-5c05-41d7-9bc7-d6788785179f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d21ded48-c333-4035-8124-a0ca71f8b621 (dataset): DatasetConfig { id: d21ded48-c333-4035-8124-a0ca71f8b621 (dataset), name: DatasetName { pool_name: ZpoolName { id: ff99775c-fb56-419e-aef8-9c8117494384 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_3821992c-1524-497b-81ca-b1baf49b4776" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, def5f9a2-e9df-4e02-aaa3-5aaef9a75c30 (dataset): DatasetConfig { id: def5f9a2-e9df-4e02-aaa3-5aaef9a75c30 (dataset), name: DatasetName { pool_name: ZpoolName { id: 54375e11-a569-4c64-8c24-c6dfba089c32 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e2e72eb5-e78e-4ca9-bbc5-eff2fa762d61 (dataset): DatasetConfig { id: e2e72eb5-e78e-4ca9-bbc5-eff2fa762d61 (dataset), name: DatasetName { pool_name: ZpoolName { id: a7344162-b09f-4fab-9022-409ee4ca9964 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e6767141-f064-49c6-bdbe-d5f0ad01af0c (dataset): DatasetConfig { id: e6767141-f064-49c6-bdbe-d5f0ad01af0c (dataset), name: DatasetName { pool_name: ZpoolName { id: f94a6d1b-9178-4c13-817f-a77b6a6cd97e (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e683ef43-574e-482f-9de2-1bdaed1dfb05 (dataset): DatasetConfig { id: e683ef43-574e-482f-9de2-1bdaed1dfb05 (dataset), name: DatasetName { pool_name: ZpoolName { id: ff99775c-fb56-419e-aef8-9c8117494384 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ecf0d559-9be7-42d6-9a02-6382df081603 (dataset): DatasetConfig { id: ecf0d559-9be7-42d6-9a02-6382df081603 (dataset), name: DatasetName { pool_name: ZpoolName { id: ff99775c-fb56-419e-aef8-9c8117494384 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, eda16795-e96e-4d71-9e8f-d43f1118d4de (dataset): DatasetConfig { id: eda16795-e96e-4d71-9e8f-d43f1118d4de (dataset), name: DatasetName { pool_name: ZpoolName { id: a7344162-b09f-4fab-9022-409ee4ca9964 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, eeeaccfe-43a4-48ac-84f4-54ba8270b16d (dataset): DatasetConfig { id: eeeaccfe-43a4-48ac-84f4-54ba8270b16d (dataset), name: DatasetName { pool_name: ZpoolName { id: ff99775c-fb56-419e-aef8-9c8117494384 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_013acbf3-0dbe-4a2b-96c6-c6e57d0f9f5e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f322e915-8fca-4f3e-8fe6-54c2b20ef446 (dataset): DatasetConfig { id: f322e915-8fca-4f3e-8fe6-54c2b20ef446 (dataset), name: DatasetName { pool_name: ZpoolName { id: 37e32039-a8dd-4947-8c19-c28ef6335cf2 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_36882fd9-de52-45bb-ad54-8d8a7a8975d3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f4a0dacd-8a2c-4ad7-a1e8-1cf4227c9e40 (dataset): DatasetConfig { id: f4a0dacd-8a2c-4ad7-a1e8-1cf4227c9e40 (dataset), name: DatasetName { pool_name: ZpoolName { id: 37e32039-a8dd-4947-8c19-c28ef6335cf2 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f6b36dbb-41bb-4c3c-bc46-690cad73fa34 (dataset): DatasetConfig { id: f6b36dbb-41bb-4c3c-bc46-690cad73fa34 (dataset), name: DatasetName { pool_name: ZpoolName { id: ff99775c-fb56-419e-aef8-9c8117494384 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f7b42518-ab15-486a-8f2d-1b273a91a673 (dataset): DatasetConfig { id: f7b42518-ab15-486a-8f2d-1b273a91a673 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0b66aa68-555b-43d3-99fd-94013fc7fb74 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_77818842-4ce3-4fbc-b24e-bfe02c4a0922" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f82ef7e3-e0c5-4b4c-93be-9d4a8b7c2331 (dataset): DatasetConfig { id: f82ef7e3-e0c5-4b4c-93be-9d4a8b7c2331 (dataset), name: DatasetName { pool_name: ZpoolName { id: c3225150-4706-46cb-9890-c4e173582acb (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_28a08a69-cd1e-46f3-83b9-e52da0fd36e5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fa2de44f-bfce-4156-be10-ef840a01fab6 (dataset): DatasetConfig { id: fa2de44f-bfce-4156-be10-ef840a01fab6 (dataset), name: DatasetName { pool_name: ZpoolName { id: ff99775c-fb56-419e-aef8-9c8117494384 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_dea39fd9-f9ae-4cd4-a4be-75231f93c875" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fc4f4f33-96a2-4562-bd52-7e006c12728a (dataset): DatasetConfig { id: fc4f4f33-96a2-4562-bd52-7e006c12728a (dataset), name: DatasetName { pool_name: ZpoolName { id: 4393a6b4-1740-4ce1-b6df-2d78fb8128b9 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fd20d9f0-0193-47d0-b9bb-24e9e7c7aa5c (dataset): DatasetConfig { id: fd20d9f0-0193-47d0-b9bb-24e9e7c7aa5c (dataset), name: DatasetName { pool_name: ZpoolName { id: 0b66aa68-555b-43d3-99fd-94013fc7fb74 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ff1218b5-698c-470e-9b41-be2daa8f852d (dataset): DatasetConfig { id: ff1218b5-698c-470e-9b41-be2daa8f852d (dataset), name: DatasetName { pool_name: ZpoolName { id: ff99775c-fb56-419e-aef8-9c8117494384 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} }, tx: ... } file = sled-storage/src/manager.rs:603
4592024-11-27T20:44:59.382ZINFOSledAgent (StorageManager): No ledger in /pool/int/71828714-15a3-4f82-918a-cbabee4531fa/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4602024-11-27T20:44:59.382ZINFOSledAgent (StorageManager): No ledger in /pool/int/f58570a3-13b1-4b0c-ac0c-e8a0652f7ced/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4612024-11-27T20:44:59.382ZINFOSledAgent (StorageManager): No previously-stored 'requested datasets', creating new ledger file = sled-storage/src/manager.rs:905 request = datasets_ensure
4622024-11-27T20:44:59.382ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4632024-11-27T20:44:59.382ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a7344162-b09f-4fab-9022-409ee4ca9964/crypt/zone/oxz_crucible_e9e56728-efea-4219-afac-d4b3fc62d122"), full_name: "oxp_a7344162-b09f-4fab-9022-409ee4ca9964/crypt/zone/oxz_crucible_e9e56728-efea-4219-afac-d4b3fc62d122" } file = sled-storage/src/manager.rs:1331
4642024-11-27T20:44:59.432ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/0f17ab63-f38a-412f-a653-029795d7304e) file = sled-agent/src/probe_manager.rs:231 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e
4652024-11-27T20:44:59.476ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4662024-11-27T20:44:59.476ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ff99775c-fb56-419e-aef8-9c8117494384/crypt/debug"), full_name: "oxp_ff99775c-fb56-419e-aef8-9c8117494384/crypt/debug" } file = sled-storage/src/manager.rs:1331
4672024-11-27T20:44:59.544ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4682024-11-27T20:44:59.544ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c3225150-4706-46cb-9890-c4e173582acb/crypt/zone/oxz_cockroachdb_930271d3-e3bf-4a49-aafa-99fc0d6522b0"), full_name: "oxp_c3225150-4706-46cb-9890-c4e173582acb/crypt/zone/oxz_cockroachdb_930271d3-e3bf-4a49-aafa-99fc0d6522b0" } file = sled-storage/src/manager.rs:1331
4692024-11-27T20:44:59.641ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4702024-11-27T20:44:59.641ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_c3225150-4706-46cb-9890-c4e173582acb/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
4712024-11-27T20:44:59.730ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4722024-11-27T20:44:59.730ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f94a6d1b-9178-4c13-817f-a77b6a6cd97e/crypt/zone"), full_name: "oxp_f94a6d1b-9178-4c13-817f-a77b6a6cd97e/crypt/zone" } file = sled-storage/src/manager.rs:1331
4732024-11-27T20:44:59.796ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4742024-11-27T20:44:59.796ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/0b66aa68-555b-43d3-99fd-94013fc7fb74/crypt/zone/oxz_nexus_fb7409be-e1e9-41dc-ba28-37cdd7b9c8d6"), full_name: "oxp_0b66aa68-555b-43d3-99fd-94013fc7fb74/crypt/zone/oxz_nexus_fb7409be-e1e9-41dc-ba28-37cdd7b9c8d6" } file = sled-storage/src/manager.rs:1331
4752024-11-27T20:44:59.895ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4762024-11-27T20:44:59.896ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/37e32039-a8dd-4947-8c19-c28ef6335cf2/crypt/zone"), full_name: "oxp_37e32039-a8dd-4947-8c19-c28ef6335cf2/crypt/zone" } file = sled-storage/src/manager.rs:1331
4772024-11-27T20:44:59.964ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4782024-11-27T20:44:59.964ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c3225150-4706-46cb-9890-c4e173582acb/crypt/debug"), full_name: "oxp_c3225150-4706-46cb-9890-c4e173582acb/crypt/debug" } file = sled-storage/src/manager.rs:1331
4792024-11-27T20:45:00.033ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4802024-11-27T20:45:00.033ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4393a6b4-1740-4ce1-b6df-2d78fb8128b9/crypt/zone/oxz_crucible_b620ee63-750b-4cff-b1e4-2bb3459911f2"), full_name: "oxp_4393a6b4-1740-4ce1-b6df-2d78fb8128b9/crypt/zone/oxz_crucible_b620ee63-750b-4cff-b1e4-2bb3459911f2" } file = sled-storage/src/manager.rs:1331
4812024-11-27T20:45:00.131ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4822024-11-27T20:45:00.131ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/37e32039-a8dd-4947-8c19-c28ef6335cf2/crypt/debug"), full_name: "oxp_37e32039-a8dd-4947-8c19-c28ef6335cf2/crypt/debug" } file = sled-storage/src/manager.rs:1331
4832024-11-27T20:45:00.199ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4842024-11-27T20:45:00.199ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a7344162-b09f-4fab-9022-409ee4ca9964/crypt/zone/oxz_internal_dns_e70e832a-d23d-4681-854d-05e6b3b433d8"), full_name: "oxp_a7344162-b09f-4fab-9022-409ee4ca9964/crypt/zone/oxz_internal_dns_e70e832a-d23d-4681-854d-05e6b3b433d8" } file = sled-storage/src/manager.rs:1331
4852024-11-27T20:45:00.295ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4862024-11-27T20:45:00.295ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ff99775c-fb56-419e-aef8-9c8117494384/crypt/zone/oxz_nexus_ae973228-9cf8-450f-8ac4-7d740fc62ad6"), full_name: "oxp_ff99775c-fb56-419e-aef8-9c8117494384/crypt/zone/oxz_nexus_ae973228-9cf8-450f-8ac4-7d740fc62ad6" } file = sled-storage/src/manager.rs:1331
4872024-11-27T20:45:00.394ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4882024-11-27T20:45:00.394ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/bd1e9859-f391-4410-ac6a-94d84a761bf8/crypt/zone/oxz_crucible_1765ccc4-2c06-4c6d-ae19-b79c0f7578bc"), full_name: "oxp_bd1e9859-f391-4410-ac6a-94d84a761bf8/crypt/zone/oxz_crucible_1765ccc4-2c06-4c6d-ae19-b79c0f7578bc" } file = sled-storage/src/manager.rs:1331
4892024-11-27T20:45:00.434ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/0f17ab63-f38a-412f-a653-029795d7304e) file = sled-agent/src/probe_manager.rs:231 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e
4902024-11-27T20:45:00.485ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4912024-11-27T20:45:00.485ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/54375e11-a569-4c64-8c24-c6dfba089c32/crypt/zone/oxz_crucible_52f03443-0950-44b1-839a-35fd71795350"), full_name: "oxp_54375e11-a569-4c64-8c24-c6dfba089c32/crypt/zone/oxz_crucible_52f03443-0950-44b1-839a-35fd71795350" } file = sled-storage/src/manager.rs:1331
4922024-11-27T20:45:00.579ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4932024-11-27T20:45:00.579ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/bd1e9859-f391-4410-ac6a-94d84a761bf8/crypt/debug"), full_name: "oxp_bd1e9859-f391-4410-ac6a-94d84a761bf8/crypt/debug" } file = sled-storage/src/manager.rs:1331
4942024-11-27T20:45:00.641ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4952024-11-27T20:45:00.641ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/54375e11-a569-4c64-8c24-c6dfba089c32/crypt/zone"), full_name: "oxp_54375e11-a569-4c64-8c24-c6dfba089c32/crypt/zone" } file = sled-storage/src/manager.rs:1331
4962024-11-27T20:45:00.704ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4972024-11-27T20:45:00.704ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_37e32039-a8dd-4947-8c19-c28ef6335cf2/crucible" } file = sled-storage/src/manager.rs:1331
4982024-11-27T20:45:00.784ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4992024-11-27T20:45:00.784ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/0b66aa68-555b-43d3-99fd-94013fc7fb74/crypt/debug"), full_name: "oxp_0b66aa68-555b-43d3-99fd-94013fc7fb74/crypt/debug" } file = sled-storage/src/manager.rs:1331
5002024-11-27T20:45:00.845ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5012024-11-27T20:45:00.845ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ff99775c-fb56-419e-aef8-9c8117494384/crypt/zone/oxz_clickhouse_85b62460-1774-4b0f-80ef-e51e72587837"), full_name: "oxp_ff99775c-fb56-419e-aef8-9c8117494384/crypt/zone/oxz_clickhouse_85b62460-1774-4b0f-80ef-e51e72587837" } file = sled-storage/src/manager.rs:1331
5022024-11-27T20:45:00.937ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5032024-11-27T20:45:00.937ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/54375e11-a569-4c64-8c24-c6dfba089c32/crypt/zone/oxz_ntp_4436f451-3d3d-4865-8a88-b09e2df9d2a4"), full_name: "oxp_54375e11-a569-4c64-8c24-c6dfba089c32/crypt/zone/oxz_ntp_4436f451-3d3d-4865-8a88-b09e2df9d2a4" } file = sled-storage/src/manager.rs:1331
5042024-11-27T20:45:01.036ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5052024-11-27T20:45:01.036ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/0b66aa68-555b-43d3-99fd-94013fc7fb74/crypt/zone/oxz_crucible_3153c6ff-7972-4eff-961c-d5e1d29efabc"), full_name: "oxp_0b66aa68-555b-43d3-99fd-94013fc7fb74/crypt/zone/oxz_crucible_3153c6ff-7972-4eff-961c-d5e1d29efabc" } file = sled-storage/src/manager.rs:1331
5062024-11-27T20:45:01.129ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5072024-11-27T20:45:01.129ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4393a6b4-1740-4ce1-b6df-2d78fb8128b9/crypt/debug"), full_name: "oxp_4393a6b4-1740-4ce1-b6df-2d78fb8128b9/crypt/debug" } file = sled-storage/src/manager.rs:1331
5082024-11-27T20:45:01.191ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5092024-11-27T20:45:01.191ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_54375e11-a569-4c64-8c24-c6dfba089c32/crypt/external_dns" } file = sled-storage/src/manager.rs:1331
5102024-11-27T20:45:01.274ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5112024-11-27T20:45:01.274ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/0b66aa68-555b-43d3-99fd-94013fc7fb74/crypt/zone"), full_name: "oxp_0b66aa68-555b-43d3-99fd-94013fc7fb74/crypt/zone" } file = sled-storage/src/manager.rs:1331
5122024-11-27T20:45:01.336ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5132024-11-27T20:45:01.336ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a7344162-b09f-4fab-9022-409ee4ca9964/crypt/zone/oxz_cockroachdb_b9b36699-cb8e-411f-8a7f-fdeca8531636"), full_name: "oxp_a7344162-b09f-4fab-9022-409ee4ca9964/crypt/zone/oxz_cockroachdb_b9b36699-cb8e-411f-8a7f-fdeca8531636" } file = sled-storage/src/manager.rs:1331
5142024-11-27T20:45:01.430ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5152024-11-27T20:45:01.430ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ff99775c-fb56-419e-aef8-9c8117494384/crypt/zone/oxz_external_dns_ef029baa-d573-494d-9698-1690c9c57399"), full_name: "oxp_ff99775c-fb56-419e-aef8-9c8117494384/crypt/zone/oxz_external_dns_ef029baa-d573-494d-9698-1690c9c57399" } file = sled-storage/src/manager.rs:1331
5162024-11-27T20:45:01.436ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/0f17ab63-f38a-412f-a653-029795d7304e) file = sled-agent/src/probe_manager.rs:231 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e
5172024-11-27T20:45:01.524ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5182024-11-27T20:45:01.524ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_bd1e9859-f391-4410-ac6a-94d84a761bf8/crucible" } file = sled-storage/src/manager.rs:1331
5192024-11-27T20:45:01.606ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5202024-11-27T20:45:01.606ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4393a6b4-1740-4ce1-b6df-2d78fb8128b9/crypt/zone"), full_name: "oxp_4393a6b4-1740-4ce1-b6df-2d78fb8128b9/crypt/zone" } file = sled-storage/src/manager.rs:1331
5212024-11-27T20:45:01.669ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5222024-11-27T20:45:01.669ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f94a6d1b-9178-4c13-817f-a77b6a6cd97e/crypt/debug"), full_name: "oxp_f94a6d1b-9178-4c13-817f-a77b6a6cd97e/crypt/debug" } file = sled-storage/src/manager.rs:1331
5232024-11-27T20:45:01.736ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5242024-11-27T20:45:01.737ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/54375e11-a569-4c64-8c24-c6dfba089c32/crypt/zone/oxz_internal_dns_ead0ca80-fe91-4d95-9487-ba1d84aaa1ee"), full_name: "oxp_54375e11-a569-4c64-8c24-c6dfba089c32/crypt/zone/oxz_internal_dns_ead0ca80-fe91-4d95-9487-ba1d84aaa1ee" } file = sled-storage/src/manager.rs:1331
5252024-11-27T20:45:01.831ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5262024-11-27T20:45:01.831ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/54375e11-a569-4c64-8c24-c6dfba089c32/crypt/zone/oxz_cockroachdb_16dcdd3a-0d94-4143-9ea2-af6be74d7fdc"), full_name: "oxp_54375e11-a569-4c64-8c24-c6dfba089c32/crypt/zone/oxz_cockroachdb_16dcdd3a-0d94-4143-9ea2-af6be74d7fdc" } file = sled-storage/src/manager.rs:1331
5272024-11-27T20:45:01.926ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5282024-11-27T20:45:01.926ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_c3225150-4706-46cb-9890-c4e173582acb/crucible" } file = sled-storage/src/manager.rs:1331
5292024-11-27T20:45:02.010ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5302024-11-27T20:45:02.010ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_a7344162-b09f-4fab-9022-409ee4ca9964/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
5312024-11-27T20:45:02.103ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5322024-11-27T20:45:02.103ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_54375e11-a569-4c64-8c24-c6dfba089c32/crucible" } file = sled-storage/src/manager.rs:1331
5332024-11-27T20:45:02.187ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5342024-11-27T20:45:02.187ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/54375e11-a569-4c64-8c24-c6dfba089c32/crypt/debug"), full_name: "oxp_54375e11-a569-4c64-8c24-c6dfba089c32/crypt/debug" } file = sled-storage/src/manager.rs:1331
5352024-11-27T20:45:02.253ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5362024-11-27T20:45:02.253ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c3225150-4706-46cb-9890-c4e173582acb/crypt/zone"), full_name: "oxp_c3225150-4706-46cb-9890-c4e173582acb/crypt/zone" } file = sled-storage/src/manager.rs:1331
5372024-11-27T20:45:02.319ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5382024-11-27T20:45:02.319ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a7344162-b09f-4fab-9022-409ee4ca9964/crypt/debug"), full_name: "oxp_a7344162-b09f-4fab-9022-409ee4ca9964/crypt/debug" } file = sled-storage/src/manager.rs:1331
5392024-11-27T20:45:02.394ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5402024-11-27T20:45:02.394ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/bd1e9859-f391-4410-ac6a-94d84a761bf8/crypt/zone/oxz_crucible_pantry_916dfff1-8c7a-4ee9-859d-b29aab2b839b"), full_name: "oxp_bd1e9859-f391-4410-ac6a-94d84a761bf8/crypt/zone/oxz_crucible_pantry_916dfff1-8c7a-4ee9-859d-b29aab2b839b" } file = sled-storage/src/manager.rs:1331
5412024-11-27T20:45:02.438ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/0f17ab63-f38a-412f-a653-029795d7304e) file = sled-agent/src/probe_manager.rs:231 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e
5422024-11-27T20:45:02.496ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5432024-11-27T20:45:02.496ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/37e32039-a8dd-4947-8c19-c28ef6335cf2/crypt/zone/oxz_cockroachdb_72f05dc1-8d0f-4e04-8ddd-f6bfa1bef6a7"), full_name: "oxp_37e32039-a8dd-4947-8c19-c28ef6335cf2/crypt/zone/oxz_cockroachdb_72f05dc1-8d0f-4e04-8ddd-f6bfa1bef6a7" } file = sled-storage/src/manager.rs:1331
5442024-11-27T20:45:02.596ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5452024-11-27T20:45:02.596ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/bd1e9859-f391-4410-ac6a-94d84a761bf8/crypt/zone/oxz_crucible_pantry_c3958fcf-f239-469b-9c1a-085eb2a46574"), full_name: "oxp_bd1e9859-f391-4410-ac6a-94d84a761bf8/crypt/zone/oxz_crucible_pantry_c3958fcf-f239-469b-9c1a-085eb2a46574" } file = sled-storage/src/manager.rs:1331
5462024-11-27T20:45:02.640ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 17.848931157s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e
5472024-11-27T20:45:02.694ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5482024-11-27T20:45:02.694ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_54375e11-a569-4c64-8c24-c6dfba089c32/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
5492024-11-27T20:45:02.783ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5502024-11-27T20:45:02.783ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ff99775c-fb56-419e-aef8-9c8117494384/crypt/zone/oxz_crucible_a189f197-7882-4220-a741-c3ab48d1538d"), full_name: "oxp_ff99775c-fb56-419e-aef8-9c8117494384/crypt/zone/oxz_crucible_a189f197-7882-4220-a741-c3ab48d1538d" } file = sled-storage/src/manager.rs:1331
5512024-11-27T20:45:02.883ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5522024-11-27T20:45:02.883ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_ff99775c-fb56-419e-aef8-9c8117494384/crucible" } file = sled-storage/src/manager.rs:1331
5532024-11-27T20:45:02.969ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5542024-11-27T20:45:02.969ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f94a6d1b-9178-4c13-817f-a77b6a6cd97e/crypt/zone/oxz_crucible_a687ab65-8cb5-438f-b716-9c6d0acfbb6d"), full_name: "oxp_f94a6d1b-9178-4c13-817f-a77b6a6cd97e/crypt/zone/oxz_crucible_a687ab65-8cb5-438f-b716-9c6d0acfbb6d" } file = sled-storage/src/manager.rs:1331
5552024-11-27T20:45:03.068ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5562024-11-27T20:45:03.068ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a7344162-b09f-4fab-9022-409ee4ca9964/crypt/zone"), full_name: "oxp_a7344162-b09f-4fab-9022-409ee4ca9964/crypt/zone" } file = sled-storage/src/manager.rs:1331
5572024-11-27T20:45:03.135ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5582024-11-27T20:45:03.135ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ff99775c-fb56-419e-aef8-9c8117494384/crypt/zone"), full_name: "oxp_ff99775c-fb56-419e-aef8-9c8117494384/crypt/zone" } file = sled-storage/src/manager.rs:1331
5592024-11-27T20:45:03.201ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5602024-11-27T20:45:03.201ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/bd1e9859-f391-4410-ac6a-94d84a761bf8/crypt/zone"), full_name: "oxp_bd1e9859-f391-4410-ac6a-94d84a761bf8/crypt/zone" } file = sled-storage/src/manager.rs:1331
5612024-11-27T20:45:03.270ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5622024-11-27T20:45:03.270ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/54375e11-a569-4c64-8c24-c6dfba089c32/crypt/zone/oxz_external_dns_d13b0217-c0a6-4eaa-8098-4068c753e7f8"), full_name: "oxp_54375e11-a569-4c64-8c24-c6dfba089c32/crypt/zone/oxz_external_dns_d13b0217-c0a6-4eaa-8098-4068c753e7f8" } file = sled-storage/src/manager.rs:1331
5632024-11-27T20:45:03.371ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5642024-11-27T20:45:03.371ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c3225150-4706-46cb-9890-c4e173582acb/crypt/zone/oxz_crucible_624b70de-5c05-41d7-9bc7-d6788785179f"), full_name: "oxp_c3225150-4706-46cb-9890-c4e173582acb/crypt/zone/oxz_crucible_624b70de-5c05-41d7-9bc7-d6788785179f" } file = sled-storage/src/manager.rs:1331
5652024-11-27T20:45:03.439ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/0f17ab63-f38a-412f-a653-029795d7304e) file = sled-agent/src/probe_manager.rs:231 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e
5662024-11-27T20:45:03.468ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5672024-11-27T20:45:03.468ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ff99775c-fb56-419e-aef8-9c8117494384/crypt/zone/oxz_cockroachdb_3821992c-1524-497b-81ca-b1baf49b4776"), full_name: "oxp_ff99775c-fb56-419e-aef8-9c8117494384/crypt/zone/oxz_cockroachdb_3821992c-1524-497b-81ca-b1baf49b4776" } file = sled-storage/src/manager.rs:1331
5682024-11-27T20:45:03.566ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5692024-11-27T20:45:03.566ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_54375e11-a569-4c64-8c24-c6dfba089c32/crypt/internal_dns" } file = sled-storage/src/manager.rs:1331
5702024-11-27T20:45:03.654ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5712024-11-27T20:45:03.654ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_a7344162-b09f-4fab-9022-409ee4ca9964/crypt/internal_dns" } file = sled-storage/src/manager.rs:1331
5722024-11-27T20:45:03.742ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5732024-11-27T20:45:03.742ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_f94a6d1b-9178-4c13-817f-a77b6a6cd97e/crucible" } file = sled-storage/src/manager.rs:1331
5742024-11-27T20:45:03.852ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5752024-11-27T20:45:03.852ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_ff99775c-fb56-419e-aef8-9c8117494384/crypt/external_dns" } file = sled-storage/src/manager.rs:1331
5762024-11-27T20:45:03.944ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5772024-11-27T20:45:03.944ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_ff99775c-fb56-419e-aef8-9c8117494384/crypt/internal_dns" } file = sled-storage/src/manager.rs:1331
5782024-11-27T20:45:04.037ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5792024-11-27T20:45:04.037ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_a7344162-b09f-4fab-9022-409ee4ca9964/crucible" } file = sled-storage/src/manager.rs:1331
5802024-11-27T20:45:04.126ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5812024-11-27T20:45:04.126ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ff99775c-fb56-419e-aef8-9c8117494384/crypt/zone/oxz_internal_dns_013acbf3-0dbe-4a2b-96c6-c6e57d0f9f5e"), full_name: "oxp_ff99775c-fb56-419e-aef8-9c8117494384/crypt/zone/oxz_internal_dns_013acbf3-0dbe-4a2b-96c6-c6e57d0f9f5e" } file = sled-storage/src/manager.rs:1331
5822024-11-27T20:45:04.222ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5832024-11-27T20:45:04.222ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/37e32039-a8dd-4947-8c19-c28ef6335cf2/crypt/zone/oxz_crucible_36882fd9-de52-45bb-ad54-8d8a7a8975d3"), full_name: "oxp_37e32039-a8dd-4947-8c19-c28ef6335cf2/crypt/zone/oxz_crucible_36882fd9-de52-45bb-ad54-8d8a7a8975d3" } file = sled-storage/src/manager.rs:1331
5842024-11-27T20:45:04.322ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5852024-11-27T20:45:04.322ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_37e32039-a8dd-4947-8c19-c28ef6335cf2/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
5862024-11-27T20:45:04.414ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5872024-11-27T20:45:04.414ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_ff99775c-fb56-419e-aef8-9c8117494384/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
5882024-11-27T20:45:04.442ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/0f17ab63-f38a-412f-a653-029795d7304e) file = sled-agent/src/probe_manager.rs:231 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e
5892024-11-27T20:45:04.518ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5902024-11-27T20:45:04.518ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/0b66aa68-555b-43d3-99fd-94013fc7fb74/crypt/zone/oxz_nexus_77818842-4ce3-4fbc-b24e-bfe02c4a0922"), full_name: "oxp_0b66aa68-555b-43d3-99fd-94013fc7fb74/crypt/zone/oxz_nexus_77818842-4ce3-4fbc-b24e-bfe02c4a0922" } file = sled-storage/src/manager.rs:1331
5912024-11-27T20:45:04.624ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5922024-11-27T20:45:04.624ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c3225150-4706-46cb-9890-c4e173582acb/crypt/zone/oxz_crucible_pantry_28a08a69-cd1e-46f3-83b9-e52da0fd36e5"), full_name: "oxp_c3225150-4706-46cb-9890-c4e173582acb/crypt/zone/oxz_crucible_pantry_28a08a69-cd1e-46f3-83b9-e52da0fd36e5" } file = sled-storage/src/manager.rs:1331
5932024-11-27T20:45:04.729ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5942024-11-27T20:45:04.730ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ff99775c-fb56-419e-aef8-9c8117494384/crypt/zone/oxz_oximeter_dea39fd9-f9ae-4cd4-a4be-75231f93c875"), full_name: "oxp_ff99775c-fb56-419e-aef8-9c8117494384/crypt/zone/oxz_oximeter_dea39fd9-f9ae-4cd4-a4be-75231f93c875" } file = sled-storage/src/manager.rs:1331
5952024-11-27T20:45:04.833ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5962024-11-27T20:45:04.833ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_4393a6b4-1740-4ce1-b6df-2d78fb8128b9/crucible" } file = sled-storage/src/manager.rs:1331
5972024-11-27T20:45:04.878ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:4292
5982024-11-27T20:45:04.878ZINFOSledAgent (ServiceManager): Ensuring there is a default route file = sled-agent/src/services.rs:4302 gateway = fd00:1122:3344:101::1
5992024-11-27T20:45:04.886ZINFOSledAgent (ServiceManager): Default route already exists file = sled-agent/src/services.rs:4316 gateway = fd00:1122:3344:101::1
6002024-11-27T20:45:04.886ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4381
6012024-11-27T20:45:04.930ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
6022024-11-27T20:45:04.930ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_0b66aa68-555b-43d3-99fd-94013fc7fb74/crucible" } file = sled-storage/src/manager.rs:1331
6032024-11-27T20:45:05.037ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
6042024-11-27T20:45:05.037ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_ff99775c-fb56-419e-aef8-9c8117494384/crypt/clickhouse" } file = sled-storage/src/manager.rs:1331
6052024-11-27T20:45:05.039ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4447
6062024-11-27T20:45:05.039ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4474
6072024-11-27T20:45:05.085ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4487
6082024-11-27T20:45:05.085ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4333
6092024-11-27T20:45:05.138ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/71828714-15a3-4f82-918a-cbabee4531fa/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6102024-11-27T20:45:05.138ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/f58570a3-13b1-4b0c-ac0c-e8a0652f7ced/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6112024-11-27T20:45:05.138ZINFOSledAgent: datasets ensure: Updated storage file = sled-agent/src/sled_agent.rs:864 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e
6122024-11-27T20:45:05.138ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4375
6132024-11-27T20:45:05.138ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4454 rack_subnet = fd00:1122:3344::
6142024-11-27T20:45:05.141ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5762574 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:40677 req_id = bceee72c-1e0c-40e5-bdd5-0ba9b9d6da96 response_code = 200 uri = /datasets
6152024-11-27T20:45:05.160ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4465
6162024-11-27T20:45:05.160ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4507
6172024-11-27T20:45:05.188ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: 013acbf3-0dbe-4a2b-96c6-c6e57d0f9f5e (service), filesystem_pool: Some(ZpoolName { id: ff99775c-fb56-419e-aef8-9c8117494384 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ff99775c-fb56-419e-aef8-9c8117494384 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: ead0ca80-fe91-4d95-9487-ba1d84aaa1ee (service), filesystem_pool: Some(ZpoolName { id: 54375e11-a569-4c64-8c24-c6dfba089c32 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 54375e11-a569-4c64-8c24-c6dfba089c32 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: e70e832a-d23d-4681-854d-05e6b3b433d8 (service), filesystem_pool: Some(ZpoolName { id: a7344162-b09f-4fab-9022-409ee4ca9964 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a7344162-b09f-4fab-9022-409ee4ca9964 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:525 sled_address = [fd00:1122:3344:101::1]:12345
6182024-11-27T20:45:05.188ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:49832
6192024-11-27T20:45:05.188ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 013acbf3-0dbe-4a2b-96c6-c6e57d0f9f5e, dataset_name: DatasetName { pool_name: ZpoolName { id: ff99775c-fb56-419e-aef8-9c8117494384 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
6202024-11-27T20:45:05.188ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 013acbf3-0dbe-4a2b-96c6-c6e57d0f9f5e, dataset_name: DatasetName { pool_name: ZpoolName { id: ff99775c-fb56-419e-aef8-9c8117494384 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6212024-11-27T20:45:05.225ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: ead0ca80-fe91-4d95-9487-ba1d84aaa1ee, dataset_name: DatasetName { pool_name: ZpoolName { id: 54375e11-a569-4c64-8c24-c6dfba089c32 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
6222024-11-27T20:45:05.225ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: ead0ca80-fe91-4d95-9487-ba1d84aaa1ee, dataset_name: DatasetName { pool_name: ZpoolName { id: 54375e11-a569-4c64-8c24-c6dfba089c32 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6232024-11-27T20:45:05.233ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4539
6242024-11-27T20:45:05.233ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4545
6252024-11-27T20:45:05.262ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: e70e832a-d23d-4681-854d-05e6b3b433d8, dataset_name: DatasetName { pool_name: ZpoolName { id: a7344162-b09f-4fab-9022-409ee4ca9964 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
6262024-11-27T20:45:05.262ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: e70e832a-d23d-4681-854d-05e6b3b433d8, dataset_name: DatasetName { pool_name: ZpoolName { id: a7344162-b09f-4fab-9022-409ee4ca9964 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6272024-11-27T20:45:05.295ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6282024-11-27T20:45:05.295ZINFOSledAgent (ServiceManager): No ledger in /pool/int/71828714-15a3-4f82-918a-cbabee4531fa/config/omicron-zones.json file = common/src/ledger.rs:188
6292024-11-27T20:45:05.295ZINFOSledAgent (ServiceManager): No ledger in /pool/int/f58570a3-13b1-4b0c-ac0c-e8a0652f7ced/config/omicron-zones.json file = common/src/ledger.rs:188
6302024-11-27T20:45:05.295ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6312024-11-27T20:45:05.335ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4586
6322024-11-27T20:45:05.335ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:370
6332024-11-27T20:45:05.343ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 18008145077018772918 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e
6342024-11-27T20:45:05.343ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9741239623583156828 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e
6352024-11-27T20:45:05.345ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6362024-11-27T20:45:05.345ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6372024-11-27T20:45:05.345ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6382024-11-27T20:45:05.393ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:420
6392024-11-27T20:45:05.394ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/0f17ab63-f38a-412f-a653-029795d7304e) file = sled-agent/src/nexus.rs:527 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e
6402024-11-27T20:45:05.401ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_013acbf3-0dbe-4a2b-96c6-c6e57d0f9f5e file = illumos-utils/src/zone.rs:325
6412024-11-27T20:45:05.405ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_ead0ca80-fe91-4d95-9487-ba1d84aaa1ee file = illumos-utils/src/zone.rs:325
6422024-11-27T20:45:05.410ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_e70e832a-d23d-4681-854d-05e6b3b433d8 file = illumos-utils/src/zone.rs:325
6432024-11-27T20:45:05.421ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_013acbf3-0dbe-4a2b-96c6-c6e57d0f9f5e file = illumos-utils/src/zone.rs:363
6442024-11-27T20:45:05.426ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_ead0ca80-fe91-4d95-9487-ba1d84aaa1ee file = illumos-utils/src/zone.rs:363
6452024-11-27T20:45:05.431ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_e70e832a-d23d-4681-854d-05e6b3b433d8 file = illumos-utils/src/zone.rs:363
6462024-11-27T20:45:05.444ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/0f17ab63-f38a-412f-a653-029795d7304e) file = sled-agent/src/probe_manager.rs:231 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e
6472024-11-27T20:45:05.448ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:717
6482024-11-27T20:45:05.448ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:762
6492024-11-27T20:45:05.448ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:765 uptime = 1
6502024-11-27T20:45:05.448ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.1.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: Some(\n None,\n ),\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n tx_eq: None,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:444
6512024-11-27T20:45:05.488ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
6522024-11-27T20:45:05.557ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:603
6532024-11-27T20:45:05.557ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
6542024-11-27T20:45:05.557ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
6552024-11-27T20:45:05.557ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
6562024-11-27T20:45:05.557ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
6572024-11-27T20:45:05.557ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
6582024-11-27T20:45:05.557ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
6592024-11-27T20:45:05.557ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
6602024-11-27T20:45:05.557ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
6612024-11-27T20:45:05.557ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
6622024-11-27T20:45:05.557ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
6632024-11-27T20:45:05.557ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
6642024-11-27T20:45:05.557ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
6652024-11-27T20:45:05.557ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
6662024-11-27T20:45:05.557ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
6672024-11-27T20:45:05.557ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
6682024-11-27T20:45:05.557ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
6692024-11-27T20:45:05.557ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
6702024-11-27T20:45:05.557ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
6712024-11-27T20:45:05.557ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
6722024-11-27T20:45:05.557ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
6732024-11-27T20:45:05.557ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
6742024-11-27T20:45:05.557ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
6752024-11-27T20:45:06.278ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10801473587821902893 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e
6762024-11-27T20:45:06.278ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9544658036638116349 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e
6772024-11-27T20:45:06.445ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/0f17ab63-f38a-412f-a653-029795d7304e) file = sled-agent/src/probe_manager.rs:231 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e
6782024-11-27T20:45:07.048ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_e70e832a-d23d-4681-854d-05e6b3b433d8: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6792024-11-27T20:45:07.048ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
6802024-11-27T20:45:07.048ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_e70e832a-d23d-4681-854d-05e6b3b433d8 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_e70e832a-d23d-4681-854d-05e6b3b433d8
6812024-11-27T20:45:07.535ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_013acbf3-0dbe-4a2b-96c6-c6e57d0f9f5e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6822024-11-27T20:45:08.017ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_ead0ca80-fe91-4d95-9487-ba1d84aaa1ee: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6832024-11-27T20:45:08.017ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
6842024-11-27T20:45:08.025ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e70e832a-d23d-4681-854d-05e6b3b433d8") failed: Property not found. retry in 45.954134ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_e70e832a-d23d-4681-854d-05e6b3b433d8
6852024-11-27T20:45:08.025ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
6862024-11-27T20:45:08.025ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_013acbf3-0dbe-4a2b-96c6-c6e57d0f9f5e zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_013acbf3-0dbe-4a2b-96c6-c6e57d0f9f5e
6872024-11-27T20:45:08.030ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_ead0ca80-fe91-4d95-9487-ba1d84aaa1ee zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_ead0ca80-fe91-4d95-9487-ba1d84aaa1ee
6882024-11-27T20:45:08.080ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e70e832a-d23d-4681-854d-05e6b3b433d8") failed: Property not found. retry in 110.526445ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_e70e832a-d23d-4681-854d-05e6b3b433d8
6892024-11-27T20:45:08.151ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_013acbf3-0dbe-4a2b-96c6-c6e57d0f9f5e") failed: Property not found. retry in 50.215897ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_013acbf3-0dbe-4a2b-96c6-c6e57d0f9f5e
6902024-11-27T20:45:08.160ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ead0ca80-fe91-4d95-9487-ba1d84aaa1ee") failed: Property not found. retry in 32.088746ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_ead0ca80-fe91-4d95-9487-ba1d84aaa1ee
6912024-11-27T20:45:08.199ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e70e832a-d23d-4681-854d-05e6b3b433d8") failed: Property not found. retry in 215.415417ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_e70e832a-d23d-4681-854d-05e6b3b433d8
6922024-11-27T20:45:08.206ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ead0ca80-fe91-4d95-9487-ba1d84aaa1ee") failed: Property not found. retry in 89.137223ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_ead0ca80-fe91-4d95-9487-ba1d84aaa1ee
6932024-11-27T20:45:08.213ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_013acbf3-0dbe-4a2b-96c6-c6e57d0f9f5e") failed: Property not found. retry in 144.083514ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_013acbf3-0dbe-4a2b-96c6-c6e57d0f9f5e
6942024-11-27T20:45:08.485ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ead0ca80-fe91-4d95-9487-ba1d84aaa1ee") failed: Property not found. retry in 145.646278ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_ead0ca80-fe91-4d95-9487-ba1d84aaa1ee
6952024-11-27T20:45:08.505ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e70e832a-d23d-4681-854d-05e6b3b433d8") failed: Property not found. retry in 335.296308ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_e70e832a-d23d-4681-854d-05e6b3b433d8
6962024-11-27T20:45:08.518ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_013acbf3-0dbe-4a2b-96c6-c6e57d0f9f5e") failed: Property not found. retry in 276.504142ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_013acbf3-0dbe-4a2b-96c6-c6e57d0f9f5e
6972024-11-27T20:45:08.667ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ead0ca80-fe91-4d95-9487-ba1d84aaa1ee") failed: Property not found. retry in 403.981641ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_ead0ca80-fe91-4d95-9487-ba1d84aaa1ee
6982024-11-27T20:45:08.807ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_013acbf3-0dbe-4a2b-96c6-c6e57d0f9f5e") failed: Property not found. retry in 349.308408ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_013acbf3-0dbe-4a2b-96c6-c6e57d0f9f5e
6992024-11-27T20:45:08.850ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e70e832a-d23d-4681-854d-05e6b3b433d8") failed: Property not found. retry in 916.331835ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_e70e832a-d23d-4681-854d-05e6b3b433d8
7002024-11-27T20:45:09.084ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ead0ca80-fe91-4d95-9487-ba1d84aaa1ee") failed: Property not found. retry in 555.044999ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_ead0ca80-fe91-4d95-9487-ba1d84aaa1ee
7012024-11-27T20:45:09.165ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_013acbf3-0dbe-4a2b-96c6-c6e57d0f9f5e") failed: Property not found. retry in 608.840438ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_013acbf3-0dbe-4a2b-96c6-c6e57d0f9f5e
7022024-11-27T20:45:09.651ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ead0ca80-fe91-4d95-9487-ba1d84aaa1ee") failed: Property not found. retry in 1.364392855s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_ead0ca80-fe91-4d95-9487-ba1d84aaa1ee
7032024-11-27T20:45:09.777ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e70e832a-d23d-4681-854d-05e6b3b433d8") failed: Property not found. retry in 1.28175379s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_e70e832a-d23d-4681-854d-05e6b3b433d8
7042024-11-27T20:45:09.787ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_013acbf3-0dbe-4a2b-96c6-c6e57d0f9f5e") failed: Property not found. retry in 610.482152ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_013acbf3-0dbe-4a2b-96c6-c6e57d0f9f5e
7052024-11-27T20:45:10.407ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_013acbf3-0dbe-4a2b-96c6-c6e57d0f9f5e") failed: Property not found. retry in 1.298984495s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_013acbf3-0dbe-4a2b-96c6-c6e57d0f9f5e
7062024-11-27T20:45:11.024ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ead0ca80-fe91-4d95-9487-ba1d84aaa1ee") failed: Property not found. retry in 1.393107625s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_ead0ca80-fe91-4d95-9487-ba1d84aaa1ee
7072024-11-27T20:45:11.067ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e70e832a-d23d-4681-854d-05e6b3b433d8") failed: Property not found. retry in 1.134000002s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_e70e832a-d23d-4681-854d-05e6b3b433d8
7082024-11-27T20:45:11.714ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_013acbf3-0dbe-4a2b-96c6-c6e57d0f9f5e") failed: Property not found. retry in 1.092012528s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_013acbf3-0dbe-4a2b-96c6-c6e57d0f9f5e
7092024-11-27T20:45:12.210ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e70e832a-d23d-4681-854d-05e6b3b433d8") failed: Property not found. retry in 1.014377864s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_e70e832a-d23d-4681-854d-05e6b3b433d8
7102024-11-27T20:45:12.426ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ead0ca80-fe91-4d95-9487-ba1d84aaa1ee") failed: Property not found. retry in 622.229006ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_ead0ca80-fe91-4d95-9487-ba1d84aaa1ee
7112024-11-27T20:45:12.817ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_013acbf3-0dbe-4a2b-96c6-c6e57d0f9f5e") failed: Property not found. retry in 1.14698448s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_013acbf3-0dbe-4a2b-96c6-c6e57d0f9f5e
7122024-11-27T20:45:13.983ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_internal_dns_013acbf3-0dbe-4a2b-96c6-c6e57d0f9f5e
7132024-11-27T20:45:13.983ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_internal_dns_ead0ca80-fe91-4d95-9487-ba1d84aaa1ee
7142024-11-27T20:45:13.983ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_internal_dns_e70e832a-d23d-4681-854d-05e6b3b433d8
7152024-11-27T20:45:13.983ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/71828714-15a3-4f82-918a-cbabee4531fa/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7162024-11-27T20:45:13.983ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/f58570a3-13b1-4b0c-ac0c-e8a0652f7ced/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7172024-11-27T20:45:13.984ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8795918 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:49832 req_id = dc3f3506-6c05-4e54-9d18-1572bb8a7972 response_code = 204 uri = /omicron-zones
7182024-11-27T20:45:13.986ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:642
7192024-11-27T20:45:14.016ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 103.306976ms) dns_config_addr = [fd00:1122:3344:1::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:1::1]:5353/config) file = sled-agent/src/rack_setup/service.rs:662
7202024-11-27T20:45:14.138ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:642
7212024-11-27T20:45:14.184ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:642
7222024-11-27T20:45:14.236ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:678
7232024-11-27T20:45:14.237ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7242024-11-27T20:45:14.269ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7252024-11-27T20:45:14.270ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7262024-11-27T20:45:14.270ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7272024-11-27T20:45:14.300ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: 013acbf3-0dbe-4a2b-96c6-c6e57d0f9f5e (service), filesystem_pool: Some(ZpoolName { id: ff99775c-fb56-419e-aef8-9c8117494384 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ff99775c-fb56-419e-aef8-9c8117494384 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: ead0ca80-fe91-4d95-9487-ba1d84aaa1ee (service), filesystem_pool: Some(ZpoolName { id: 54375e11-a569-4c64-8c24-c6dfba089c32 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 54375e11-a569-4c64-8c24-c6dfba089c32 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: e70e832a-d23d-4681-854d-05e6b3b433d8 (service), filesystem_pool: Some(ZpoolName { id: a7344162-b09f-4fab-9022-409ee4ca9964 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a7344162-b09f-4fab-9022-409ee4ca9964 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 4436f451-3d3d-4865-8a88-b09e2df9d2a4 (service), filesystem_pool: Some(ZpoolName { id: 54375e11-a569-4c64-8c24-c6dfba089c32 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: be0208b0-8e84-4ea3-867d-74de0bb08ca1, kind: Service { id: 4436f451-3d3d-4865-8a88-b09e2df9d2a4 }, name: Name("ntp-4436f451-3d3d-4865-8a88-b09e2df9d2a4"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 221, 231])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:525 sled_address = [fd00:1122:3344:101::1]:12345
7282024-11-27T20:45:14.300ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57010
7292024-11-27T20:45:14.300ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 013acbf3-0dbe-4a2b-96c6-c6e57d0f9f5e, dataset_name: DatasetName { pool_name: ZpoolName { id: ff99775c-fb56-419e-aef8-9c8117494384 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
7302024-11-27T20:45:14.300ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 013acbf3-0dbe-4a2b-96c6-c6e57d0f9f5e, dataset_name: DatasetName { pool_name: ZpoolName { id: ff99775c-fb56-419e-aef8-9c8117494384 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7312024-11-27T20:45:14.340ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: ead0ca80-fe91-4d95-9487-ba1d84aaa1ee, dataset_name: DatasetName { pool_name: ZpoolName { id: 54375e11-a569-4c64-8c24-c6dfba089c32 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
7322024-11-27T20:45:14.340ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: ead0ca80-fe91-4d95-9487-ba1d84aaa1ee, dataset_name: DatasetName { pool_name: ZpoolName { id: 54375e11-a569-4c64-8c24-c6dfba089c32 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7332024-11-27T20:45:14.375ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: e70e832a-d23d-4681-854d-05e6b3b433d8, dataset_name: DatasetName { pool_name: ZpoolName { id: a7344162-b09f-4fab-9022-409ee4ca9964 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
7342024-11-27T20:45:14.375ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: e70e832a-d23d-4681-854d-05e6b3b433d8, dataset_name: DatasetName { pool_name: ZpoolName { id: a7344162-b09f-4fab-9022-409ee4ca9964 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7352024-11-27T20:45:14.409ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7362024-11-27T20:45:14.410ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/71828714-15a3-4f82-918a-cbabee4531fa/config/omicron-zones.json file = common/src/ledger.rs:177
7372024-11-27T20:45:14.410ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/f58570a3-13b1-4b0c-ac0c-e8a0652f7ced/config/omicron-zones.json file = common/src/ledger.rs:177
7382024-11-27T20:45:14.410ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7392024-11-27T20:45:14.422ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7402024-11-27T20:45:14.454ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7412024-11-27T20:45:14.455ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7422024-11-27T20:45:14.455ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7432024-11-27T20:45:14.485ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 221, 231]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
7442024-11-27T20:45:14.485ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1263 zone_type = boundary_ntp
7452024-11-27T20:45:14.485ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:83
7462024-11-27T20:45:14.485ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:90
7472024-11-27T20:45:14.485ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:118
7482024-11-27T20:45:14.487ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7492024-11-27T20:45:14.511ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_4436f451-3d3d-4865-8a88-b09e2df9d2a4 file = illumos-utils/src/zone.rs:325
7502024-11-27T20:45:14.529ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_4436f451-3d3d-4865-8a88-b09e2df9d2a4 file = illumos-utils/src/zone.rs:363
7512024-11-27T20:45:15.154ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_4436f451-3d3d-4865-8a88-b09e2df9d2a4: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7522024-11-27T20:45:15.154ZINFOSledAgent (ServiceManager): Booting oxz_ntp_4436f451-3d3d-4865-8a88-b09e2df9d2a4 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_ntp_4436f451-3d3d-4865-8a88-b09e2df9d2a4
7532024-11-27T20:45:15.286ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_4436f451-3d3d-4865-8a88-b09e2df9d2a4") failed: Property not found. retry in 70.086868ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_4436f451-3d3d-4865-8a88-b09e2df9d2a4
7542024-11-27T20:45:15.345ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 18008145077018772918 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e
7552024-11-27T20:45:15.345ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9741239623583156828 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e
7562024-11-27T20:45:15.368ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_4436f451-3d3d-4865-8a88-b09e2df9d2a4") failed: Property not found. retry in 114.610887ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_4436f451-3d3d-4865-8a88-b09e2df9d2a4
7572024-11-27T20:45:15.505ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_4436f451-3d3d-4865-8a88-b09e2df9d2a4") failed: Property not found. retry in 126.043946ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_4436f451-3d3d-4865-8a88-b09e2df9d2a4
7582024-11-27T20:45:15.643ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_4436f451-3d3d-4865-8a88-b09e2df9d2a4") failed: Property not found. retry in 592.035783ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_4436f451-3d3d-4865-8a88-b09e2df9d2a4
7592024-11-27T20:45:16.245ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_4436f451-3d3d-4865-8a88-b09e2df9d2a4") failed: Property not found. retry in 804.821587ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_4436f451-3d3d-4865-8a88-b09e2df9d2a4
7602024-11-27T20:45:16.280ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10801473587821902893 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e
7612024-11-27T20:45:16.280ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9544658036638116349 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e
7622024-11-27T20:45:17.058ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_4436f451-3d3d-4865-8a88-b09e2df9d2a4") failed: Property not found. retry in 1.265115114s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_4436f451-3d3d-4865-8a88-b09e2df9d2a4
7632024-11-27T20:45:18.333ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_4436f451-3d3d-4865-8a88-b09e2df9d2a4") failed: Property not found. retry in 814.577189ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_4436f451-3d3d-4865-8a88-b09e2df9d2a4
7642024-11-27T20:45:19.156ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_4436f451-3d3d-4865-8a88-b09e2df9d2a4") failed: Property not found. retry in 1.348676647s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_4436f451-3d3d-4865-8a88-b09e2df9d2a4
7652024-11-27T20:45:20.526ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_ntp_4436f451-3d3d-4865-8a88-b09e2df9d2a4
7662024-11-27T20:45:20.526ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/71828714-15a3-4f82-918a-cbabee4531fa/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7672024-11-27T20:45:20.526ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/f58570a3-13b1-4b0c-ac0c-e8a0652f7ced/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7682024-11-27T20:45:20.526ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6226577 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:57010 req_id = 7fefd2bf-4865-455a-a67b-d9b57d0d971c response_code = 204 uri = /omicron-zones
7692024-11-27T20:45:20.529ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:719
7702024-11-27T20:45:20.561ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:699
7712024-11-27T20:45:20.561ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40879
7722024-11-27T20:45:20.571ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_4436f451-3d3d-4865-8a88-b09e2df9d2a4': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
7732024-11-27T20:45:20.571ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 10317 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:40879 req_id = 041c484f-67c2-4f96-9ae0-01626114d8e5 response_code = 500 uri = /timesync
7742024-11-27T20:45:20.574ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:749
7752024-11-27T20:45:20.714ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:699
7762024-11-27T20:45:20.714ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60965
7772024-11-27T20:45:23.077ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13928142508321285222 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e
7782024-11-27T20:45:23.251ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12943334193469429552 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e
7792024-11-27T20:45:23.987ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3961417238117162295 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e
7802024-11-27T20:45:24.723ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_4436f451-3d3d-4865-8a88-b09e2df9d2a4': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
7812024-11-27T20:45:24.723ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 4009253 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:60965 req_id = 13cc33b2-f6f9-4766-9a76-7f0ed7df42c4 response_code = 500 uri = /timesync
7822024-11-27T20:45:24.726ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:749
7832024-11-27T20:45:24.892ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:699
7842024-11-27T20:45:24.892ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63027
7852024-11-27T20:45:24.901ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_4436f451-3d3d-4865-8a88-b09e2df9d2a4': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
7862024-11-27T20:45:24.901ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 8534 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:63027 req_id = 871c4f52-747f-4a7d-a762-4447b0167388 response_code = 500 uri = /timesync
7872024-11-27T20:45:24.902ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:749
7882024-11-27T20:45:25.041ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:699
7892024-11-27T20:45:25.041ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42841
7902024-11-27T20:45:25.348ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 18008145077018772918 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e
7912024-11-27T20:45:25.348ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9741239623583156828 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e
7922024-11-27T20:45:26.283ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10801473587821902893 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e
7932024-11-27T20:45:26.283ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9544658036638116349 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e
7942024-11-27T20:45:29.125ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_4436f451-3d3d-4865-8a88-b09e2df9d2a4': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
7952024-11-27T20:45:29.125ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 4009122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42841 req_id = e2176fab-b36b-4699-a2bb-c084f7ffac47 response_code = 500 uri = /timesync
7962024-11-27T20:45:29.127ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:749
7972024-11-27T20:45:29.247ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:699
7982024-11-27T20:45:29.248ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57267
7992024-11-27T20:45:29.256ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8256 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:57267 req_id = 27c1070b-d032-4e25-b456-92025513cf35 response_code = 200 uri = /timesync
8002024-11-27T20:45:29.258ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1732740326.02258, correction: 0.056346066 } file = sled-agent/src/rack_setup/service.rs:727
8012024-11-27T20:45:29.258ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:749
8022024-11-27T20:45:29.498ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:699
8032024-11-27T20:45:29.499ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45608
8042024-11-27T20:45:29.507ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8421 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:45608 req_id = 7f28a376-89a6-4e5b-b5cb-f64794fddc3e response_code = 200 uri = /timesync
8052024-11-27T20:45:29.509ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1732740326.02258, correction: 0.055667613 } file = sled-agent/src/rack_setup/service.rs:727
8062024-11-27T20:45:29.509ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:749
8072024-11-27T20:45:29.842ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:699
8082024-11-27T20:45:29.843ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39578
8092024-11-27T20:45:29.851ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8021 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39578 req_id = a8be6d5f-5df7-4288-864e-b6d9b27678db response_code = 200 uri = /timesync
8102024-11-27T20:45:29.853ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1732740326.02258, correction: 0.054739233 } file = sled-agent/src/rack_setup/service.rs:727
8112024-11-27T20:45:29.853ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:749
8122024-11-27T20:45:30.271ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:699
8132024-11-27T20:45:30.271ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37417
8142024-11-27T20:45:30.279ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8506 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:37417 req_id = 1ce21f79-0852-4056-b689-f29a992909a3 response_code = 200 uri = /timesync
8152024-11-27T20:45:30.282ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1732740326.02258, correction: 0.053539351 } file = sled-agent/src/rack_setup/service.rs:727
8162024-11-27T20:45:30.282ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:749
8172024-11-27T20:45:30.610ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4772686658635611981 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e
8182024-11-27T20:45:30.610ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13536530009036731815 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e
8192024-11-27T20:45:30.677ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:699
8202024-11-27T20:45:30.677ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59428
8212024-11-27T20:45:30.686ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8626 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:59428 req_id = 1723ea78-9971-4b6c-b0b9-9e9f3270f81c response_code = 200 uri = /timesync
8222024-11-27T20:45:30.688ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1732740326.02258, correction: 0.052441053 } file = sled-agent/src/rack_setup/service.rs:727
8232024-11-27T20:45:30.688ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:749
8242024-11-27T20:45:31.240ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:699
8252024-11-27T20:45:31.240ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58128
8262024-11-27T20:45:31.249ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8518 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:58128 req_id = ecdeb7d7-11d7-40ac-85f7-9664e8dbcbe2 response_code = 200 uri = /timesync
8272024-11-27T20:45:31.251ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1732740326.02258, correction: 0.050955329 } file = sled-agent/src/rack_setup/service.rs:727
8282024-11-27T20:45:31.251ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:749
8292024-11-27T20:45:31.696ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:699
8302024-11-27T20:45:31.696ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63724
8312024-11-27T20:45:31.704ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8050 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:63724 req_id = c9cca86f-2aca-47cc-9d13-4610753f5b3c response_code = 200 uri = /timesync
8322024-11-27T20:45:31.706ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1732740326.02258, correction: 0.049725551 } file = sled-agent/src/rack_setup/service.rs:727
8332024-11-27T20:45:31.706ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:749
8342024-11-27T20:45:32.320ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:699
8352024-11-27T20:45:32.320ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52793
8362024-11-27T20:45:32.328ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8488 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:52793 req_id = 38643e11-78c4-4149-8a0a-70d300ae6286 response_code = 200 uri = /timesync
8372024-11-27T20:45:32.331ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1732740326.02258, correction: 0.048369281 } file = sled-agent/src/rack_setup/service.rs:727
8382024-11-27T20:45:32.331ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:749
8392024-11-27T20:45:33.123ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:699
8402024-11-27T20:45:33.123ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59212
8412024-11-27T20:45:33.143ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 19891 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:59212 req_id = 4c69e2af-565c-46c9-b137-a211d4d30814 response_code = 200 uri = /timesync
8422024-11-27T20:45:33.146ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 2616771612, ip_addr: 155.248.196.28, stratum: 3, ref_time: 1732740332.157195, correction: 0.046142939 } file = sled-agent/src/rack_setup/service.rs:727
8432024-11-27T20:45:33.146ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1412
8442024-11-27T20:45:33.176ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 013acbf3-0dbe-4a2b-96c6-c6e57d0f9f5e (service), filesystem_pool: Some(ZpoolName { id: ff99775c-fb56-419e-aef8-9c8117494384 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ff99775c-fb56-419e-aef8-9c8117494384 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: ead0ca80-fe91-4d95-9487-ba1d84aaa1ee (service), filesystem_pool: Some(ZpoolName { id: 54375e11-a569-4c64-8c24-c6dfba089c32 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 54375e11-a569-4c64-8c24-c6dfba089c32 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: e70e832a-d23d-4681-854d-05e6b3b433d8 (service), filesystem_pool: Some(ZpoolName { id: a7344162-b09f-4fab-9022-409ee4ca9964 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a7344162-b09f-4fab-9022-409ee4ca9964 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 4436f451-3d3d-4865-8a88-b09e2df9d2a4 (service), filesystem_pool: Some(ZpoolName { id: 54375e11-a569-4c64-8c24-c6dfba089c32 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: be0208b0-8e84-4ea3-867d-74de0bb08ca1, kind: Service { id: 4436f451-3d3d-4865-8a88-b09e2df9d2a4 }, name: Name("ntp-4436f451-3d3d-4865-8a88-b09e2df9d2a4"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 221, 231])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 3821992c-1524-497b-81ca-b1baf49b4776 (service), filesystem_pool: Some(ZpoolName { id: ff99775c-fb56-419e-aef8-9c8117494384 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ff99775c-fb56-419e-aef8-9c8117494384 (zpool), kind: External } } } }, OmicronZoneConfig { id: 16dcdd3a-0d94-4143-9ea2-af6be74d7fdc (service), filesystem_pool: Some(ZpoolName { id: 54375e11-a569-4c64-8c24-c6dfba089c32 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 54375e11-a569-4c64-8c24-c6dfba089c32 (zpool), kind: External } } } }, OmicronZoneConfig { id: b9b36699-cb8e-411f-8a7f-fdeca8531636 (service), filesystem_pool: Some(ZpoolName { id: a7344162-b09f-4fab-9022-409ee4ca9964 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a7344162-b09f-4fab-9022-409ee4ca9964 (zpool), kind: External } } } }, OmicronZoneConfig { id: 72f05dc1-8d0f-4e04-8ddd-f6bfa1bef6a7 (service), filesystem_pool: Some(ZpoolName { id: 37e32039-a8dd-4947-8c19-c28ef6335cf2 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 37e32039-a8dd-4947-8c19-c28ef6335cf2 (zpool), kind: External } } } }, OmicronZoneConfig { id: 930271d3-e3bf-4a49-aafa-99fc0d6522b0 (service), filesystem_pool: Some(ZpoolName { id: c3225150-4706-46cb-9890-c4e173582acb (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c3225150-4706-46cb-9890-c4e173582acb (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:525 sled_address = [fd00:1122:3344:101::1]:12345
8452024-11-27T20:45:33.176ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48838
8462024-11-27T20:45:33.176ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 013acbf3-0dbe-4a2b-96c6-c6e57d0f9f5e, dataset_name: DatasetName { pool_name: ZpoolName { id: ff99775c-fb56-419e-aef8-9c8117494384 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
8472024-11-27T20:45:33.176ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 013acbf3-0dbe-4a2b-96c6-c6e57d0f9f5e, dataset_name: DatasetName { pool_name: ZpoolName { id: ff99775c-fb56-419e-aef8-9c8117494384 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8482024-11-27T20:45:33.211ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: ead0ca80-fe91-4d95-9487-ba1d84aaa1ee, dataset_name: DatasetName { pool_name: ZpoolName { id: 54375e11-a569-4c64-8c24-c6dfba089c32 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
8492024-11-27T20:45:33.211ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: ead0ca80-fe91-4d95-9487-ba1d84aaa1ee, dataset_name: DatasetName { pool_name: ZpoolName { id: 54375e11-a569-4c64-8c24-c6dfba089c32 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8502024-11-27T20:45:33.247ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: e70e832a-d23d-4681-854d-05e6b3b433d8, dataset_name: DatasetName { pool_name: ZpoolName { id: a7344162-b09f-4fab-9022-409ee4ca9964 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
8512024-11-27T20:45:33.247ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: e70e832a-d23d-4681-854d-05e6b3b433d8, dataset_name: DatasetName { pool_name: ZpoolName { id: a7344162-b09f-4fab-9022-409ee4ca9964 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8522024-11-27T20:45:33.280ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 3821992c-1524-497b-81ca-b1baf49b4776, dataset_name: DatasetName { pool_name: ZpoolName { id: ff99775c-fb56-419e-aef8-9c8117494384 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
8532024-11-27T20:45:33.280ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 3821992c-1524-497b-81ca-b1baf49b4776, dataset_name: DatasetName { pool_name: ZpoolName { id: ff99775c-fb56-419e-aef8-9c8117494384 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8542024-11-27T20:45:33.313ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 16dcdd3a-0d94-4143-9ea2-af6be74d7fdc, dataset_name: DatasetName { pool_name: ZpoolName { id: 54375e11-a569-4c64-8c24-c6dfba089c32 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
8552024-11-27T20:45:33.313ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 16dcdd3a-0d94-4143-9ea2-af6be74d7fdc, dataset_name: DatasetName { pool_name: ZpoolName { id: 54375e11-a569-4c64-8c24-c6dfba089c32 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8562024-11-27T20:45:33.349ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: b9b36699-cb8e-411f-8a7f-fdeca8531636, dataset_name: DatasetName { pool_name: ZpoolName { id: a7344162-b09f-4fab-9022-409ee4ca9964 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
8572024-11-27T20:45:33.349ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: b9b36699-cb8e-411f-8a7f-fdeca8531636, dataset_name: DatasetName { pool_name: ZpoolName { id: a7344162-b09f-4fab-9022-409ee4ca9964 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8582024-11-27T20:45:33.382ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 72f05dc1-8d0f-4e04-8ddd-f6bfa1bef6a7, dataset_name: DatasetName { pool_name: ZpoolName { id: 37e32039-a8dd-4947-8c19-c28ef6335cf2 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
8592024-11-27T20:45:33.382ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 72f05dc1-8d0f-4e04-8ddd-f6bfa1bef6a7, dataset_name: DatasetName { pool_name: ZpoolName { id: 37e32039-a8dd-4947-8c19-c28ef6335cf2 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8602024-11-27T20:45:33.414ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 930271d3-e3bf-4a49-aafa-99fc0d6522b0, dataset_name: DatasetName { pool_name: ZpoolName { id: c3225150-4706-46cb-9890-c4e173582acb (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
8612024-11-27T20:45:33.414ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 930271d3-e3bf-4a49-aafa-99fc0d6522b0, dataset_name: DatasetName { pool_name: ZpoolName { id: c3225150-4706-46cb-9890-c4e173582acb (zpool), kind: External }, kind: Cockroach }, responder: ... }
8622024-11-27T20:45:33.448ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
8632024-11-27T20:45:33.448ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/71828714-15a3-4f82-918a-cbabee4531fa/config/omicron-zones.json file = common/src/ledger.rs:177
8642024-11-27T20:45:33.448ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/f58570a3-13b1-4b0c-ac0c-e8a0652f7ced/config/omicron-zones.json file = common/src/ledger.rs:177
8652024-11-27T20:45:33.448ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
8662024-11-27T20:45:33.532ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
8672024-11-27T20:45:33.532ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
8682024-11-27T20:45:33.532ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
8692024-11-27T20:45:33.532ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
8702024-11-27T20:45:33.532ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
8712024-11-27T20:45:33.622ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_16dcdd3a-0d94-4143-9ea2-af6be74d7fdc file = illumos-utils/src/zone.rs:325
8722024-11-27T20:45:33.626ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_b9b36699-cb8e-411f-8a7f-fdeca8531636 file = illumos-utils/src/zone.rs:325
8732024-11-27T20:45:33.630ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_930271d3-e3bf-4a49-aafa-99fc0d6522b0 file = illumos-utils/src/zone.rs:325
8742024-11-27T20:45:33.634ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_72f05dc1-8d0f-4e04-8ddd-f6bfa1bef6a7 file = illumos-utils/src/zone.rs:325
8752024-11-27T20:45:33.638ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_3821992c-1524-497b-81ca-b1baf49b4776 file = illumos-utils/src/zone.rs:325
8762024-11-27T20:45:33.643ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_16dcdd3a-0d94-4143-9ea2-af6be74d7fdc file = illumos-utils/src/zone.rs:363
8772024-11-27T20:45:33.647ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_b9b36699-cb8e-411f-8a7f-fdeca8531636 file = illumos-utils/src/zone.rs:363
8782024-11-27T20:45:33.652ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_930271d3-e3bf-4a49-aafa-99fc0d6522b0 file = illumos-utils/src/zone.rs:363
8792024-11-27T20:45:33.656ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_72f05dc1-8d0f-4e04-8ddd-f6bfa1bef6a7 file = illumos-utils/src/zone.rs:363
8802024-11-27T20:45:33.661ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_3821992c-1524-497b-81ca-b1baf49b4776 file = illumos-utils/src/zone.rs:363
8812024-11-27T20:45:35.182ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53619
8822024-11-27T20:45:35.182ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53619 req_id = ee1d6c4b-4b17-4d65-9f0a-0b33f72aa5a8 response_code = 200 uri = /baseboard
8832024-11-27T20:45:35.629ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 201.258987ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e
8842024-11-27T20:45:36.686ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_930271d3-e3bf-4a49-aafa-99fc0d6522b0: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='930271d3-e3bf-4a49-aafa-99fc0d6522b0'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8852024-11-27T20:45:36.686ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_16dcdd3a-0d94-4143-9ea2-af6be74d7fdc: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='16dcdd3a-0d94-4143-9ea2-af6be74d7fdc'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8862024-11-27T20:45:36.686ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_930271d3-e3bf-4a49-aafa-99fc0d6522b0 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_930271d3-e3bf-4a49-aafa-99fc0d6522b0
8872024-11-27T20:45:36.692ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_16dcdd3a-0d94-4143-9ea2-af6be74d7fdc zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_16dcdd3a-0d94-4143-9ea2-af6be74d7fdc
8882024-11-27T20:45:36.734ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_b9b36699-cb8e-411f-8a7f-fdeca8531636: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='b9b36699-cb8e-411f-8a7f-fdeca8531636'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8892024-11-27T20:45:36.734ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_b9b36699-cb8e-411f-8a7f-fdeca8531636 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_b9b36699-cb8e-411f-8a7f-fdeca8531636
8902024-11-27T20:45:36.797ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_3821992c-1524-497b-81ca-b1baf49b4776: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='3821992c-1524-497b-81ca-b1baf49b4776'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8912024-11-27T20:45:36.797ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_3821992c-1524-497b-81ca-b1baf49b4776 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_3821992c-1524-497b-81ca-b1baf49b4776
8922024-11-27T20:45:36.830ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_930271d3-e3bf-4a49-aafa-99fc0d6522b0") failed: Property not found. retry in 54.532146ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_930271d3-e3bf-4a49-aafa-99fc0d6522b0
8932024-11-27T20:45:36.838ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_16dcdd3a-0d94-4143-9ea2-af6be74d7fdc") failed: Property not found. retry in 35.177738ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_16dcdd3a-0d94-4143-9ea2-af6be74d7fdc
8942024-11-27T20:45:36.839ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_72f05dc1-8d0f-4e04-8ddd-f6bfa1bef6a7: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='72f05dc1-8d0f-4e04-8ddd-f6bfa1bef6a7'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8952024-11-27T20:45:36.839ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_72f05dc1-8d0f-4e04-8ddd-f6bfa1bef6a7 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_72f05dc1-8d0f-4e04-8ddd-f6bfa1bef6a7
8962024-11-27T20:45:36.875ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b9b36699-cb8e-411f-8a7f-fdeca8531636") failed: Property not found. retry in 32.926367ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b9b36699-cb8e-411f-8a7f-fdeca8531636
8972024-11-27T20:45:36.883ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_16dcdd3a-0d94-4143-9ea2-af6be74d7fdc") failed: Property not found. retry in 92.5274ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_16dcdd3a-0d94-4143-9ea2-af6be74d7fdc
8982024-11-27T20:45:36.901ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_930271d3-e3bf-4a49-aafa-99fc0d6522b0") failed: Property not found. retry in 116.074551ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_930271d3-e3bf-4a49-aafa-99fc0d6522b0
8992024-11-27T20:45:37.170ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_16dcdd3a-0d94-4143-9ea2-af6be74d7fdc") failed: Property not found. retry in 127.957581ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_16dcdd3a-0d94-4143-9ea2-af6be74d7fdc
9002024-11-27T20:45:37.195ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b9b36699-cb8e-411f-8a7f-fdeca8531636") failed: Property not found. retry in 100.243608ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b9b36699-cb8e-411f-8a7f-fdeca8531636
9012024-11-27T20:45:37.224ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_930271d3-e3bf-4a49-aafa-99fc0d6522b0") failed: Property not found. retry in 152.142061ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_930271d3-e3bf-4a49-aafa-99fc0d6522b0
9022024-11-27T20:45:37.284ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3821992c-1524-497b-81ca-b1baf49b4776") failed: Property not found. retry in 60.464585ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3821992c-1524-497b-81ca-b1baf49b4776
9032024-11-27T20:45:37.323ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_72f05dc1-8d0f-4e04-8ddd-f6bfa1bef6a7") failed: Property not found. retry in 51.094434ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_72f05dc1-8d0f-4e04-8ddd-f6bfa1bef6a7
9042024-11-27T20:45:37.396ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_16dcdd3a-0d94-4143-9ea2-af6be74d7fdc") failed: Property not found. retry in 303.358336ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_16dcdd3a-0d94-4143-9ea2-af6be74d7fdc
9052024-11-27T20:45:37.468ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b9b36699-cb8e-411f-8a7f-fdeca8531636") failed: Property not found. retry in 261.84869ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b9b36699-cb8e-411f-8a7f-fdeca8531636
9062024-11-27T20:45:37.542ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_930271d3-e3bf-4a49-aafa-99fc0d6522b0") failed: Property not found. retry in 553.603734ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_930271d3-e3bf-4a49-aafa-99fc0d6522b0
9072024-11-27T20:45:37.619ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_72f05dc1-8d0f-4e04-8ddd-f6bfa1bef6a7") failed: Property not found. retry in 134.283446ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_72f05dc1-8d0f-4e04-8ddd-f6bfa1bef6a7
9082024-11-27T20:45:37.713ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3821992c-1524-497b-81ca-b1baf49b4776") failed: Property not found. retry in 93.692715ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3821992c-1524-497b-81ca-b1baf49b4776
9092024-11-27T20:45:38.250ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_16dcdd3a-0d94-4143-9ea2-af6be74d7fdc") failed: Property not found. retry in 624.92593ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_16dcdd3a-0d94-4143-9ea2-af6be74d7fdc
9102024-11-27T20:45:38.331ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b9b36699-cb8e-411f-8a7f-fdeca8531636") failed: Property not found. retry in 562.008994ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b9b36699-cb8e-411f-8a7f-fdeca8531636
9112024-11-27T20:45:38.444ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_930271d3-e3bf-4a49-aafa-99fc0d6522b0") failed: Property not found. retry in 837.468983ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_930271d3-e3bf-4a49-aafa-99fc0d6522b0
9122024-11-27T20:45:38.626ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_72f05dc1-8d0f-4e04-8ddd-f6bfa1bef6a7") failed: Property not found. retry in 103.065507ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_72f05dc1-8d0f-4e04-8ddd-f6bfa1bef6a7
9132024-11-27T20:45:38.886ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3821992c-1524-497b-81ca-b1baf49b4776") failed: Property not found. retry in 294.889365ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3821992c-1524-497b-81ca-b1baf49b4776
9142024-11-27T20:45:38.964ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_16dcdd3a-0d94-4143-9ea2-af6be74d7fdc") failed: Property not found. retry in 675.337363ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_16dcdd3a-0d94-4143-9ea2-af6be74d7fdc
9152024-11-27T20:45:39.031ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b9b36699-cb8e-411f-8a7f-fdeca8531636") failed: Property not found. retry in 1.119751325s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b9b36699-cb8e-411f-8a7f-fdeca8531636
9162024-11-27T20:45:39.060ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_72f05dc1-8d0f-4e04-8ddd-f6bfa1bef6a7") failed: Property not found. retry in 214.761349ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_72f05dc1-8d0f-4e04-8ddd-f6bfa1bef6a7
9172024-11-27T20:45:39.208ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3821992c-1524-497b-81ca-b1baf49b4776") failed: Property not found. retry in 540.651133ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3821992c-1524-497b-81ca-b1baf49b4776
9182024-11-27T20:45:39.295ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_72f05dc1-8d0f-4e04-8ddd-f6bfa1bef6a7") failed: Property not found. retry in 710.128573ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_72f05dc1-8d0f-4e04-8ddd-f6bfa1bef6a7
9192024-11-27T20:45:39.308ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_930271d3-e3bf-4a49-aafa-99fc0d6522b0") failed: Property not found. retry in 1.399542856s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_930271d3-e3bf-4a49-aafa-99fc0d6522b0
9202024-11-27T20:45:39.654ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_16dcdd3a-0d94-4143-9ea2-af6be74d7fdc") failed: Property not found. retry in 630.024001ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_16dcdd3a-0d94-4143-9ea2-af6be74d7fdc
9212024-11-27T20:45:39.763ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3821992c-1524-497b-81ca-b1baf49b4776") failed: Property not found. retry in 408.845339ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3821992c-1524-497b-81ca-b1baf49b4776
9222024-11-27T20:45:40.016ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_72f05dc1-8d0f-4e04-8ddd-f6bfa1bef6a7") failed: Property not found. retry in 855.95769ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_72f05dc1-8d0f-4e04-8ddd-f6bfa1bef6a7
9232024-11-27T20:45:40.164ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b9b36699-cb8e-411f-8a7f-fdeca8531636") failed: Property not found. retry in 514.953567ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b9b36699-cb8e-411f-8a7f-fdeca8531636
9242024-11-27T20:45:40.182ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3821992c-1524-497b-81ca-b1baf49b4776") failed: Property not found. retry in 538.291348ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3821992c-1524-497b-81ca-b1baf49b4776
9252024-11-27T20:45:40.294ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_16dcdd3a-0d94-4143-9ea2-af6be74d7fdc") failed: Property not found. retry in 1.345649475s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_16dcdd3a-0d94-4143-9ea2-af6be74d7fdc
9262024-11-27T20:45:40.690ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b9b36699-cb8e-411f-8a7f-fdeca8531636") failed: Property not found. retry in 886.285866ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b9b36699-cb8e-411f-8a7f-fdeca8531636
9272024-11-27T20:45:40.718ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_930271d3-e3bf-4a49-aafa-99fc0d6522b0") failed: Property not found. retry in 909.211326ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_930271d3-e3bf-4a49-aafa-99fc0d6522b0
9282024-11-27T20:45:40.728ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3821992c-1524-497b-81ca-b1baf49b4776") failed: Property not found. retry in 1.107487219s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3821992c-1524-497b-81ca-b1baf49b4776
9292024-11-27T20:45:40.884ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_72f05dc1-8d0f-4e04-8ddd-f6bfa1bef6a7") failed: Property not found. retry in 1.381891289s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_72f05dc1-8d0f-4e04-8ddd-f6bfa1bef6a7
9302024-11-27T20:45:41.591ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b9b36699-cb8e-411f-8a7f-fdeca8531636") failed: Property not found. retry in 1.405316571s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b9b36699-cb8e-411f-8a7f-fdeca8531636
9312024-11-27T20:45:41.642ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_930271d3-e3bf-4a49-aafa-99fc0d6522b0") failed: Property not found. retry in 999.751358ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_930271d3-e3bf-4a49-aafa-99fc0d6522b0
9322024-11-27T20:45:41.654ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_16dcdd3a-0d94-4143-9ea2-af6be74d7fdc") failed: Property not found. retry in 831.859699ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_16dcdd3a-0d94-4143-9ea2-af6be74d7fdc
9332024-11-27T20:45:41.849ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3821992c-1524-497b-81ca-b1baf49b4776") failed: Property not found. retry in 629.819716ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3821992c-1524-497b-81ca-b1baf49b4776
9342024-11-27T20:45:42.281ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_72f05dc1-8d0f-4e04-8ddd-f6bfa1bef6a7") failed: Property not found. retry in 823.562881ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_72f05dc1-8d0f-4e04-8ddd-f6bfa1bef6a7
9352024-11-27T20:45:42.490ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3821992c-1524-497b-81ca-b1baf49b4776") failed: Property not found. retry in 1.374244137s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3821992c-1524-497b-81ca-b1baf49b4776
9362024-11-27T20:45:42.497ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_16dcdd3a-0d94-4143-9ea2-af6be74d7fdc") failed: Property not found. retry in 747.847899ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_16dcdd3a-0d94-4143-9ea2-af6be74d7fdc
9372024-11-27T20:45:42.653ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_930271d3-e3bf-4a49-aafa-99fc0d6522b0") failed: Property not found. retry in 1.195402589s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_930271d3-e3bf-4a49-aafa-99fc0d6522b0
9382024-11-27T20:45:43.010ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b9b36699-cb8e-411f-8a7f-fdeca8531636") failed: Property not found. retry in 1.319166711s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b9b36699-cb8e-411f-8a7f-fdeca8531636
9392024-11-27T20:45:43.115ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_72f05dc1-8d0f-4e04-8ddd-f6bfa1bef6a7") failed: Property not found. retry in 1.47173675s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_72f05dc1-8d0f-4e04-8ddd-f6bfa1bef6a7
9402024-11-27T20:45:43.255ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_16dcdd3a-0d94-4143-9ea2-af6be74d7fdc") failed: Property not found. retry in 1.293533531s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_16dcdd3a-0d94-4143-9ea2-af6be74d7fdc
9412024-11-27T20:45:43.863ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_930271d3-e3bf-4a49-aafa-99fc0d6522b0") failed: Property not found. retry in 1.130118312s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_930271d3-e3bf-4a49-aafa-99fc0d6522b0
9422024-11-27T20:45:43.877ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3821992c-1524-497b-81ca-b1baf49b4776") failed: Property not found. retry in 1.336045618s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3821992c-1524-497b-81ca-b1baf49b4776
9432024-11-27T20:45:44.344ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b9b36699-cb8e-411f-8a7f-fdeca8531636") failed: Property not found. retry in 1.415262062s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b9b36699-cb8e-411f-8a7f-fdeca8531636
9442024-11-27T20:45:44.564ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_16dcdd3a-0d94-4143-9ea2-af6be74d7fdc") failed: Property not found. retry in 522.715027ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_16dcdd3a-0d94-4143-9ea2-af6be74d7fdc
9452024-11-27T20:45:44.605ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_72f05dc1-8d0f-4e04-8ddd-f6bfa1bef6a7") failed: Property not found. retry in 1.385533636s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_72f05dc1-8d0f-4e04-8ddd-f6bfa1bef6a7
9462024-11-27T20:45:45.005ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_930271d3-e3bf-4a49-aafa-99fc0d6522b0") failed: Property not found. retry in 585.087437ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_930271d3-e3bf-4a49-aafa-99fc0d6522b0
9472024-11-27T20:45:45.097ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_16dcdd3a-0d94-4143-9ea2-af6be74d7fdc") failed: Property not found. retry in 1.301048409s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_16dcdd3a-0d94-4143-9ea2-af6be74d7fdc
9482024-11-27T20:45:45.226ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3821992c-1524-497b-81ca-b1baf49b4776") failed: Property not found. retry in 1.378268838s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3821992c-1524-497b-81ca-b1baf49b4776
9492024-11-27T20:45:45.600ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_930271d3-e3bf-4a49-aafa-99fc0d6522b0") failed: Property not found. retry in 1.01543315s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_930271d3-e3bf-4a49-aafa-99fc0d6522b0
9502024-11-27T20:45:45.773ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b9b36699-cb8e-411f-8a7f-fdeca8531636") failed: Property not found. retry in 1.436999081s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b9b36699-cb8e-411f-8a7f-fdeca8531636
9512024-11-27T20:45:46.410ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_16dcdd3a-0d94-4143-9ea2-af6be74d7fdc") failed: Property not found. retry in 1.175913455s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_16dcdd3a-0d94-4143-9ea2-af6be74d7fdc
9522024-11-27T20:45:46.616ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3821992c-1524-497b-81ca-b1baf49b4776") failed: Property not found. retry in 1.470839185s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3821992c-1524-497b-81ca-b1baf49b4776
9532024-11-27T20:45:46.624ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_930271d3-e3bf-4a49-aafa-99fc0d6522b0") failed: Property not found. retry in 527.199985ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_930271d3-e3bf-4a49-aafa-99fc0d6522b0
9542024-11-27T20:45:47.163ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_930271d3-e3bf-4a49-aafa-99fc0d6522b0") failed: Property not found. retry in 1.21966331s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_930271d3-e3bf-4a49-aafa-99fc0d6522b0
9552024-11-27T20:45:47.222ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b9b36699-cb8e-411f-8a7f-fdeca8531636") failed: Property not found. retry in 780.205158ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b9b36699-cb8e-411f-8a7f-fdeca8531636
9562024-11-27T20:45:47.600ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_16dcdd3a-0d94-4143-9ea2-af6be74d7fdc") failed: Property not found. retry in 1.28152749s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_16dcdd3a-0d94-4143-9ea2-af6be74d7fdc
9572024-11-27T20:45:48.014ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b9b36699-cb8e-411f-8a7f-fdeca8531636") failed: Property not found. retry in 756.202961ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b9b36699-cb8e-411f-8a7f-fdeca8531636
9582024-11-27T20:45:48.101ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3821992c-1524-497b-81ca-b1baf49b4776") failed: Property not found. retry in 518.744116ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3821992c-1524-497b-81ca-b1baf49b4776
9592024-11-27T20:45:48.395ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_930271d3-e3bf-4a49-aafa-99fc0d6522b0") failed: Property not found. retry in 1.402957562s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_930271d3-e3bf-4a49-aafa-99fc0d6522b0
9602024-11-27T20:45:48.631ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3821992c-1524-497b-81ca-b1baf49b4776") failed: Property not found. retry in 669.704979ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3821992c-1524-497b-81ca-b1baf49b4776
9612024-11-27T20:45:48.781ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b9b36699-cb8e-411f-8a7f-fdeca8531636") failed: Property not found. retry in 1.011971054s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b9b36699-cb8e-411f-8a7f-fdeca8531636
9622024-11-27T20:45:48.894ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_16dcdd3a-0d94-4143-9ea2-af6be74d7fdc") failed: Property not found. retry in 717.551894ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_16dcdd3a-0d94-4143-9ea2-af6be74d7fdc
9632024-11-27T20:45:49.311ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3821992c-1524-497b-81ca-b1baf49b4776") failed: Property not found. retry in 811.691258ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3821992c-1524-497b-81ca-b1baf49b4776
9642024-11-27T20:45:49.624ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_16dcdd3a-0d94-4143-9ea2-af6be74d7fdc") failed: Property not found. retry in 979.665099ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_16dcdd3a-0d94-4143-9ea2-af6be74d7fdc
9652024-11-27T20:45:49.805ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b9b36699-cb8e-411f-8a7f-fdeca8531636") failed: Property not found. retry in 983.877656ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b9b36699-cb8e-411f-8a7f-fdeca8531636
9662024-11-27T20:45:49.813ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_930271d3-e3bf-4a49-aafa-99fc0d6522b0") failed: Property not found. retry in 879.732429ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_930271d3-e3bf-4a49-aafa-99fc0d6522b0
9672024-11-27T20:45:50.135ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3821992c-1524-497b-81ca-b1baf49b4776") failed: Property not found. retry in 1.486027986s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3821992c-1524-497b-81ca-b1baf49b4776
9682024-11-27T20:45:50.616ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_16dcdd3a-0d94-4143-9ea2-af6be74d7fdc") failed: Property not found. retry in 1.457810678s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_16dcdd3a-0d94-4143-9ea2-af6be74d7fdc
9692024-11-27T20:45:50.704ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_930271d3-e3bf-4a49-aafa-99fc0d6522b0") failed: Property not found. retry in 686.34328ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_930271d3-e3bf-4a49-aafa-99fc0d6522b0
9702024-11-27T20:45:50.801ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b9b36699-cb8e-411f-8a7f-fdeca8531636") failed: Property not found. retry in 539.327504ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b9b36699-cb8e-411f-8a7f-fdeca8531636
9712024-11-27T20:45:50.906ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 469.571956ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e
9722024-11-27T20:45:51.350ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b9b36699-cb8e-411f-8a7f-fdeca8531636") failed: Property not found. retry in 825.154876ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b9b36699-cb8e-411f-8a7f-fdeca8531636
9732024-11-27T20:45:51.417ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_930271d3-e3bf-4a49-aafa-99fc0d6522b0") failed: Property not found. retry in 577.496807ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_930271d3-e3bf-4a49-aafa-99fc0d6522b0
9742024-11-27T20:45:51.633ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3821992c-1524-497b-81ca-b1baf49b4776") failed: Property not found. retry in 991.20268ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3821992c-1524-497b-81ca-b1baf49b4776
9752024-11-27T20:45:52.004ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_930271d3-e3bf-4a49-aafa-99fc0d6522b0") failed: Property not found. retry in 568.01779ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_930271d3-e3bf-4a49-aafa-99fc0d6522b0
9762024-11-27T20:45:52.082ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_16dcdd3a-0d94-4143-9ea2-af6be74d7fdc") failed: Property not found. retry in 725.246143ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_16dcdd3a-0d94-4143-9ea2-af6be74d7fdc
9772024-11-27T20:45:52.185ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b9b36699-cb8e-411f-8a7f-fdeca8531636") failed: Property not found. retry in 1.242199876s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b9b36699-cb8e-411f-8a7f-fdeca8531636
9782024-11-27T20:45:52.582ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_930271d3-e3bf-4a49-aafa-99fc0d6522b0") failed: Property not found. retry in 769.638897ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_930271d3-e3bf-4a49-aafa-99fc0d6522b0
9792024-11-27T20:45:52.633ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3821992c-1524-497b-81ca-b1baf49b4776") failed: Property not found. retry in 1.139569828s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3821992c-1524-497b-81ca-b1baf49b4776
9802024-11-27T20:45:52.816ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_16dcdd3a-0d94-4143-9ea2-af6be74d7fdc") failed: Property not found. retry in 1.324065257s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_16dcdd3a-0d94-4143-9ea2-af6be74d7fdc
9812024-11-27T20:45:53.361ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_930271d3-e3bf-4a49-aafa-99fc0d6522b0") failed: Property not found. retry in 1.008002292s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_930271d3-e3bf-4a49-aafa-99fc0d6522b0
9822024-11-27T20:45:53.435ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b9b36699-cb8e-411f-8a7f-fdeca8531636") failed: Property not found. retry in 1.208845211s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b9b36699-cb8e-411f-8a7f-fdeca8531636
9832024-11-27T20:45:53.781ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3821992c-1524-497b-81ca-b1baf49b4776") failed: Property not found. retry in 1.237248067s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3821992c-1524-497b-81ca-b1baf49b4776
9842024-11-27T20:45:54.149ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_16dcdd3a-0d94-4143-9ea2-af6be74d7fdc") failed: Property not found. retry in 1.141746646s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_16dcdd3a-0d94-4143-9ea2-af6be74d7fdc
9852024-11-27T20:45:54.378ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_930271d3-e3bf-4a49-aafa-99fc0d6522b0") failed: Property not found. retry in 521.098811ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_930271d3-e3bf-4a49-aafa-99fc0d6522b0
9862024-11-27T20:45:54.654ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b9b36699-cb8e-411f-8a7f-fdeca8531636") failed: Property not found. retry in 1.164105764s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b9b36699-cb8e-411f-8a7f-fdeca8531636
9872024-11-27T20:45:55.842ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_16dcdd3a-0d94-4143-9ea2-af6be74d7fdc
9882024-11-27T20:45:55.842ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_b9b36699-cb8e-411f-8a7f-fdeca8531636
9892024-11-27T20:45:55.842ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_930271d3-e3bf-4a49-aafa-99fc0d6522b0
9902024-11-27T20:45:55.842ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_72f05dc1-8d0f-4e04-8ddd-f6bfa1bef6a7
9912024-11-27T20:45:55.842ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_3821992c-1524-497b-81ca-b1baf49b4776
9922024-11-27T20:45:55.842ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/71828714-15a3-4f82-918a-cbabee4531fa/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
9932024-11-27T20:45:55.842ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/f58570a3-13b1-4b0c-ac0c-e8a0652f7ced/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
9942024-11-27T20:45:55.843ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 22620492 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:48838 req_id = b4375907-6274-4945-a0ac-3f417a65e3da response_code = 204 uri = /omicron-zones
9952024-11-27T20:45:55.879ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54819
9962024-11-27T20:45:55.908ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::4]:32221 file = sled-agent/src/services.rs:3743
9972024-11-27T20:46:05.272ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:57844
9982024-11-27T20:46:05.273ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:57844 req_id = 9d08c3a3-a707-418a-884e-1ba1990ca5e0 response_code = 200 uri = /baseboard
9992024-11-27T20:46:06.413ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.141663869s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e
10002024-11-27T20:46:15.477ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3761
10012024-11-27T20:46:22.598ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.764490604s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e
10022024-11-27T20:46:25.972ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3784
10032024-11-27T20:46:25.972ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 30092989 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:54819 req_id = 8f8efdd6-7ccf-48cb-b1ee-19e1a8949a98 response_code = 204 uri = /cockroachdb
10042024-11-27T20:46:26.006ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: 013acbf3-0dbe-4a2b-96c6-c6e57d0f9f5e (service), filesystem_pool: Some(ZpoolName { id: ff99775c-fb56-419e-aef8-9c8117494384 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ff99775c-fb56-419e-aef8-9c8117494384 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: ead0ca80-fe91-4d95-9487-ba1d84aaa1ee (service), filesystem_pool: Some(ZpoolName { id: 54375e11-a569-4c64-8c24-c6dfba089c32 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 54375e11-a569-4c64-8c24-c6dfba089c32 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: e70e832a-d23d-4681-854d-05e6b3b433d8 (service), filesystem_pool: Some(ZpoolName { id: a7344162-b09f-4fab-9022-409ee4ca9964 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a7344162-b09f-4fab-9022-409ee4ca9964 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 4436f451-3d3d-4865-8a88-b09e2df9d2a4 (service), filesystem_pool: Some(ZpoolName { id: 54375e11-a569-4c64-8c24-c6dfba089c32 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: be0208b0-8e84-4ea3-867d-74de0bb08ca1, kind: Service { id: 4436f451-3d3d-4865-8a88-b09e2df9d2a4 }, name: Name("ntp-4436f451-3d3d-4865-8a88-b09e2df9d2a4"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 221, 231])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 3821992c-1524-497b-81ca-b1baf49b4776 (service), filesystem_pool: Some(ZpoolName { id: ff99775c-fb56-419e-aef8-9c8117494384 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ff99775c-fb56-419e-aef8-9c8117494384 (zpool), kind: External } } } }, OmicronZoneConfig { id: 16dcdd3a-0d94-4143-9ea2-af6be74d7fdc (service), filesystem_pool: Some(ZpoolName { id: 54375e11-a569-4c64-8c24-c6dfba089c32 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 54375e11-a569-4c64-8c24-c6dfba089c32 (zpool), kind: External } } } }, OmicronZoneConfig { id: b9b36699-cb8e-411f-8a7f-fdeca8531636 (service), filesystem_pool: Some(ZpoolName { id: a7344162-b09f-4fab-9022-409ee4ca9964 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a7344162-b09f-4fab-9022-409ee4ca9964 (zpool), kind: External } } } }, OmicronZoneConfig { id: 72f05dc1-8d0f-4e04-8ddd-f6bfa1bef6a7 (service), filesystem_pool: Some(ZpoolName { id: 37e32039-a8dd-4947-8c19-c28ef6335cf2 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 37e32039-a8dd-4947-8c19-c28ef6335cf2 (zpool), kind: External } } } }, OmicronZoneConfig { id: 930271d3-e3bf-4a49-aafa-99fc0d6522b0 (service), filesystem_pool: Some(ZpoolName { id: c3225150-4706-46cb-9890-c4e173582acb (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c3225150-4706-46cb-9890-c4e173582acb (zpool), kind: External } } } }, OmicronZoneConfig { id: ef029baa-d573-494d-9698-1690c9c57399 (service), filesystem_pool: Some(ZpoolName { id: ff99775c-fb56-419e-aef8-9c8117494384 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ff99775c-fb56-419e-aef8-9c8117494384 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.1.164:53, nic: NetworkInterface { id: 8c3b27b2-7f68-49b4-b3f3-4525d795f2c5, kind: Service { id: ef029baa-d573-494d-9698-1690c9c57399 }, name: Name("external-dns-ef029baa-d573-494d-9698-1690c9c57399"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 142, 128])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: d13b0217-c0a6-4eaa-8098-4068c753e7f8 (service), filesystem_pool: Some(ZpoolName { id: 54375e11-a569-4c64-8c24-c6dfba089c32 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 54375e11-a569-4c64-8c24-c6dfba089c32 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.1.165:53, nic: NetworkInterface { id: 81c35812-3316-445b-a6f6-3aa12cbc0141, kind: Service { id: d13b0217-c0a6-4eaa-8098-4068c753e7f8 }, name: Name("external-dns-d13b0217-c0a6-4eaa-8098-4068c753e7f8"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 26])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: ae973228-9cf8-450f-8ac4-7d740fc62ad6 (service), filesystem_pool: Some(ZpoolName { id: ff99775c-fb56-419e-aef8-9c8117494384 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.1.166, nic: NetworkInterface { id: b9a4498e-d802-4925-8101-8f18c4e4f305, kind: Service { id: ae973228-9cf8-450f-8ac4-7d740fc62ad6 }, name: Name("nexus-ae973228-9cf8-450f-8ac4-7d740fc62ad6"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 168, 190])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 77818842-4ce3-4fbc-b24e-bfe02c4a0922 (service), filesystem_pool: Some(ZpoolName { id: 0b66aa68-555b-43d3-99fd-94013fc7fb74 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.1.167, nic: NetworkInterface { id: 07c10885-dd61-4583-8ce1-a7179a48d3fa, kind: Service { id: 77818842-4ce3-4fbc-b24e-bfe02c4a0922 }, name: Name("nexus-77818842-4ce3-4fbc-b24e-bfe02c4a0922"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 187, 182])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: fb7409be-e1e9-41dc-ba28-37cdd7b9c8d6 (service), filesystem_pool: Some(ZpoolName { id: 0b66aa68-555b-43d3-99fd-94013fc7fb74 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.1.168, nic: NetworkInterface { id: 7ec37840-3b01-4078-b834-03dbd8adf8dd, kind: Service { id: fb7409be-e1e9-41dc-ba28-37cdd7b9c8d6 }, name: Name("nexus-fb7409be-e1e9-41dc-ba28-37cdd7b9c8d6"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 220])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: dea39fd9-f9ae-4cd4-a4be-75231f93c875 (service), filesystem_pool: Some(ZpoolName { id: ff99775c-fb56-419e-aef8-9c8117494384 (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: 85b62460-1774-4b0f-80ef-e51e72587837 (service), filesystem_pool: Some(ZpoolName { id: ff99775c-fb56-419e-aef8-9c8117494384 (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ff99775c-fb56-419e-aef8-9c8117494384 (zpool), kind: External } } } }, OmicronZoneConfig { id: 28a08a69-cd1e-46f3-83b9-e52da0fd36e5 (service), filesystem_pool: Some(ZpoolName { id: c3225150-4706-46cb-9890-c4e173582acb (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: 916dfff1-8c7a-4ee9-859d-b29aab2b839b (service), filesystem_pool: Some(ZpoolName { id: bd1e9859-f391-4410-ac6a-94d84a761bf8 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: c3958fcf-f239-469b-9c1a-085eb2a46574 (service), filesystem_pool: Some(ZpoolName { id: bd1e9859-f391-4410-ac6a-94d84a761bf8 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: a189f197-7882-4220-a741-c3ab48d1538d (service), filesystem_pool: Some(ZpoolName { id: ff99775c-fb56-419e-aef8-9c8117494384 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ff99775c-fb56-419e-aef8-9c8117494384 (zpool), kind: External } } } }, OmicronZoneConfig { id: 52f03443-0950-44b1-839a-35fd71795350 (service), filesystem_pool: Some(ZpoolName { id: 54375e11-a569-4c64-8c24-c6dfba089c32 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 54375e11-a569-4c64-8c24-c6dfba089c32 (zpool), kind: External } } } }, OmicronZoneConfig { id: e9e56728-efea-4219-afac-d4b3fc62d122 (service), filesystem_pool: Some(ZpoolName { id: a7344162-b09f-4fab-9022-409ee4ca9964 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a7344162-b09f-4fab-9022-409ee4ca9964 (zpool), kind: External } } } }, OmicronZoneConfig { id: 36882fd9-de52-45bb-ad54-8d8a7a8975d3 (service), filesystem_pool: Some(ZpoolName { id: 37e32039-a8dd-4947-8c19-c28ef6335cf2 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 37e32039-a8dd-4947-8c19-c28ef6335cf2 (zpool), kind: External } } } }, OmicronZoneConfig { id: 624b70de-5c05-41d7-9bc7-d6788785179f (service), filesystem_pool: Some(ZpoolName { id: c3225150-4706-46cb-9890-c4e173582acb (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c3225150-4706-46cb-9890-c4e173582acb (zpool), kind: External } } } }, OmicronZoneConfig { id: b620ee63-750b-4cff-b1e4-2bb3459911f2 (service), filesystem_pool: Some(ZpoolName { id: 4393a6b4-1740-4ce1-b6df-2d78fb8128b9 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 4393a6b4-1740-4ce1-b6df-2d78fb8128b9 (zpool), kind: External } } } }, OmicronZoneConfig { id: 1765ccc4-2c06-4c6d-ae19-b79c0f7578bc (service), filesystem_pool: Some(ZpoolName { id: bd1e9859-f391-4410-ac6a-94d84a761bf8 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: bd1e9859-f391-4410-ac6a-94d84a761bf8 (zpool), kind: External } } } }, OmicronZoneConfig { id: a687ab65-8cb5-438f-b716-9c6d0acfbb6d (service), filesystem_pool: Some(ZpoolName { id: f94a6d1b-9178-4c13-817f-a77b6a6cd97e (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f94a6d1b-9178-4c13-817f-a77b6a6cd97e (zpool), kind: External } } } }, OmicronZoneConfig { id: 3153c6ff-7972-4eff-961c-d5e1d29efabc (service), filesystem_pool: Some(ZpoolName { id: 0b66aa68-555b-43d3-99fd-94013fc7fb74 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 0b66aa68-555b-43d3-99fd-94013fc7fb74 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:525 sled_address = [fd00:1122:3344:101::1]:12345
10052024-11-27T20:46:26.006ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64977
10062024-11-27T20:46:26.008ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 013acbf3-0dbe-4a2b-96c6-c6e57d0f9f5e, dataset_name: DatasetName { pool_name: ZpoolName { id: ff99775c-fb56-419e-aef8-9c8117494384 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
10072024-11-27T20:46:26.008ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 013acbf3-0dbe-4a2b-96c6-c6e57d0f9f5e, dataset_name: DatasetName { pool_name: ZpoolName { id: ff99775c-fb56-419e-aef8-9c8117494384 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10082024-11-27T20:46:26.068ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: ead0ca80-fe91-4d95-9487-ba1d84aaa1ee, dataset_name: DatasetName { pool_name: ZpoolName { id: 54375e11-a569-4c64-8c24-c6dfba089c32 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
10092024-11-27T20:46:26.068ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: ead0ca80-fe91-4d95-9487-ba1d84aaa1ee, dataset_name: DatasetName { pool_name: ZpoolName { id: 54375e11-a569-4c64-8c24-c6dfba089c32 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10102024-11-27T20:46:26.120ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: e70e832a-d23d-4681-854d-05e6b3b433d8, dataset_name: DatasetName { pool_name: ZpoolName { id: a7344162-b09f-4fab-9022-409ee4ca9964 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
10112024-11-27T20:46:26.120ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: e70e832a-d23d-4681-854d-05e6b3b433d8, dataset_name: DatasetName { pool_name: ZpoolName { id: a7344162-b09f-4fab-9022-409ee4ca9964 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10122024-11-27T20:46:26.176ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 3821992c-1524-497b-81ca-b1baf49b4776, dataset_name: DatasetName { pool_name: ZpoolName { id: ff99775c-fb56-419e-aef8-9c8117494384 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10132024-11-27T20:46:26.176ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 3821992c-1524-497b-81ca-b1baf49b4776, dataset_name: DatasetName { pool_name: ZpoolName { id: ff99775c-fb56-419e-aef8-9c8117494384 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10142024-11-27T20:46:26.225ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 16dcdd3a-0d94-4143-9ea2-af6be74d7fdc, dataset_name: DatasetName { pool_name: ZpoolName { id: 54375e11-a569-4c64-8c24-c6dfba089c32 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10152024-11-27T20:46:26.225ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 16dcdd3a-0d94-4143-9ea2-af6be74d7fdc, dataset_name: DatasetName { pool_name: ZpoolName { id: 54375e11-a569-4c64-8c24-c6dfba089c32 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10162024-11-27T20:46:26.268ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: b9b36699-cb8e-411f-8a7f-fdeca8531636, dataset_name: DatasetName { pool_name: ZpoolName { id: a7344162-b09f-4fab-9022-409ee4ca9964 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10172024-11-27T20:46:26.269ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: b9b36699-cb8e-411f-8a7f-fdeca8531636, dataset_name: DatasetName { pool_name: ZpoolName { id: a7344162-b09f-4fab-9022-409ee4ca9964 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10182024-11-27T20:46:26.313ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 72f05dc1-8d0f-4e04-8ddd-f6bfa1bef6a7, dataset_name: DatasetName { pool_name: ZpoolName { id: 37e32039-a8dd-4947-8c19-c28ef6335cf2 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10192024-11-27T20:46:26.313ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 72f05dc1-8d0f-4e04-8ddd-f6bfa1bef6a7, dataset_name: DatasetName { pool_name: ZpoolName { id: 37e32039-a8dd-4947-8c19-c28ef6335cf2 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10202024-11-27T20:46:26.360ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 930271d3-e3bf-4a49-aafa-99fc0d6522b0, dataset_name: DatasetName { pool_name: ZpoolName { id: c3225150-4706-46cb-9890-c4e173582acb (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10212024-11-27T20:46:26.360ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 930271d3-e3bf-4a49-aafa-99fc0d6522b0, dataset_name: DatasetName { pool_name: ZpoolName { id: c3225150-4706-46cb-9890-c4e173582acb (zpool), kind: External }, kind: Cockroach }, responder: ... }
10222024-11-27T20:46:26.416ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: ef029baa-d573-494d-9698-1690c9c57399, dataset_name: DatasetName { pool_name: ZpoolName { id: ff99775c-fb56-419e-aef8-9c8117494384 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
10232024-11-27T20:46:26.416ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: ef029baa-d573-494d-9698-1690c9c57399, dataset_name: DatasetName { pool_name: ZpoolName { id: ff99775c-fb56-419e-aef8-9c8117494384 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
10242024-11-27T20:46:26.471ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d13b0217-c0a6-4eaa-8098-4068c753e7f8, dataset_name: DatasetName { pool_name: ZpoolName { id: 54375e11-a569-4c64-8c24-c6dfba089c32 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
10252024-11-27T20:46:26.471ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: d13b0217-c0a6-4eaa-8098-4068c753e7f8, dataset_name: DatasetName { pool_name: ZpoolName { id: 54375e11-a569-4c64-8c24-c6dfba089c32 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
10262024-11-27T20:46:26.535ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 85b62460-1774-4b0f-80ef-e51e72587837, dataset_name: DatasetName { pool_name: ZpoolName { id: ff99775c-fb56-419e-aef8-9c8117494384 (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:603
10272024-11-27T20:46:26.535ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 85b62460-1774-4b0f-80ef-e51e72587837, dataset_name: DatasetName { pool_name: ZpoolName { id: ff99775c-fb56-419e-aef8-9c8117494384 (zpool), kind: External }, kind: Clickhouse }, responder: ... }
10282024-11-27T20:46:26.605ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: a189f197-7882-4220-a741-c3ab48d1538d, dataset_name: DatasetName { pool_name: ZpoolName { id: ff99775c-fb56-419e-aef8-9c8117494384 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
10292024-11-27T20:46:26.605ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: a189f197-7882-4220-a741-c3ab48d1538d, dataset_name: DatasetName { pool_name: ZpoolName { id: ff99775c-fb56-419e-aef8-9c8117494384 (zpool), kind: External }, kind: Crucible }, responder: ... }
10302024-11-27T20:46:26.670ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 52f03443-0950-44b1-839a-35fd71795350, dataset_name: DatasetName { pool_name: ZpoolName { id: 54375e11-a569-4c64-8c24-c6dfba089c32 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
10312024-11-27T20:46:26.670ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 52f03443-0950-44b1-839a-35fd71795350, dataset_name: DatasetName { pool_name: ZpoolName { id: 54375e11-a569-4c64-8c24-c6dfba089c32 (zpool), kind: External }, kind: Crucible }, responder: ... }
10322024-11-27T20:46:26.722ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: e9e56728-efea-4219-afac-d4b3fc62d122, dataset_name: DatasetName { pool_name: ZpoolName { id: a7344162-b09f-4fab-9022-409ee4ca9964 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
10332024-11-27T20:46:26.723ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: e9e56728-efea-4219-afac-d4b3fc62d122, dataset_name: DatasetName { pool_name: ZpoolName { id: a7344162-b09f-4fab-9022-409ee4ca9964 (zpool), kind: External }, kind: Crucible }, responder: ... }
10342024-11-27T20:46:26.767ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 36882fd9-de52-45bb-ad54-8d8a7a8975d3, dataset_name: DatasetName { pool_name: ZpoolName { id: 37e32039-a8dd-4947-8c19-c28ef6335cf2 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
10352024-11-27T20:46:26.767ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 36882fd9-de52-45bb-ad54-8d8a7a8975d3, dataset_name: DatasetName { pool_name: ZpoolName { id: 37e32039-a8dd-4947-8c19-c28ef6335cf2 (zpool), kind: External }, kind: Crucible }, responder: ... }
10362024-11-27T20:46:26.832ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 624b70de-5c05-41d7-9bc7-d6788785179f, dataset_name: DatasetName { pool_name: ZpoolName { id: c3225150-4706-46cb-9890-c4e173582acb (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
10372024-11-27T20:46:26.832ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 624b70de-5c05-41d7-9bc7-d6788785179f, dataset_name: DatasetName { pool_name: ZpoolName { id: c3225150-4706-46cb-9890-c4e173582acb (zpool), kind: External }, kind: Crucible }, responder: ... }
10382024-11-27T20:46:26.884ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: b620ee63-750b-4cff-b1e4-2bb3459911f2, dataset_name: DatasetName { pool_name: ZpoolName { id: 4393a6b4-1740-4ce1-b6df-2d78fb8128b9 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
10392024-11-27T20:46:26.884ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: b620ee63-750b-4cff-b1e4-2bb3459911f2, dataset_name: DatasetName { pool_name: ZpoolName { id: 4393a6b4-1740-4ce1-b6df-2d78fb8128b9 (zpool), kind: External }, kind: Crucible }, responder: ... }
10402024-11-27T20:46:26.972ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 1765ccc4-2c06-4c6d-ae19-b79c0f7578bc, dataset_name: DatasetName { pool_name: ZpoolName { id: bd1e9859-f391-4410-ac6a-94d84a761bf8 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
10412024-11-27T20:46:26.972ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 1765ccc4-2c06-4c6d-ae19-b79c0f7578bc, dataset_name: DatasetName { pool_name: ZpoolName { id: bd1e9859-f391-4410-ac6a-94d84a761bf8 (zpool), kind: External }, kind: Crucible }, responder: ... }
10422024-11-27T20:46:27.041ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: a687ab65-8cb5-438f-b716-9c6d0acfbb6d, dataset_name: DatasetName { pool_name: ZpoolName { id: f94a6d1b-9178-4c13-817f-a77b6a6cd97e (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
10432024-11-27T20:46:27.041ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: a687ab65-8cb5-438f-b716-9c6d0acfbb6d, dataset_name: DatasetName { pool_name: ZpoolName { id: f94a6d1b-9178-4c13-817f-a77b6a6cd97e (zpool), kind: External }, kind: Crucible }, responder: ... }
10442024-11-27T20:46:27.103ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 3153c6ff-7972-4eff-961c-d5e1d29efabc, dataset_name: DatasetName { pool_name: ZpoolName { id: 0b66aa68-555b-43d3-99fd-94013fc7fb74 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
10452024-11-27T20:46:27.103ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 3153c6ff-7972-4eff-961c-d5e1d29efabc, dataset_name: DatasetName { pool_name: ZpoolName { id: 0b66aa68-555b-43d3-99fd-94013fc7fb74 (zpool), kind: External }, kind: Crucible }, responder: ... }
10462024-11-27T20:46:27.165ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10472024-11-27T20:46:27.165ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/71828714-15a3-4f82-918a-cbabee4531fa/config/omicron-zones.json file = common/src/ledger.rs:177
10482024-11-27T20:46:27.165ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/f58570a3-13b1-4b0c-ac0c-e8a0652f7ced/config/omicron-zones.json file = common/src/ledger.rs:177
10492024-11-27T20:46:27.166ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10502024-11-27T20:46:27.294ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10512024-11-27T20:46:27.294ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10522024-11-27T20:46:27.307ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10532024-11-27T20:46:27.343ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10542024-11-27T20:46:27.343ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10552024-11-27T20:46:27.344ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10562024-11-27T20:46:27.344ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10572024-11-27T20:46:27.346ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10582024-11-27T20:46:27.346ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10592024-11-27T20:46:27.349ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10602024-11-27T20:46:27.349ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10612024-11-27T20:46:27.557ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10622024-11-27T20:46:27.558ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10632024-11-27T20:46:27.558ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10642024-11-27T20:46:27.558ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10652024-11-27T20:46:27.558ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10662024-11-27T20:46:27.558ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10672024-11-27T20:46:27.558ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10682024-11-27T20:46:27.568ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10692024-11-27T20:46:27.568ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_28a08a69-cd1e-46f3-83b9-e52da0fd36e5 file = illumos-utils/src/zone.rs:325
10702024-11-27T20:46:27.575ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_e9e56728-efea-4219-afac-d4b3fc62d122 file = illumos-utils/src/zone.rs:325
10712024-11-27T20:46:27.581ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_52f03443-0950-44b1-839a-35fd71795350 file = illumos-utils/src/zone.rs:325
10722024-11-27T20:46:27.586ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_3153c6ff-7972-4eff-961c-d5e1d29efabc file = illumos-utils/src/zone.rs:325
10732024-11-27T20:46:27.591ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_916dfff1-8c7a-4ee9-859d-b29aab2b839b file = illumos-utils/src/zone.rs:325
10742024-11-27T20:46:27.597ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_c3958fcf-f239-469b-9c1a-085eb2a46574 file = illumos-utils/src/zone.rs:325
10752024-11-27T20:46:27.603ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_dea39fd9-f9ae-4cd4-a4be-75231f93c875 file = illumos-utils/src/zone.rs:325
10762024-11-27T20:46:27.785ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_28a08a69-cd1e-46f3-83b9-e52da0fd36e5 file = illumos-utils/src/zone.rs:363
10772024-11-27T20:46:27.792ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_e9e56728-efea-4219-afac-d4b3fc62d122 file = illumos-utils/src/zone.rs:363
10782024-11-27T20:46:27.798ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_52f03443-0950-44b1-839a-35fd71795350 file = illumos-utils/src/zone.rs:363
10792024-11-27T20:46:27.803ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_3153c6ff-7972-4eff-961c-d5e1d29efabc file = illumos-utils/src/zone.rs:363
10802024-11-27T20:46:27.810ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_916dfff1-8c7a-4ee9-859d-b29aab2b839b file = illumos-utils/src/zone.rs:363
10812024-11-27T20:46:27.816ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_c3958fcf-f239-469b-9c1a-085eb2a46574 file = illumos-utils/src/zone.rs:363
10822024-11-27T20:46:27.821ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_dea39fd9-f9ae-4cd4-a4be-75231f93c875 file = illumos-utils/src/zone.rs:363
10832024-11-27T20:46:27.827ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_85b62460-1774-4b0f-80ef-e51e72587837 file = illumos-utils/src/zone.rs:325
10842024-11-27T20:46:27.832ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_a189f197-7882-4220-a741-c3ab48d1538d file = illumos-utils/src/zone.rs:325
10852024-11-27T20:46:27.838ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_624b70de-5c05-41d7-9bc7-d6788785179f file = illumos-utils/src/zone.rs:325
10862024-11-27T20:46:27.843ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_b620ee63-750b-4cff-b1e4-2bb3459911f2 file = illumos-utils/src/zone.rs:325
10872024-11-27T20:46:27.849ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_1765ccc4-2c06-4c6d-ae19-b79c0f7578bc file = illumos-utils/src/zone.rs:325
10882024-11-27T20:46:27.855ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_a687ab65-8cb5-438f-b716-9c6d0acfbb6d file = illumos-utils/src/zone.rs:325
10892024-11-27T20:46:27.863ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_36882fd9-de52-45bb-ad54-8d8a7a8975d3 file = illumos-utils/src/zone.rs:325
10902024-11-27T20:46:27.927ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
10912024-11-27T20:46:27.927ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_85b62460-1774-4b0f-80ef-e51e72587837 file = illumos-utils/src/zone.rs:363
10922024-11-27T20:46:27.938ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_a189f197-7882-4220-a741-c3ab48d1538d file = illumos-utils/src/zone.rs:363
10932024-11-27T20:46:27.951ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_624b70de-5c05-41d7-9bc7-d6788785179f file = illumos-utils/src/zone.rs:363
10942024-11-27T20:46:27.960ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_b620ee63-750b-4cff-b1e4-2bb3459911f2 file = illumos-utils/src/zone.rs:363
10952024-11-27T20:46:27.969ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_1765ccc4-2c06-4c6d-ae19-b79c0f7578bc file = illumos-utils/src/zone.rs:363
10962024-11-27T20:46:27.978ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_a687ab65-8cb5-438f-b716-9c6d0acfbb6d file = illumos-utils/src/zone.rs:363
10972024-11-27T20:46:27.987ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_36882fd9-de52-45bb-ad54-8d8a7a8975d3 file = illumos-utils/src/zone.rs:363
10982024-11-27T20:46:28.052ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
10992024-11-27T20:46:28.112ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11002024-11-27T20:46:28.175ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11012024-11-27T20:46:28.238ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11022024-11-27T20:46:28.248ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11032024-11-27T20:46:28.248ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11042024-11-27T20:46:28.305ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 128, 26]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
11052024-11-27T20:46:28.305ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1263 zone_type = external_dns
11062024-11-27T20:46:28.306ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11072024-11-27T20:46:28.306ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11082024-11-27T20:46:28.364ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 142, 128]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
11092024-11-27T20:46:28.365ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1263 zone_type = external_dns
11102024-11-27T20:46:28.366ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11112024-11-27T20:46:28.366ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11122024-11-27T20:46:28.422ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 165, 220]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11132024-11-27T20:46:28.422ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1263 zone_type = nexus
11142024-11-27T20:46:28.424ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11152024-11-27T20:46:28.424ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11162024-11-27T20:46:28.482ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 168, 190]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11172024-11-27T20:46:28.482ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1263 zone_type = nexus
11182024-11-27T20:46:28.484ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11192024-11-27T20:46:28.484ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11202024-11-27T20:46:28.539ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 187, 182]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11212024-11-27T20:46:28.539ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1263 zone_type = nexus
11222024-11-27T20:46:28.539ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:83
11232024-11-27T20:46:28.539ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:90
11242024-11-27T20:46:28.539ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:83
11252024-11-27T20:46:28.539ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:90
11262024-11-27T20:46:28.539ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:83
11272024-11-27T20:46:28.539ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:90
11282024-11-27T20:46:28.539ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:83
11292024-11-27T20:46:28.539ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:90
11302024-11-27T20:46:28.560ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:118
11312024-11-27T20:46:28.561ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11322024-11-27T20:46:28.625ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:118
11332024-11-27T20:46:28.631ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:118
11342024-11-27T20:46:28.631ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11352024-11-27T20:46:28.635ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11362024-11-27T20:46:28.635ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:83
11372024-11-27T20:46:28.635ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:90
11382024-11-27T20:46:28.635ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:118
11392024-11-27T20:46:28.753ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:118
11402024-11-27T20:46:28.757ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11412024-11-27T20:46:28.757ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11422024-11-27T20:46:28.803ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_ef029baa-d573-494d-9698-1690c9c57399 file = illumos-utils/src/zone.rs:325
11432024-11-27T20:46:28.816ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_fb7409be-e1e9-41dc-ba28-37cdd7b9c8d6 file = illumos-utils/src/zone.rs:325
11442024-11-27T20:46:28.828ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_ae973228-9cf8-450f-8ac4-7d740fc62ad6 file = illumos-utils/src/zone.rs:325
11452024-11-27T20:46:28.887ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_d13b0217-c0a6-4eaa-8098-4068c753e7f8 file = illumos-utils/src/zone.rs:325
11462024-11-27T20:46:28.901ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_ef029baa-d573-494d-9698-1690c9c57399 file = illumos-utils/src/zone.rs:363
11472024-11-27T20:46:28.911ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_fb7409be-e1e9-41dc-ba28-37cdd7b9c8d6 file = illumos-utils/src/zone.rs:363
11482024-11-27T20:46:28.927ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_ae973228-9cf8-450f-8ac4-7d740fc62ad6 file = illumos-utils/src/zone.rs:363
11492024-11-27T20:46:28.939ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_77818842-4ce3-4fbc-b24e-bfe02c4a0922 file = illumos-utils/src/zone.rs:325
11502024-11-27T20:46:28.954ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_d13b0217-c0a6-4eaa-8098-4068c753e7f8 file = illumos-utils/src/zone.rs:363
11512024-11-27T20:46:28.981ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_77818842-4ce3-4fbc-b24e-bfe02c4a0922 file = illumos-utils/src/zone.rs:363
11522024-11-27T20:46:38.651ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49091
11532024-11-27T20:46:38.704ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 23217 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49091 req_id = 96539bf8-45d5-42df-819a-fe70f7a5fe4f response_code = 200 uri = /baseboard
11542024-11-27T20:46:39.083ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_c3958fcf-f239-469b-9c1a-085eb2a46574: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11552024-11-27T20:46:39.090ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_28a08a69-cd1e-46f3-83b9-e52da0fd36e5: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11562024-11-27T20:46:39.109ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_916dfff1-8c7a-4ee9-859d-b29aab2b839b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11572024-11-27T20:46:39.120ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_c3958fcf-f239-469b-9c1a-085eb2a46574 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_c3958fcf-f239-469b-9c1a-085eb2a46574
11582024-11-27T20:46:39.201ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_28a08a69-cd1e-46f3-83b9-e52da0fd36e5 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_28a08a69-cd1e-46f3-83b9-e52da0fd36e5
11592024-11-27T20:46:39.212ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_916dfff1-8c7a-4ee9-859d-b29aab2b839b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_916dfff1-8c7a-4ee9-859d-b29aab2b839b
11602024-11-27T20:46:39.297ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_d13b0217-c0a6-4eaa-8098-4068c753e7f8: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11612024-11-27T20:46:39.297ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_d13b0217-c0a6-4eaa-8098-4068c753e7f8 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_d13b0217-c0a6-4eaa-8098-4068c753e7f8
11622024-11-27T20:46:39.329ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_1765ccc4-2c06-4c6d-ae19-b79c0f7578bc: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_bd1e9859-f391-4410-ac6a-94d84a761bf8/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='dc934533-1055-4362-8da1-22c6d6f41c44'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11632024-11-27T20:46:39.329ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_52f03443-0950-44b1-839a-35fd71795350: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_54375e11-a569-4c64-8c24-c6dfba089c32/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='c7e9b1ab-8a74-4681-a10e-8229919c4a0c'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11642024-11-27T20:46:39.329ZINFOSledAgent (ServiceManager): Booting oxz_crucible_1765ccc4-2c06-4c6d-ae19-b79c0f7578bc zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_1765ccc4-2c06-4c6d-ae19-b79c0f7578bc
11652024-11-27T20:46:39.338ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_e9e56728-efea-4219-afac-d4b3fc62d122: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_a7344162-b09f-4fab-9022-409ee4ca9964/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='2dbe5848-7d46-4ac3-877f-1454ba5c7d01'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11662024-11-27T20:46:39.338ZINFOSledAgent (ServiceManager): Booting oxz_crucible_52f03443-0950-44b1-839a-35fd71795350 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_52f03443-0950-44b1-839a-35fd71795350
11672024-11-27T20:46:39.347ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_3153c6ff-7972-4eff-961c-d5e1d29efabc: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_0b66aa68-555b-43d3-99fd-94013fc7fb74/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='31992de4-b1ef-46a6-8c9a-6c6b9ec0fa64'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11682024-11-27T20:46:39.348ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_624b70de-5c05-41d7-9bc7-d6788785179f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_c3225150-4706-46cb-9890-c4e173582acb/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='633682f4-f785-4502-9fcd-224d040901d6'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11692024-11-27T20:46:39.365ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_b620ee63-750b-4cff-b1e4-2bb3459911f2: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_4393a6b4-1740-4ce1-b6df-2d78fb8128b9/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='c23f3bcf-dc9c-4f02-a6ba-fab567ba9a56'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11702024-11-27T20:46:39.366ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_a687ab65-8cb5-438f-b716-9c6d0acfbb6d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_f94a6d1b-9178-4c13-817f-a77b6a6cd97e/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='d8fee5a0-34bc-4a34-aef0-4ef82d2d02de'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11712024-11-27T20:46:39.369ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_36882fd9-de52-45bb-ad54-8d8a7a8975d3: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_37e32039-a8dd-4947-8c19-c28ef6335cf2/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='b476fa78-f7dd-4f92-959b-c6179943a792'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11722024-11-27T20:46:39.369ZINFOSledAgent (ServiceManager): Booting oxz_crucible_e9e56728-efea-4219-afac-d4b3fc62d122 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_e9e56728-efea-4219-afac-d4b3fc62d122
11732024-11-27T20:46:39.378ZINFOSledAgent (ServiceManager): Booting oxz_crucible_3153c6ff-7972-4eff-961c-d5e1d29efabc zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_3153c6ff-7972-4eff-961c-d5e1d29efabc
11742024-11-27T20:46:39.385ZINFOSledAgent (ServiceManager): Booting oxz_crucible_624b70de-5c05-41d7-9bc7-d6788785179f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_624b70de-5c05-41d7-9bc7-d6788785179f
11752024-11-27T20:46:39.391ZINFOSledAgent (ServiceManager): Booting oxz_crucible_b620ee63-750b-4cff-b1e4-2bb3459911f2 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_b620ee63-750b-4cff-b1e4-2bb3459911f2
11762024-11-27T20:46:39.399ZINFOSledAgent (ServiceManager): Booting oxz_crucible_a687ab65-8cb5-438f-b716-9c6d0acfbb6d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_a687ab65-8cb5-438f-b716-9c6d0acfbb6d
11772024-11-27T20:46:39.406ZINFOSledAgent (ServiceManager): Booting oxz_crucible_36882fd9-de52-45bb-ad54-8d8a7a8975d3 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_36882fd9-de52-45bb-ad54-8d8a7a8975d3
11782024-11-27T20:46:39.598ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 5.337367128s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e
11792024-11-27T20:46:40.497ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_28a08a69-cd1e-46f3-83b9-e52da0fd36e5") failed: Property not found. retry in 64.311544ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_28a08a69-cd1e-46f3-83b9-e52da0fd36e5
11802024-11-27T20:46:40.504ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d13b0217-c0a6-4eaa-8098-4068c753e7f8") failed: Property not found. retry in 29.060837ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d13b0217-c0a6-4eaa-8098-4068c753e7f8
11812024-11-27T20:46:40.513ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e9e56728-efea-4219-afac-d4b3fc62d122") failed: Property not found. retry in 65.818881ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e9e56728-efea-4219-afac-d4b3fc62d122
11822024-11-27T20:46:40.522ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_52f03443-0950-44b1-839a-35fd71795350") failed: Property not found. retry in 54.424436ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_52f03443-0950-44b1-839a-35fd71795350
11832024-11-27T20:46:40.530ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3153c6ff-7972-4eff-961c-d5e1d29efabc") failed: Property not found. retry in 38.574131ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3153c6ff-7972-4eff-961c-d5e1d29efabc
11842024-11-27T20:46:40.538ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_916dfff1-8c7a-4ee9-859d-b29aab2b839b") failed: Property not found. retry in 64.594882ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_916dfff1-8c7a-4ee9-859d-b29aab2b839b
11852024-11-27T20:46:40.545ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c3958fcf-f239-469b-9c1a-085eb2a46574") failed: Property not found. retry in 67.737082ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c3958fcf-f239-469b-9c1a-085eb2a46574
11862024-11-27T20:46:40.554ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_624b70de-5c05-41d7-9bc7-d6788785179f") failed: Property not found. retry in 65.843124ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_624b70de-5c05-41d7-9bc7-d6788785179f
11872024-11-27T20:46:40.562ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b620ee63-750b-4cff-b1e4-2bb3459911f2") failed: Property not found. retry in 25.463775ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b620ee63-750b-4cff-b1e4-2bb3459911f2
11882024-11-27T20:46:40.573ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1765ccc4-2c06-4c6d-ae19-b79c0f7578bc") failed: Property not found. retry in 71.948298ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1765ccc4-2c06-4c6d-ae19-b79c0f7578bc
11892024-11-27T20:46:40.680ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a687ab65-8cb5-438f-b716-9c6d0acfbb6d") failed: Property not found. retry in 31.164625ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a687ab65-8cb5-438f-b716-9c6d0acfbb6d
11902024-11-27T20:46:40.764ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_36882fd9-de52-45bb-ad54-8d8a7a8975d3") failed: Property not found. retry in 70.8291ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_36882fd9-de52-45bb-ad54-8d8a7a8975d3
11912024-11-27T20:46:40.813ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_28a08a69-cd1e-46f3-83b9-e52da0fd36e5") failed: Property not found. retry in 72.135936ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_28a08a69-cd1e-46f3-83b9-e52da0fd36e5
11922024-11-27T20:46:40.836ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d13b0217-c0a6-4eaa-8098-4068c753e7f8") failed: Property not found. retry in 93.806874ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d13b0217-c0a6-4eaa-8098-4068c753e7f8
11932024-11-27T20:46:40.891ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e9e56728-efea-4219-afac-d4b3fc62d122") failed: Property not found. retry in 51.274868ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e9e56728-efea-4219-afac-d4b3fc62d122
11942024-11-27T20:46:40.907ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_52f03443-0950-44b1-839a-35fd71795350") failed: Property not found. retry in 80.844811ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_52f03443-0950-44b1-839a-35fd71795350
11952024-11-27T20:46:40.922ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3153c6ff-7972-4eff-961c-d5e1d29efabc") failed: Property not found. retry in 107.073664ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3153c6ff-7972-4eff-961c-d5e1d29efabc
11962024-11-27T20:46:40.936ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_916dfff1-8c7a-4ee9-859d-b29aab2b839b") failed: Property not found. retry in 55.198303ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_916dfff1-8c7a-4ee9-859d-b29aab2b839b
11972024-11-27T20:46:40.950ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c3958fcf-f239-469b-9c1a-085eb2a46574") failed: Property not found. retry in 73.098057ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c3958fcf-f239-469b-9c1a-085eb2a46574
11982024-11-27T20:46:40.963ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_624b70de-5c05-41d7-9bc7-d6788785179f") failed: Property not found. retry in 79.998607ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_624b70de-5c05-41d7-9bc7-d6788785179f
11992024-11-27T20:46:40.978ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b620ee63-750b-4cff-b1e4-2bb3459911f2") failed: Property not found. retry in 89.978114ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b620ee63-750b-4cff-b1e4-2bb3459911f2
12002024-11-27T20:46:40.991ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1765ccc4-2c06-4c6d-ae19-b79c0f7578bc") failed: Property not found. retry in 72.499246ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1765ccc4-2c06-4c6d-ae19-b79c0f7578bc
12012024-11-27T20:46:41.005ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a687ab65-8cb5-438f-b716-9c6d0acfbb6d") failed: Property not found. retry in 58.669149ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a687ab65-8cb5-438f-b716-9c6d0acfbb6d
12022024-11-27T20:46:41.020ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_36882fd9-de52-45bb-ad54-8d8a7a8975d3") failed: Property not found. retry in 71.613604ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_36882fd9-de52-45bb-ad54-8d8a7a8975d3
12032024-11-27T20:46:41.035ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_28a08a69-cd1e-46f3-83b9-e52da0fd36e5") failed: Property not found. retry in 184.022863ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_28a08a69-cd1e-46f3-83b9-e52da0fd36e5
12042024-11-27T20:46:41.085ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d13b0217-c0a6-4eaa-8098-4068c753e7f8") failed: Property not found. retry in 120.365334ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d13b0217-c0a6-4eaa-8098-4068c753e7f8
12052024-11-27T20:46:41.098ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e9e56728-efea-4219-afac-d4b3fc62d122") failed: Property not found. retry in 129.603693ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e9e56728-efea-4219-afac-d4b3fc62d122
12062024-11-27T20:46:41.113ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_52f03443-0950-44b1-839a-35fd71795350") failed: Property not found. retry in 119.90839ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_52f03443-0950-44b1-839a-35fd71795350
12072024-11-27T20:46:41.150ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3153c6ff-7972-4eff-961c-d5e1d29efabc") failed: Property not found. retry in 188.54978ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3153c6ff-7972-4eff-961c-d5e1d29efabc
12082024-11-27T20:46:41.161ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_916dfff1-8c7a-4ee9-859d-b29aab2b839b") failed: Property not found. retry in 292.517209ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_916dfff1-8c7a-4ee9-859d-b29aab2b839b
12092024-11-27T20:46:41.172ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c3958fcf-f239-469b-9c1a-085eb2a46574") failed: Property not found. retry in 255.914599ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c3958fcf-f239-469b-9c1a-085eb2a46574
12102024-11-27T20:46:41.183ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_624b70de-5c05-41d7-9bc7-d6788785179f") failed: Property not found. retry in 187.197782ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_624b70de-5c05-41d7-9bc7-d6788785179f
12112024-11-27T20:46:41.195ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b620ee63-750b-4cff-b1e4-2bb3459911f2") failed: Property not found. retry in 108.451207ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b620ee63-750b-4cff-b1e4-2bb3459911f2
12122024-11-27T20:46:41.206ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1765ccc4-2c06-4c6d-ae19-b79c0f7578bc") failed: Property not found. retry in 261.438844ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1765ccc4-2c06-4c6d-ae19-b79c0f7578bc
12132024-11-27T20:46:41.219ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a687ab65-8cb5-438f-b716-9c6d0acfbb6d") failed: Property not found. retry in 209.850126ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a687ab65-8cb5-438f-b716-9c6d0acfbb6d
12142024-11-27T20:46:41.229ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_36882fd9-de52-45bb-ad54-8d8a7a8975d3") failed: Property not found. retry in 107.299105ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_36882fd9-de52-45bb-ad54-8d8a7a8975d3
12152024-11-27T20:46:41.238ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_28a08a69-cd1e-46f3-83b9-e52da0fd36e5") failed: Property not found. retry in 203.856117ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_28a08a69-cd1e-46f3-83b9-e52da0fd36e5
12162024-11-27T20:46:41.248ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d13b0217-c0a6-4eaa-8098-4068c753e7f8") failed: Property not found. retry in 426.751329ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d13b0217-c0a6-4eaa-8098-4068c753e7f8
12172024-11-27T20:46:41.257ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e9e56728-efea-4219-afac-d4b3fc62d122") failed: Property not found. retry in 307.656913ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e9e56728-efea-4219-afac-d4b3fc62d122
12182024-11-27T20:46:41.267ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_52f03443-0950-44b1-839a-35fd71795350") failed: Property not found. retry in 317.063229ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_52f03443-0950-44b1-839a-35fd71795350
12192024-11-27T20:46:41.320ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b620ee63-750b-4cff-b1e4-2bb3459911f2") failed: Property not found. retry in 497.295837ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b620ee63-750b-4cff-b1e4-2bb3459911f2
12202024-11-27T20:46:41.359ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_36882fd9-de52-45bb-ad54-8d8a7a8975d3") failed: Property not found. retry in 516.834207ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_36882fd9-de52-45bb-ad54-8d8a7a8975d3
12212024-11-27T20:46:41.371ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3153c6ff-7972-4eff-961c-d5e1d29efabc") failed: Property not found. retry in 535.05888ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3153c6ff-7972-4eff-961c-d5e1d29efabc
12222024-11-27T20:46:41.387ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_624b70de-5c05-41d7-9bc7-d6788785179f") failed: Property not found. retry in 583.339177ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_624b70de-5c05-41d7-9bc7-d6788785179f
12232024-11-27T20:46:41.442ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c3958fcf-f239-469b-9c1a-085eb2a46574") failed: Property not found. retry in 513.035085ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c3958fcf-f239-469b-9c1a-085eb2a46574
12242024-11-27T20:46:41.455ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_28a08a69-cd1e-46f3-83b9-e52da0fd36e5") failed: Property not found. retry in 786.141425ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_28a08a69-cd1e-46f3-83b9-e52da0fd36e5
12252024-11-27T20:46:41.467ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a687ab65-8cb5-438f-b716-9c6d0acfbb6d") failed: Property not found. retry in 455.29711ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a687ab65-8cb5-438f-b716-9c6d0acfbb6d
12262024-11-27T20:46:41.476ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_916dfff1-8c7a-4ee9-859d-b29aab2b839b") failed: Property not found. retry in 580.085234ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_916dfff1-8c7a-4ee9-859d-b29aab2b839b
12272024-11-27T20:46:41.486ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1765ccc4-2c06-4c6d-ae19-b79c0f7578bc") failed: Property not found. retry in 450.189293ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1765ccc4-2c06-4c6d-ae19-b79c0f7578bc
12282024-11-27T20:46:41.579ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e9e56728-efea-4219-afac-d4b3fc62d122") failed: Property not found. retry in 1.016816117s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e9e56728-efea-4219-afac-d4b3fc62d122
12292024-11-27T20:46:41.597ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_52f03443-0950-44b1-839a-35fd71795350") failed: Property not found. retry in 1.064103019s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_52f03443-0950-44b1-839a-35fd71795350
12302024-11-27T20:46:41.689ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d13b0217-c0a6-4eaa-8098-4068c753e7f8") failed: Property not found. retry in 1.068809025s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d13b0217-c0a6-4eaa-8098-4068c753e7f8
12312024-11-27T20:46:41.831ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b620ee63-750b-4cff-b1e4-2bb3459911f2") failed: Property not found. retry in 1.109386359s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b620ee63-750b-4cff-b1e4-2bb3459911f2
12322024-11-27T20:46:41.891ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_36882fd9-de52-45bb-ad54-8d8a7a8975d3") failed: Property not found. retry in 476.050473ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_36882fd9-de52-45bb-ad54-8d8a7a8975d3
12332024-11-27T20:46:41.919ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3153c6ff-7972-4eff-961c-d5e1d29efabc") failed: Property not found. retry in 676.763209ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3153c6ff-7972-4eff-961c-d5e1d29efabc
12342024-11-27T20:46:41.936ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a687ab65-8cb5-438f-b716-9c6d0acfbb6d") failed: Property not found. retry in 1.137148096s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a687ab65-8cb5-438f-b716-9c6d0acfbb6d
12352024-11-27T20:46:41.949ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1765ccc4-2c06-4c6d-ae19-b79c0f7578bc") failed: Property not found. retry in 517.255695ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1765ccc4-2c06-4c6d-ae19-b79c0f7578bc
12362024-11-27T20:46:41.969ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c3958fcf-f239-469b-9c1a-085eb2a46574") failed: Property not found. retry in 780.038094ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c3958fcf-f239-469b-9c1a-085eb2a46574
12372024-11-27T20:46:41.981ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_624b70de-5c05-41d7-9bc7-d6788785179f") failed: Property not found. retry in 543.365012ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_624b70de-5c05-41d7-9bc7-d6788785179f
12382024-11-27T20:46:42.068ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_916dfff1-8c7a-4ee9-859d-b29aab2b839b") failed: Property not found. retry in 1.135019936s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_916dfff1-8c7a-4ee9-859d-b29aab2b839b
12392024-11-27T20:46:42.323ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_28a08a69-cd1e-46f3-83b9-e52da0fd36e5") failed: Property not found. retry in 1.19823025s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_28a08a69-cd1e-46f3-83b9-e52da0fd36e5
12402024-11-27T20:46:42.382ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_36882fd9-de52-45bb-ad54-8d8a7a8975d3") failed: Property not found. retry in 1.084024433s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_36882fd9-de52-45bb-ad54-8d8a7a8975d3
12412024-11-27T20:46:42.479ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1765ccc4-2c06-4c6d-ae19-b79c0f7578bc") failed: Property not found. retry in 1.304112324s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1765ccc4-2c06-4c6d-ae19-b79c0f7578bc
12422024-11-27T20:46:42.534ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_624b70de-5c05-41d7-9bc7-d6788785179f") failed: Property not found. retry in 653.226893ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_624b70de-5c05-41d7-9bc7-d6788785179f
12432024-11-27T20:46:42.605ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e9e56728-efea-4219-afac-d4b3fc62d122") failed: Property not found. retry in 698.04258ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e9e56728-efea-4219-afac-d4b3fc62d122
12442024-11-27T20:46:42.613ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3153c6ff-7972-4eff-961c-d5e1d29efabc") failed: Property not found. retry in 1.140566513s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3153c6ff-7972-4eff-961c-d5e1d29efabc
12452024-11-27T20:46:42.671ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_52f03443-0950-44b1-839a-35fd71795350") failed: Property not found. retry in 925.014815ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_52f03443-0950-44b1-839a-35fd71795350
12462024-11-27T20:46:42.759ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c3958fcf-f239-469b-9c1a-085eb2a46574") failed: Property not found. retry in 804.919721ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c3958fcf-f239-469b-9c1a-085eb2a46574
12472024-11-27T20:46:42.767ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d13b0217-c0a6-4eaa-8098-4068c753e7f8") failed: Property not found. retry in 905.383706ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d13b0217-c0a6-4eaa-8098-4068c753e7f8
12482024-11-27T20:46:43.008ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b620ee63-750b-4cff-b1e4-2bb3459911f2") failed: Property not found. retry in 1.162132732s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b620ee63-750b-4cff-b1e4-2bb3459911f2
12492024-11-27T20:46:43.009ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_77818842-4ce3-4fbc-b24e-bfe02c4a0922: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12502024-11-27T20:46:43.009ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_fb7409be-e1e9-41dc-ba28-37cdd7b9c8d6: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12512024-11-27T20:46:43.009ZINFOSledAgent (ServiceManager): Booting oxz_nexus_77818842-4ce3-4fbc-b24e-bfe02c4a0922 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_77818842-4ce3-4fbc-b24e-bfe02c4a0922
12522024-11-27T20:46:43.013ZINFOSledAgent (ServiceManager): Booting oxz_nexus_fb7409be-e1e9-41dc-ba28-37cdd7b9c8d6 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_fb7409be-e1e9-41dc-ba28-37cdd7b9c8d6
12532024-11-27T20:46:43.084ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a687ab65-8cb5-438f-b716-9c6d0acfbb6d") failed: Property not found. retry in 674.225944ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a687ab65-8cb5-438f-b716-9c6d0acfbb6d
12542024-11-27T20:46:43.179ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fb7409be-e1e9-41dc-ba28-37cdd7b9c8d6") failed: Property not found. retry in 60.029866ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fb7409be-e1e9-41dc-ba28-37cdd7b9c8d6
12552024-11-27T20:46:43.188ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_77818842-4ce3-4fbc-b24e-bfe02c4a0922") failed: Property not found. retry in 72.99049ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_77818842-4ce3-4fbc-b24e-bfe02c4a0922
12562024-11-27T20:46:43.196ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_624b70de-5c05-41d7-9bc7-d6788785179f") failed: Property not found. retry in 1.489415247s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_624b70de-5c05-41d7-9bc7-d6788785179f
12572024-11-27T20:46:43.211ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_916dfff1-8c7a-4ee9-859d-b29aab2b839b") failed: Property not found. retry in 1.349767754s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_916dfff1-8c7a-4ee9-859d-b29aab2b839b
12582024-11-27T20:46:43.247ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fb7409be-e1e9-41dc-ba28-37cdd7b9c8d6") failed: Property not found. retry in 129.072614ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fb7409be-e1e9-41dc-ba28-37cdd7b9c8d6
12592024-11-27T20:46:43.282ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_77818842-4ce3-4fbc-b24e-bfe02c4a0922") failed: Property not found. retry in 80.319037ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_77818842-4ce3-4fbc-b24e-bfe02c4a0922
12602024-11-27T20:46:43.312ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e9e56728-efea-4219-afac-d4b3fc62d122") failed: Property not found. retry in 958.771034ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e9e56728-efea-4219-afac-d4b3fc62d122
12612024-11-27T20:46:43.372ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_77818842-4ce3-4fbc-b24e-bfe02c4a0922") failed: Property not found. retry in 260.129867ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_77818842-4ce3-4fbc-b24e-bfe02c4a0922
12622024-11-27T20:46:43.386ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fb7409be-e1e9-41dc-ba28-37cdd7b9c8d6") failed: Property not found. retry in 189.245363ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fb7409be-e1e9-41dc-ba28-37cdd7b9c8d6
12632024-11-27T20:46:43.475ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_36882fd9-de52-45bb-ad54-8d8a7a8975d3") failed: Property not found. retry in 847.9367ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_36882fd9-de52-45bb-ad54-8d8a7a8975d3
12642024-11-27T20:46:43.530ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_28a08a69-cd1e-46f3-83b9-e52da0fd36e5") failed: Property not found. retry in 917.522364ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_28a08a69-cd1e-46f3-83b9-e52da0fd36e5
12652024-11-27T20:46:43.573ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c3958fcf-f239-469b-9c1a-085eb2a46574") failed: Property not found. retry in 981.319273ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c3958fcf-f239-469b-9c1a-085eb2a46574
12662024-11-27T20:46:43.585ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fb7409be-e1e9-41dc-ba28-37cdd7b9c8d6") failed: Property not found. retry in 493.378904ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fb7409be-e1e9-41dc-ba28-37cdd7b9c8d6
12672024-11-27T20:46:43.606ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_52f03443-0950-44b1-839a-35fd71795350") failed: Property not found. retry in 570.358955ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_52f03443-0950-44b1-839a-35fd71795350
12682024-11-27T20:46:43.643ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_77818842-4ce3-4fbc-b24e-bfe02c4a0922") failed: Property not found. retry in 477.736295ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_77818842-4ce3-4fbc-b24e-bfe02c4a0922
12692024-11-27T20:46:43.682ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d13b0217-c0a6-4eaa-8098-4068c753e7f8") failed: Property not found. retry in 897.331889ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d13b0217-c0a6-4eaa-8098-4068c753e7f8
12702024-11-27T20:46:43.764ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3153c6ff-7972-4eff-961c-d5e1d29efabc") failed: Property not found. retry in 620.013008ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3153c6ff-7972-4eff-961c-d5e1d29efabc
12712024-11-27T20:46:43.773ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a687ab65-8cb5-438f-b716-9c6d0acfbb6d") failed: Property not found. retry in 842.472245ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a687ab65-8cb5-438f-b716-9c6d0acfbb6d
12722024-11-27T20:46:43.792ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1765ccc4-2c06-4c6d-ae19-b79c0f7578bc") failed: Property not found. retry in 1.281714033s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1765ccc4-2c06-4c6d-ae19-b79c0f7578bc
12732024-11-27T20:46:44.091ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fb7409be-e1e9-41dc-ba28-37cdd7b9c8d6") failed: Property not found. retry in 419.02463ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fb7409be-e1e9-41dc-ba28-37cdd7b9c8d6
12742024-11-27T20:46:44.132ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_77818842-4ce3-4fbc-b24e-bfe02c4a0922") failed: Property not found. retry in 478.944782ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_77818842-4ce3-4fbc-b24e-bfe02c4a0922
12752024-11-27T20:46:44.181ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b620ee63-750b-4cff-b1e4-2bb3459911f2") failed: Property not found. retry in 615.714393ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b620ee63-750b-4cff-b1e4-2bb3459911f2
12762024-11-27T20:46:44.190ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_52f03443-0950-44b1-839a-35fd71795350") failed: Property not found. retry in 1.172702371s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_52f03443-0950-44b1-839a-35fd71795350
12772024-11-27T20:46:44.263ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_ef029baa-d573-494d-9698-1690c9c57399: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12782024-11-27T20:46:44.263ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_ef029baa-d573-494d-9698-1690c9c57399 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_ef029baa-d573-494d-9698-1690c9c57399
12792024-11-27T20:46:44.281ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e9e56728-efea-4219-afac-d4b3fc62d122") failed: Property not found. retry in 1.287409335s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e9e56728-efea-4219-afac-d4b3fc62d122
12802024-11-27T20:46:44.333ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_36882fd9-de52-45bb-ad54-8d8a7a8975d3") failed: Property not found. retry in 734.650238ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_36882fd9-de52-45bb-ad54-8d8a7a8975d3
12812024-11-27T20:46:44.381ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_a189f197-7882-4220-a741-c3ab48d1538d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_ff99775c-fb56-419e-aef8-9c8117494384/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='e8045945-7313-45f6-875b-27e56e0a53c7'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12822024-11-27T20:46:44.382ZINFOSledAgent (ServiceManager): Booting oxz_crucible_a189f197-7882-4220-a741-c3ab48d1538d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_a189f197-7882-4220-a741-c3ab48d1538d
12832024-11-27T20:46:44.396ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3153c6ff-7972-4eff-961c-d5e1d29efabc") failed: Property not found. retry in 626.89331ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3153c6ff-7972-4eff-961c-d5e1d29efabc
12842024-11-27T20:46:44.423ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ef029baa-d573-494d-9698-1690c9c57399") failed: Property not found. retry in 60.050591ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ef029baa-d573-494d-9698-1690c9c57399
12852024-11-27T20:46:44.458ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_28a08a69-cd1e-46f3-83b9-e52da0fd36e5") failed: Property not found. retry in 1.291727927s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_28a08a69-cd1e-46f3-83b9-e52da0fd36e5
12862024-11-27T20:46:44.492ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ef029baa-d573-494d-9698-1690c9c57399") failed: Property not found. retry in 103.553396ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ef029baa-d573-494d-9698-1690c9c57399
12872024-11-27T20:46:44.521ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fb7409be-e1e9-41dc-ba28-37cdd7b9c8d6") failed: Property not found. retry in 1.314404021s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fb7409be-e1e9-41dc-ba28-37cdd7b9c8d6
12882024-11-27T20:46:44.543ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a189f197-7882-4220-a741-c3ab48d1538d") failed: Property not found. retry in 53.391532ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a189f197-7882-4220-a741-c3ab48d1538d
12892024-11-27T20:46:44.563ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c3958fcf-f239-469b-9c1a-085eb2a46574") failed: Property not found. retry in 1.226726684s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c3958fcf-f239-469b-9c1a-085eb2a46574
12902024-11-27T20:46:44.571ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_916dfff1-8c7a-4ee9-859d-b29aab2b839b") failed: Property not found. retry in 1.261240205s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_916dfff1-8c7a-4ee9-859d-b29aab2b839b
12912024-11-27T20:46:44.588ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d13b0217-c0a6-4eaa-8098-4068c753e7f8") failed: Property not found. retry in 1.158353085s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d13b0217-c0a6-4eaa-8098-4068c753e7f8
12922024-11-27T20:46:44.604ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ef029baa-d573-494d-9698-1690c9c57399") failed: Property not found. retry in 286.328029ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ef029baa-d573-494d-9698-1690c9c57399
12932024-11-27T20:46:44.611ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a189f197-7882-4220-a741-c3ab48d1538d") failed: Property not found. retry in 122.424212ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a189f197-7882-4220-a741-c3ab48d1538d
12942024-11-27T20:46:44.619ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_77818842-4ce3-4fbc-b24e-bfe02c4a0922") failed: Property not found. retry in 1.109389377s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_77818842-4ce3-4fbc-b24e-bfe02c4a0922
12952024-11-27T20:46:44.627ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a687ab65-8cb5-438f-b716-9c6d0acfbb6d") failed: Property not found. retry in 1.106069249s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a687ab65-8cb5-438f-b716-9c6d0acfbb6d
12962024-11-27T20:46:44.695ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_624b70de-5c05-41d7-9bc7-d6788785179f") failed: Property not found. retry in 1.327210494s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_624b70de-5c05-41d7-9bc7-d6788785179f
12972024-11-27T20:46:44.742ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a189f197-7882-4220-a741-c3ab48d1538d") failed: Property not found. retry in 282.194866ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a189f197-7882-4220-a741-c3ab48d1538d
12982024-11-27T20:46:44.845ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b620ee63-750b-4cff-b1e4-2bb3459911f2") failed: Property not found. retry in 540.473105ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b620ee63-750b-4cff-b1e4-2bb3459911f2
12992024-11-27T20:46:44.931ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ef029baa-d573-494d-9698-1690c9c57399") failed: Property not found. retry in 277.949676ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ef029baa-d573-494d-9698-1690c9c57399
13002024-11-27T20:46:45.137ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3153c6ff-7972-4eff-961c-d5e1d29efabc") failed: Property not found. retry in 782.438623ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3153c6ff-7972-4eff-961c-d5e1d29efabc
13012024-11-27T20:46:45.144ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a189f197-7882-4220-a741-c3ab48d1538d") failed: Property not found. retry in 266.417086ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a189f197-7882-4220-a741-c3ab48d1538d
13022024-11-27T20:46:45.153ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1765ccc4-2c06-4c6d-ae19-b79c0f7578bc") failed: Property not found. retry in 1.474279678s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1765ccc4-2c06-4c6d-ae19-b79c0f7578bc
13032024-11-27T20:46:45.166ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_36882fd9-de52-45bb-ad54-8d8a7a8975d3") failed: Property not found. retry in 1.363433638s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_36882fd9-de52-45bb-ad54-8d8a7a8975d3
13042024-11-27T20:46:45.168ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_ae973228-9cf8-450f-8ac4-7d740fc62ad6: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13052024-11-27T20:46:45.168ZINFOSledAgent (ServiceManager): Booting oxz_nexus_ae973228-9cf8-450f-8ac4-7d740fc62ad6 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_ae973228-9cf8-450f-8ac4-7d740fc62ad6
13062024-11-27T20:46:45.227ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ef029baa-d573-494d-9698-1690c9c57399") failed: Property not found. retry in 619.522592ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ef029baa-d573-494d-9698-1690c9c57399
13072024-11-27T20:46:45.363ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ae973228-9cf8-450f-8ac4-7d740fc62ad6") failed: Property not found. retry in 68.256429ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ae973228-9cf8-450f-8ac4-7d740fc62ad6
13082024-11-27T20:46:45.372ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_52f03443-0950-44b1-839a-35fd71795350") failed: Property not found. retry in 885.54183ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_52f03443-0950-44b1-839a-35fd71795350
13092024-11-27T20:46:45.396ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b620ee63-750b-4cff-b1e4-2bb3459911f2") failed: Property not found. retry in 700.581668ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b620ee63-750b-4cff-b1e4-2bb3459911f2
13102024-11-27T20:46:45.420ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a189f197-7882-4220-a741-c3ab48d1538d") failed: Property not found. retry in 751.406822ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a189f197-7882-4220-a741-c3ab48d1538d
13112024-11-27T20:46:45.441ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ae973228-9cf8-450f-8ac4-7d740fc62ad6") failed: Property not found. retry in 93.615499ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ae973228-9cf8-450f-8ac4-7d740fc62ad6
13122024-11-27T20:46:45.546ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ae973228-9cf8-450f-8ac4-7d740fc62ad6") failed: Property not found. retry in 233.010261ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ae973228-9cf8-450f-8ac4-7d740fc62ad6
13132024-11-27T20:46:45.579ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e9e56728-efea-4219-afac-d4b3fc62d122") failed: Property not found. retry in 1.496698779s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e9e56728-efea-4219-afac-d4b3fc62d122
13142024-11-27T20:46:45.594ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_dea39fd9-f9ae-4cd4-a4be-75231f93c875: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='dea39fd9-f9ae-4cd4-a4be-75231f93c875'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13152024-11-27T20:46:45.594ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_dea39fd9-f9ae-4cd4-a4be-75231f93c875 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_oximeter_dea39fd9-f9ae-4cd4-a4be-75231f93c875
13162024-11-27T20:46:45.738ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_77818842-4ce3-4fbc-b24e-bfe02c4a0922") failed: Property not found. retry in 1.467138499s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_77818842-4ce3-4fbc-b24e-bfe02c4a0922
13172024-11-27T20:46:45.747ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a687ab65-8cb5-438f-b716-9c6d0acfbb6d") failed: Property not found. retry in 519.162778ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a687ab65-8cb5-438f-b716-9c6d0acfbb6d
13182024-11-27T20:46:45.757ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d13b0217-c0a6-4eaa-8098-4068c753e7f8") failed: Property not found. retry in 1.110955295s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d13b0217-c0a6-4eaa-8098-4068c753e7f8
13192024-11-27T20:46:45.766ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_28a08a69-cd1e-46f3-83b9-e52da0fd36e5") failed: Property not found. retry in 1.273046266s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_28a08a69-cd1e-46f3-83b9-e52da0fd36e5
13202024-11-27T20:46:45.773ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_dea39fd9-f9ae-4cd4-a4be-75231f93c875") failed: Property not found. retry in 57.548989ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_dea39fd9-f9ae-4cd4-a4be-75231f93c875
13212024-11-27T20:46:45.788ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ae973228-9cf8-450f-8ac4-7d740fc62ad6") failed: Property not found. retry in 577.426693ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ae973228-9cf8-450f-8ac4-7d740fc62ad6
13222024-11-27T20:46:45.799ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c3958fcf-f239-469b-9c1a-085eb2a46574") failed: Property not found. retry in 1.235199772s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c3958fcf-f239-469b-9c1a-085eb2a46574
13232024-11-27T20:46:45.839ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_dea39fd9-f9ae-4cd4-a4be-75231f93c875") failed: Property not found. retry in 72.154266ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_dea39fd9-f9ae-4cd4-a4be-75231f93c875
13242024-11-27T20:46:45.848ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fb7409be-e1e9-41dc-ba28-37cdd7b9c8d6") failed: Property not found. retry in 974.023945ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fb7409be-e1e9-41dc-ba28-37cdd7b9c8d6
13252024-11-27T20:46:45.855ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_916dfff1-8c7a-4ee9-859d-b29aab2b839b") failed: Property not found. retry in 1.303322489s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_916dfff1-8c7a-4ee9-859d-b29aab2b839b
13262024-11-27T20:46:45.864ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ef029baa-d573-494d-9698-1690c9c57399") failed: Property not found. retry in 1.32453181s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ef029baa-d573-494d-9698-1690c9c57399
13272024-11-27T20:46:45.920ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_dea39fd9-f9ae-4cd4-a4be-75231f93c875") failed: Property not found. retry in 219.350718ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_dea39fd9-f9ae-4cd4-a4be-75231f93c875
13282024-11-27T20:46:45.928ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3153c6ff-7972-4eff-961c-d5e1d29efabc") failed: Property not found. retry in 1.297695923s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3153c6ff-7972-4eff-961c-d5e1d29efabc
13292024-11-27T20:46:46.031ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_624b70de-5c05-41d7-9bc7-d6788785179f") failed: Property not found. retry in 1.389599569s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_624b70de-5c05-41d7-9bc7-d6788785179f
13302024-11-27T20:46:46.107ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b620ee63-750b-4cff-b1e4-2bb3459911f2") failed: Property not found. retry in 1.483173604s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b620ee63-750b-4cff-b1e4-2bb3459911f2
13312024-11-27T20:46:46.150ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_dea39fd9-f9ae-4cd4-a4be-75231f93c875") failed: Property not found. retry in 348.086742ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_dea39fd9-f9ae-4cd4-a4be-75231f93c875
13322024-11-27T20:46:46.181ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a189f197-7882-4220-a741-c3ab48d1538d") failed: Property not found. retry in 919.190054ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a189f197-7882-4220-a741-c3ab48d1538d
13332024-11-27T20:46:46.274ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_52f03443-0950-44b1-839a-35fd71795350") failed: Property not found. retry in 1.198542338s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_52f03443-0950-44b1-839a-35fd71795350
13342024-11-27T20:46:46.284ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a687ab65-8cb5-438f-b716-9c6d0acfbb6d") failed: Property not found. retry in 655.09779ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a687ab65-8cb5-438f-b716-9c6d0acfbb6d
13352024-11-27T20:46:46.383ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ae973228-9cf8-450f-8ac4-7d740fc62ad6") failed: Property not found. retry in 723.151357ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ae973228-9cf8-450f-8ac4-7d740fc62ad6
13362024-11-27T20:46:46.511ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_dea39fd9-f9ae-4cd4-a4be-75231f93c875") failed: Property not found. retry in 831.857351ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_dea39fd9-f9ae-4cd4-a4be-75231f93c875
13372024-11-27T20:46:46.541ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_36882fd9-de52-45bb-ad54-8d8a7a8975d3") failed: Property not found. retry in 1.004635655s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_36882fd9-de52-45bb-ad54-8d8a7a8975d3
13382024-11-27T20:46:46.638ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1765ccc4-2c06-4c6d-ae19-b79c0f7578bc") failed: Property not found. retry in 756.148805ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1765ccc4-2c06-4c6d-ae19-b79c0f7578bc
13392024-11-27T20:46:46.831ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fb7409be-e1e9-41dc-ba28-37cdd7b9c8d6") failed: Property not found. retry in 529.896311ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fb7409be-e1e9-41dc-ba28-37cdd7b9c8d6
13402024-11-27T20:46:46.878ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d13b0217-c0a6-4eaa-8098-4068c753e7f8") failed: Property not found. retry in 1.03191945s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d13b0217-c0a6-4eaa-8098-4068c753e7f8
13412024-11-27T20:46:46.950ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a687ab65-8cb5-438f-b716-9c6d0acfbb6d") failed: Property not found. retry in 868.449341ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a687ab65-8cb5-438f-b716-9c6d0acfbb6d
13422024-11-27T20:46:47.051ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c3958fcf-f239-469b-9c1a-085eb2a46574") failed: Property not found. retry in 1.436364075s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c3958fcf-f239-469b-9c1a-085eb2a46574
13432024-11-27T20:46:47.061ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_28a08a69-cd1e-46f3-83b9-e52da0fd36e5") failed: Property not found. retry in 1.103585819s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_28a08a69-cd1e-46f3-83b9-e52da0fd36e5
13442024-11-27T20:46:47.086ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e9e56728-efea-4219-afac-d4b3fc62d122") failed: Property not found. retry in 1.414342774s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e9e56728-efea-4219-afac-d4b3fc62d122
13452024-11-27T20:46:47.109ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a189f197-7882-4220-a741-c3ab48d1538d") failed: Property not found. retry in 1.355025943s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a189f197-7882-4220-a741-c3ab48d1538d
13462024-11-27T20:46:47.118ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ae973228-9cf8-450f-8ac4-7d740fc62ad6") failed: Property not found. retry in 1.319504108s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ae973228-9cf8-450f-8ac4-7d740fc62ad6
13472024-11-27T20:46:47.174ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_916dfff1-8c7a-4ee9-859d-b29aab2b839b") failed: Property not found. retry in 645.680237ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_916dfff1-8c7a-4ee9-859d-b29aab2b839b
13482024-11-27T20:46:47.199ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ef029baa-d573-494d-9698-1690c9c57399") failed: Property not found. retry in 1.166340266s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ef029baa-d573-494d-9698-1690c9c57399
13492024-11-27T20:46:47.216ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_77818842-4ce3-4fbc-b24e-bfe02c4a0922") failed: Property not found. retry in 751.91963ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_77818842-4ce3-4fbc-b24e-bfe02c4a0922
13502024-11-27T20:46:47.235ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3153c6ff-7972-4eff-961c-d5e1d29efabc") failed: Property not found. retry in 849.208707ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3153c6ff-7972-4eff-961c-d5e1d29efabc
13512024-11-27T20:46:47.354ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_dea39fd9-f9ae-4cd4-a4be-75231f93c875") failed: Property not found. retry in 931.513688ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_dea39fd9-f9ae-4cd4-a4be-75231f93c875
13522024-11-27T20:46:47.373ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fb7409be-e1e9-41dc-ba28-37cdd7b9c8d6") failed: Property not found. retry in 649.639176ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fb7409be-e1e9-41dc-ba28-37cdd7b9c8d6
13532024-11-27T20:46:47.408ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1765ccc4-2c06-4c6d-ae19-b79c0f7578bc") failed: Property not found. retry in 1.491379811s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1765ccc4-2c06-4c6d-ae19-b79c0f7578bc
13542024-11-27T20:46:47.431ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_624b70de-5c05-41d7-9bc7-d6788785179f") failed: Property not found. retry in 1.493680998s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_624b70de-5c05-41d7-9bc7-d6788785179f
13552024-11-27T20:46:47.484ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_52f03443-0950-44b1-839a-35fd71795350") failed: Property not found. retry in 898.89283ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_52f03443-0950-44b1-839a-35fd71795350
13562024-11-27T20:46:47.560ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_36882fd9-de52-45bb-ad54-8d8a7a8975d3") failed: Property not found. retry in 1.367745598s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_36882fd9-de52-45bb-ad54-8d8a7a8975d3
13572024-11-27T20:46:47.601ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b620ee63-750b-4cff-b1e4-2bb3459911f2") failed: Property not found. retry in 1.377284969s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b620ee63-750b-4cff-b1e4-2bb3459911f2
13582024-11-27T20:46:47.830ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a687ab65-8cb5-438f-b716-9c6d0acfbb6d") failed: Property not found. retry in 1.128310895s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a687ab65-8cb5-438f-b716-9c6d0acfbb6d
13592024-11-27T20:46:47.840ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_916dfff1-8c7a-4ee9-859d-b29aab2b839b") failed: Property not found. retry in 1.054013886s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_916dfff1-8c7a-4ee9-859d-b29aab2b839b
13602024-11-27T20:46:47.924ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d13b0217-c0a6-4eaa-8098-4068c753e7f8") failed: Property not found. retry in 1.276374012s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d13b0217-c0a6-4eaa-8098-4068c753e7f8
13612024-11-27T20:46:47.979ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_77818842-4ce3-4fbc-b24e-bfe02c4a0922") failed: Property not found. retry in 627.981613ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_77818842-4ce3-4fbc-b24e-bfe02c4a0922
13622024-11-27T20:46:48.035ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fb7409be-e1e9-41dc-ba28-37cdd7b9c8d6") failed: Property not found. retry in 608.572204ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fb7409be-e1e9-41dc-ba28-37cdd7b9c8d6
13632024-11-27T20:46:48.096ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3153c6ff-7972-4eff-961c-d5e1d29efabc") failed: Property not found. retry in 1.182951087s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3153c6ff-7972-4eff-961c-d5e1d29efabc
13642024-11-27T20:46:48.177ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_28a08a69-cd1e-46f3-83b9-e52da0fd36e5") failed: Property not found. retry in 575.206747ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_28a08a69-cd1e-46f3-83b9-e52da0fd36e5
13652024-11-27T20:46:48.297ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_dea39fd9-f9ae-4cd4-a4be-75231f93c875") failed: Property not found. retry in 794.96964ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_dea39fd9-f9ae-4cd4-a4be-75231f93c875
13662024-11-27T20:46:48.378ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ef029baa-d573-494d-9698-1690c9c57399") failed: Property not found. retry in 822.788313ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ef029baa-d573-494d-9698-1690c9c57399
13672024-11-27T20:46:48.393ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_52f03443-0950-44b1-839a-35fd71795350") failed: Property not found. retry in 911.224406ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_52f03443-0950-44b1-839a-35fd71795350
13682024-11-27T20:46:48.450ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ae973228-9cf8-450f-8ac4-7d740fc62ad6") failed: Property not found. retry in 1.191407635s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ae973228-9cf8-450f-8ac4-7d740fc62ad6
13692024-11-27T20:46:48.478ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a189f197-7882-4220-a741-c3ab48d1538d") failed: Property not found. retry in 607.251539ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a189f197-7882-4220-a741-c3ab48d1538d
13702024-11-27T20:46:48.500ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c3958fcf-f239-469b-9c1a-085eb2a46574") failed: Property not found. retry in 762.198954ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c3958fcf-f239-469b-9c1a-085eb2a46574
13712024-11-27T20:46:48.511ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e9e56728-efea-4219-afac-d4b3fc62d122") failed: Property not found. retry in 1.069198498s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e9e56728-efea-4219-afac-d4b3fc62d122
13722024-11-27T20:46:48.618ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_77818842-4ce3-4fbc-b24e-bfe02c4a0922") failed: Property not found. retry in 1.475005896s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_77818842-4ce3-4fbc-b24e-bfe02c4a0922
13732024-11-27T20:46:48.653ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fb7409be-e1e9-41dc-ba28-37cdd7b9c8d6") failed: Property not found. retry in 516.842157ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fb7409be-e1e9-41dc-ba28-37cdd7b9c8d6
13742024-11-27T20:46:48.765ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_28a08a69-cd1e-46f3-83b9-e52da0fd36e5") failed: Property not found. retry in 1.17392597s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_28a08a69-cd1e-46f3-83b9-e52da0fd36e5
13752024-11-27T20:46:48.911ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_916dfff1-8c7a-4ee9-859d-b29aab2b839b") failed: Property not found. retry in 1.291757418s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_916dfff1-8c7a-4ee9-859d-b29aab2b839b
13762024-11-27T20:46:48.928ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1765ccc4-2c06-4c6d-ae19-b79c0f7578bc") failed: Property not found. retry in 1.428491668s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1765ccc4-2c06-4c6d-ae19-b79c0f7578bc
13772024-11-27T20:46:48.942ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_624b70de-5c05-41d7-9bc7-d6788785179f") failed: Property not found. retry in 1.428042013s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_624b70de-5c05-41d7-9bc7-d6788785179f
13782024-11-27T20:46:48.957ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_36882fd9-de52-45bb-ad54-8d8a7a8975d3") failed: Property not found. retry in 508.050871ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_36882fd9-de52-45bb-ad54-8d8a7a8975d3
13792024-11-27T20:46:48.978ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a687ab65-8cb5-438f-b716-9c6d0acfbb6d") failed: Property not found. retry in 1.321105709s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a687ab65-8cb5-438f-b716-9c6d0acfbb6d
13802024-11-27T20:46:48.993ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b620ee63-750b-4cff-b1e4-2bb3459911f2") failed: Property not found. retry in 1.195940708s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b620ee63-750b-4cff-b1e4-2bb3459911f2
13812024-11-27T20:46:49.102ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a189f197-7882-4220-a741-c3ab48d1538d") failed: Property not found. retry in 523.09467ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a189f197-7882-4220-a741-c3ab48d1538d
13822024-11-27T20:46:49.115ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_dea39fd9-f9ae-4cd4-a4be-75231f93c875") failed: Property not found. retry in 1.378991682s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_dea39fd9-f9ae-4cd4-a4be-75231f93c875
13832024-11-27T20:46:49.184ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fb7409be-e1e9-41dc-ba28-37cdd7b9c8d6") failed: Property not found. retry in 1.399209523s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fb7409be-e1e9-41dc-ba28-37cdd7b9c8d6
13842024-11-27T20:46:49.214ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d13b0217-c0a6-4eaa-8098-4068c753e7f8") failed: Property not found. retry in 944.099869ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d13b0217-c0a6-4eaa-8098-4068c753e7f8
13852024-11-27T20:46:49.225ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ef029baa-d573-494d-9698-1690c9c57399") failed: Property not found. retry in 1.160479951s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ef029baa-d573-494d-9698-1690c9c57399
13862024-11-27T20:46:49.278ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c3958fcf-f239-469b-9c1a-085eb2a46574") failed: Property not found. retry in 958.355527ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c3958fcf-f239-469b-9c1a-085eb2a46574
13872024-11-27T20:46:49.297ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3153c6ff-7972-4eff-961c-d5e1d29efabc") failed: Property not found. retry in 1.159687419s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3153c6ff-7972-4eff-961c-d5e1d29efabc
13882024-11-27T20:46:49.319ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_52f03443-0950-44b1-839a-35fd71795350") failed: Property not found. retry in 618.964757ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_52f03443-0950-44b1-839a-35fd71795350
13892024-11-27T20:46:49.481ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_36882fd9-de52-45bb-ad54-8d8a7a8975d3") failed: Property not found. retry in 502.762923ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_36882fd9-de52-45bb-ad54-8d8a7a8975d3
13902024-11-27T20:46:49.595ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e9e56728-efea-4219-afac-d4b3fc62d122") failed: Property not found. retry in 1.024961915s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e9e56728-efea-4219-afac-d4b3fc62d122
13912024-11-27T20:46:49.642ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a189f197-7882-4220-a741-c3ab48d1538d") failed: Property not found. retry in 1.098202195s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a189f197-7882-4220-a741-c3ab48d1538d
13922024-11-27T20:46:49.659ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ae973228-9cf8-450f-8ac4-7d740fc62ad6") failed: Property not found. retry in 876.631599ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ae973228-9cf8-450f-8ac4-7d740fc62ad6
13932024-11-27T20:46:49.948ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_52f03443-0950-44b1-839a-35fd71795350") failed: Property not found. retry in 985.799855ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_52f03443-0950-44b1-839a-35fd71795350
13942024-11-27T20:46:49.960ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_28a08a69-cd1e-46f3-83b9-e52da0fd36e5") failed: Property not found. retry in 878.689036ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_28a08a69-cd1e-46f3-83b9-e52da0fd36e5
13952024-11-27T20:46:49.995ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_36882fd9-de52-45bb-ad54-8d8a7a8975d3") failed: Property not found. retry in 1.409205065s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_36882fd9-de52-45bb-ad54-8d8a7a8975d3
13962024-11-27T20:46:50.104ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_77818842-4ce3-4fbc-b24e-bfe02c4a0922") failed: Property not found. retry in 559.004029ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_77818842-4ce3-4fbc-b24e-bfe02c4a0922
13972024-11-27T20:46:50.170ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d13b0217-c0a6-4eaa-8098-4068c753e7f8") failed: Property not found. retry in 778.148587ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d13b0217-c0a6-4eaa-8098-4068c753e7f8
13982024-11-27T20:46:50.207ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b620ee63-750b-4cff-b1e4-2bb3459911f2") failed: Property not found. retry in 747.174685ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b620ee63-750b-4cff-b1e4-2bb3459911f2
13992024-11-27T20:46:50.222ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_916dfff1-8c7a-4ee9-859d-b29aab2b839b") failed: Property not found. retry in 976.544641ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_916dfff1-8c7a-4ee9-859d-b29aab2b839b
14002024-11-27T20:46:50.267ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c3958fcf-f239-469b-9c1a-085eb2a46574") failed: Property not found. retry in 540.947417ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c3958fcf-f239-469b-9c1a-085eb2a46574
14012024-11-27T20:46:50.314ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a687ab65-8cb5-438f-b716-9c6d0acfbb6d") failed: Property not found. retry in 1.111232115s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a687ab65-8cb5-438f-b716-9c6d0acfbb6d
14022024-11-27T20:46:50.377ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1765ccc4-2c06-4c6d-ae19-b79c0f7578bc") failed: Property not found. retry in 965.59128ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1765ccc4-2c06-4c6d-ae19-b79c0f7578bc
14032024-11-27T20:46:50.410ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_624b70de-5c05-41d7-9bc7-d6788785179f") failed: Property not found. retry in 1.432987223s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_624b70de-5c05-41d7-9bc7-d6788785179f
14042024-11-27T20:46:50.425ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ef029baa-d573-494d-9698-1690c9c57399") failed: Property not found. retry in 1.088184791s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ef029baa-d573-494d-9698-1690c9c57399
14052024-11-27T20:46:50.472ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3153c6ff-7972-4eff-961c-d5e1d29efabc") failed: Property not found. retry in 1.335593219s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3153c6ff-7972-4eff-961c-d5e1d29efabc
14062024-11-27T20:46:50.510ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_dea39fd9-f9ae-4cd4-a4be-75231f93c875") failed: Property not found. retry in 1.327271523s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_dea39fd9-f9ae-4cd4-a4be-75231f93c875
14072024-11-27T20:46:50.552ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ae973228-9cf8-450f-8ac4-7d740fc62ad6") failed: Property not found. retry in 1.402668496s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ae973228-9cf8-450f-8ac4-7d740fc62ad6
14082024-11-27T20:46:50.599ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fb7409be-e1e9-41dc-ba28-37cdd7b9c8d6") failed: Property not found. retry in 1.085914217s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fb7409be-e1e9-41dc-ba28-37cdd7b9c8d6
14092024-11-27T20:46:50.634ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e9e56728-efea-4219-afac-d4b3fc62d122") failed: Property not found. retry in 915.570019ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e9e56728-efea-4219-afac-d4b3fc62d122
14102024-11-27T20:46:50.679ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_77818842-4ce3-4fbc-b24e-bfe02c4a0922") failed: Property not found. retry in 715.102926ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_77818842-4ce3-4fbc-b24e-bfe02c4a0922
14112024-11-27T20:46:50.752ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a189f197-7882-4220-a741-c3ab48d1538d") failed: Property not found. retry in 974.78777ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a189f197-7882-4220-a741-c3ab48d1538d
14122024-11-27T20:46:50.776ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_85b62460-1774-4b0f-80ef-e51e72587837: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin-single"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:8123'/> <propval type="astring" name="ch_binary" value='/opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14132024-11-27T20:46:50.777ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_85b62460-1774-4b0f-80ef-e51e72587837 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_clickhouse_85b62460-1774-4b0f-80ef-e51e72587837
14142024-11-27T20:46:50.822ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c3958fcf-f239-469b-9c1a-085eb2a46574") failed: Property not found. retry in 1.396624717s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c3958fcf-f239-469b-9c1a-085eb2a46574
14152024-11-27T20:46:50.851ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_28a08a69-cd1e-46f3-83b9-e52da0fd36e5") failed: Property not found. retry in 574.220583ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_28a08a69-cd1e-46f3-83b9-e52da0fd36e5
14162024-11-27T20:46:50.946ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_52f03443-0950-44b1-839a-35fd71795350") failed: Property not found. retry in 605.001161ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_52f03443-0950-44b1-839a-35fd71795350
14172024-11-27T20:46:50.962ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d13b0217-c0a6-4eaa-8098-4068c753e7f8") failed: Property not found. retry in 857.802291ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d13b0217-c0a6-4eaa-8098-4068c753e7f8
14182024-11-27T20:46:50.974ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b620ee63-750b-4cff-b1e4-2bb3459911f2") failed: Property not found. retry in 858.86926ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b620ee63-750b-4cff-b1e4-2bb3459911f2
14192024-11-27T20:46:51.034ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_85b62460-1774-4b0f-80ef-e51e72587837") failed: Property not found. retry in 36.473396ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_85b62460-1774-4b0f-80ef-e51e72587837
14202024-11-27T20:46:51.081ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_85b62460-1774-4b0f-80ef-e51e72587837") failed: Property not found. retry in 88.065322ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_85b62460-1774-4b0f-80ef-e51e72587837
14212024-11-27T20:46:51.432ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_85b62460-1774-4b0f-80ef-e51e72587837") failed: Property not found. retry in 175.653798ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_85b62460-1774-4b0f-80ef-e51e72587837
14222024-11-27T20:46:51.441ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1765ccc4-2c06-4c6d-ae19-b79c0f7578bc") failed: Property not found. retry in 936.877103ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1765ccc4-2c06-4c6d-ae19-b79c0f7578bc
14232024-11-27T20:46:51.451ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a687ab65-8cb5-438f-b716-9c6d0acfbb6d") failed: Property not found. retry in 1.209485653s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a687ab65-8cb5-438f-b716-9c6d0acfbb6d
14242024-11-27T20:46:51.460ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_77818842-4ce3-4fbc-b24e-bfe02c4a0922") failed: Property not found. retry in 839.791117ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_77818842-4ce3-4fbc-b24e-bfe02c4a0922
14252024-11-27T20:46:51.468ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_36882fd9-de52-45bb-ad54-8d8a7a8975d3") failed: Property not found. retry in 1.462152125s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_36882fd9-de52-45bb-ad54-8d8a7a8975d3
14262024-11-27T20:46:51.475ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_28a08a69-cd1e-46f3-83b9-e52da0fd36e5") failed: Property not found. retry in 685.28573ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_28a08a69-cd1e-46f3-83b9-e52da0fd36e5
14272024-11-27T20:46:51.483ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_916dfff1-8c7a-4ee9-859d-b29aab2b839b") failed: Property not found. retry in 1.362700669s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_916dfff1-8c7a-4ee9-859d-b29aab2b839b
14282024-11-27T20:46:51.523ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ef029baa-d573-494d-9698-1690c9c57399") failed: Property not found. retry in 1.482332978s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ef029baa-d573-494d-9698-1690c9c57399
14292024-11-27T20:46:51.558ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e9e56728-efea-4219-afac-d4b3fc62d122") failed: Property not found. retry in 1.439022661s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e9e56728-efea-4219-afac-d4b3fc62d122
14302024-11-27T20:46:51.567ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_52f03443-0950-44b1-839a-35fd71795350") failed: Property not found. retry in 1.381649595s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_52f03443-0950-44b1-839a-35fd71795350
14312024-11-27T20:46:51.617ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_85b62460-1774-4b0f-80ef-e51e72587837") failed: Property not found. retry in 496.978971ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_85b62460-1774-4b0f-80ef-e51e72587837
14322024-11-27T20:46:51.698ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fb7409be-e1e9-41dc-ba28-37cdd7b9c8d6") failed: Property not found. retry in 726.776954ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fb7409be-e1e9-41dc-ba28-37cdd7b9c8d6
14332024-11-27T20:46:51.740ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a189f197-7882-4220-a741-c3ab48d1538d") failed: Property not found. retry in 517.487009ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a189f197-7882-4220-a741-c3ab48d1538d
14342024-11-27T20:46:51.821ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3153c6ff-7972-4eff-961c-d5e1d29efabc") failed: Property not found. retry in 781.544303ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3153c6ff-7972-4eff-961c-d5e1d29efabc
14352024-11-27T20:46:51.834ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d13b0217-c0a6-4eaa-8098-4068c753e7f8") failed: Property not found. retry in 769.848263ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d13b0217-c0a6-4eaa-8098-4068c753e7f8
14362024-11-27T20:46:51.846ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b620ee63-750b-4cff-b1e4-2bb3459911f2") failed: Property not found. retry in 521.754704ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b620ee63-750b-4cff-b1e4-2bb3459911f2
14372024-11-27T20:46:51.858ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_dea39fd9-f9ae-4cd4-a4be-75231f93c875") failed: Property not found. retry in 1.358704569s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_dea39fd9-f9ae-4cd4-a4be-75231f93c875
14382024-11-27T20:46:51.868ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_624b70de-5c05-41d7-9bc7-d6788785179f") failed: Property not found. retry in 558.452177ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_624b70de-5c05-41d7-9bc7-d6788785179f
14392024-11-27T20:46:51.967ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ae973228-9cf8-450f-8ac4-7d740fc62ad6") failed: Property not found. retry in 740.505681ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ae973228-9cf8-450f-8ac4-7d740fc62ad6
14402024-11-27T20:46:52.126ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_85b62460-1774-4b0f-80ef-e51e72587837") failed: Property not found. retry in 946.817377ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_85b62460-1774-4b0f-80ef-e51e72587837
14412024-11-27T20:46:52.171ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_28a08a69-cd1e-46f3-83b9-e52da0fd36e5") failed: Property not found. retry in 641.29093ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_28a08a69-cd1e-46f3-83b9-e52da0fd36e5
14422024-11-27T20:46:52.229ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c3958fcf-f239-469b-9c1a-085eb2a46574") failed: Property not found. retry in 976.018662ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c3958fcf-f239-469b-9c1a-085eb2a46574
14432024-11-27T20:46:52.267ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a189f197-7882-4220-a741-c3ab48d1538d") failed: Property not found. retry in 587.22559ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a189f197-7882-4220-a741-c3ab48d1538d
14442024-11-27T20:46:52.309ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_77818842-4ce3-4fbc-b24e-bfe02c4a0922") failed: Property not found. retry in 1.253836544s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_77818842-4ce3-4fbc-b24e-bfe02c4a0922
14452024-11-27T20:46:52.380ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b620ee63-750b-4cff-b1e4-2bb3459911f2") failed: Property not found. retry in 1.0055974s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b620ee63-750b-4cff-b1e4-2bb3459911f2
14462024-11-27T20:46:52.389ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1765ccc4-2c06-4c6d-ae19-b79c0f7578bc") failed: Property not found. retry in 885.976549ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1765ccc4-2c06-4c6d-ae19-b79c0f7578bc
14472024-11-27T20:46:52.434ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fb7409be-e1e9-41dc-ba28-37cdd7b9c8d6") failed: Property not found. retry in 532.344637ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fb7409be-e1e9-41dc-ba28-37cdd7b9c8d6
14482024-11-27T20:46:52.443ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_624b70de-5c05-41d7-9bc7-d6788785179f") failed: Property not found. retry in 667.679797ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_624b70de-5c05-41d7-9bc7-d6788785179f
14492024-11-27T20:46:52.613ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3153c6ff-7972-4eff-961c-d5e1d29efabc") failed: Property not found. retry in 561.791207ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3153c6ff-7972-4eff-961c-d5e1d29efabc
14502024-11-27T20:46:52.620ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d13b0217-c0a6-4eaa-8098-4068c753e7f8") failed: Property not found. retry in 597.063283ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d13b0217-c0a6-4eaa-8098-4068c753e7f8
14512024-11-27T20:46:52.670ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a687ab65-8cb5-438f-b716-9c6d0acfbb6d") failed: Property not found. retry in 1.29265508s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a687ab65-8cb5-438f-b716-9c6d0acfbb6d
14522024-11-27T20:46:52.716ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ae973228-9cf8-450f-8ac4-7d740fc62ad6") failed: Property not found. retry in 812.853369ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ae973228-9cf8-450f-8ac4-7d740fc62ad6
14532024-11-27T20:46:52.822ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_28a08a69-cd1e-46f3-83b9-e52da0fd36e5") failed: Property not found. retry in 1.223307464s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_28a08a69-cd1e-46f3-83b9-e52da0fd36e5
14542024-11-27T20:46:52.855ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_916dfff1-8c7a-4ee9-859d-b29aab2b839b") failed: Property not found. retry in 1.138589587s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_916dfff1-8c7a-4ee9-859d-b29aab2b839b
14552024-11-27T20:46:52.863ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a189f197-7882-4220-a741-c3ab48d1538d") failed: Property not found. retry in 1.239258841s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a189f197-7882-4220-a741-c3ab48d1538d
14562024-11-27T20:46:52.938ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_36882fd9-de52-45bb-ad54-8d8a7a8975d3") failed: Property not found. retry in 1.088772773s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_36882fd9-de52-45bb-ad54-8d8a7a8975d3
14572024-11-27T20:46:52.957ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_52f03443-0950-44b1-839a-35fd71795350") failed: Property not found. retry in 736.652166ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_52f03443-0950-44b1-839a-35fd71795350
14582024-11-27T20:46:52.976ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fb7409be-e1e9-41dc-ba28-37cdd7b9c8d6") failed: Property not found. retry in 1.456169433s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fb7409be-e1e9-41dc-ba28-37cdd7b9c8d6
14592024-11-27T20:46:53.007ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e9e56728-efea-4219-afac-d4b3fc62d122") failed: Property not found. retry in 1.029751709s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e9e56728-efea-4219-afac-d4b3fc62d122
14602024-11-27T20:46:53.017ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ef029baa-d573-494d-9698-1690c9c57399") failed: Property not found. retry in 1.349876666s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ef029baa-d573-494d-9698-1690c9c57399
14612024-11-27T20:46:53.083ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_85b62460-1774-4b0f-80ef-e51e72587837") failed: Property not found. retry in 936.284735ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_85b62460-1774-4b0f-80ef-e51e72587837
14622024-11-27T20:46:53.120ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_624b70de-5c05-41d7-9bc7-d6788785179f") failed: Property not found. retry in 1.495241314s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_624b70de-5c05-41d7-9bc7-d6788785179f
14632024-11-27T20:46:53.184ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3153c6ff-7972-4eff-961c-d5e1d29efabc") failed: Property not found. retry in 1.437936318s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3153c6ff-7972-4eff-961c-d5e1d29efabc
14642024-11-27T20:46:53.214ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c3958fcf-f239-469b-9c1a-085eb2a46574") failed: Property not found. retry in 1.129896058s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c3958fcf-f239-469b-9c1a-085eb2a46574
14652024-11-27T20:46:53.226ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_dea39fd9-f9ae-4cd4-a4be-75231f93c875") failed: Property not found. retry in 561.306135ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_dea39fd9-f9ae-4cd4-a4be-75231f93c875
14662024-11-27T20:46:53.234ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d13b0217-c0a6-4eaa-8098-4068c753e7f8") failed: Property not found. retry in 1.44690847s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d13b0217-c0a6-4eaa-8098-4068c753e7f8
14672024-11-27T20:46:53.284ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1765ccc4-2c06-4c6d-ae19-b79c0f7578bc") failed: Property not found. retry in 1.117415899s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1765ccc4-2c06-4c6d-ae19-b79c0f7578bc
14682024-11-27T20:46:53.395ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b620ee63-750b-4cff-b1e4-2bb3459911f2") failed: Property not found. retry in 1.360845722s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b620ee63-750b-4cff-b1e4-2bb3459911f2
14692024-11-27T20:46:53.539ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ae973228-9cf8-450f-8ac4-7d740fc62ad6") failed: Property not found. retry in 876.681781ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ae973228-9cf8-450f-8ac4-7d740fc62ad6
14702024-11-27T20:46:53.572ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_77818842-4ce3-4fbc-b24e-bfe02c4a0922") failed: Property not found. retry in 1.457705648s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_77818842-4ce3-4fbc-b24e-bfe02c4a0922
14712024-11-27T20:46:53.704ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_52f03443-0950-44b1-839a-35fd71795350") failed: Property not found. retry in 1.413752001s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_52f03443-0950-44b1-839a-35fd71795350
14722024-11-27T20:46:53.798ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_dea39fd9-f9ae-4cd4-a4be-75231f93c875") failed: Property not found. retry in 1.121323181s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_dea39fd9-f9ae-4cd4-a4be-75231f93c875
14732024-11-27T20:46:53.972ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a687ab65-8cb5-438f-b716-9c6d0acfbb6d") failed: Property not found. retry in 714.696051ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a687ab65-8cb5-438f-b716-9c6d0acfbb6d
14742024-11-27T20:46:54.004ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_916dfff1-8c7a-4ee9-859d-b29aab2b839b") failed: Property not found. retry in 1.280641046s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_916dfff1-8c7a-4ee9-859d-b29aab2b839b
14752024-11-27T20:46:54.030ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_85b62460-1774-4b0f-80ef-e51e72587837") failed: Property not found. retry in 747.191909ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_85b62460-1774-4b0f-80ef-e51e72587837
14762024-11-27T20:46:54.044ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_36882fd9-de52-45bb-ad54-8d8a7a8975d3") failed: Property not found. retry in 1.163333935s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_36882fd9-de52-45bb-ad54-8d8a7a8975d3
14772024-11-27T20:46:54.060ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e9e56728-efea-4219-afac-d4b3fc62d122") failed: Property not found. retry in 1.167542287s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e9e56728-efea-4219-afac-d4b3fc62d122
14782024-11-27T20:46:54.084ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_28a08a69-cd1e-46f3-83b9-e52da0fd36e5") failed: Property not found. retry in 1.440364185s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_28a08a69-cd1e-46f3-83b9-e52da0fd36e5
14792024-11-27T20:46:54.117ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a189f197-7882-4220-a741-c3ab48d1538d") failed: Property not found. retry in 547.981166ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a189f197-7882-4220-a741-c3ab48d1538d
14802024-11-27T20:46:54.355ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c3958fcf-f239-469b-9c1a-085eb2a46574") failed: Property not found. retry in 1.234842826s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c3958fcf-f239-469b-9c1a-085eb2a46574
14812024-11-27T20:46:54.377ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ef029baa-d573-494d-9698-1690c9c57399") failed: Property not found. retry in 1.234129764s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ef029baa-d573-494d-9698-1690c9c57399
14822024-11-27T20:46:54.412ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1765ccc4-2c06-4c6d-ae19-b79c0f7578bc") failed: Property not found. retry in 1.297705825s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1765ccc4-2c06-4c6d-ae19-b79c0f7578bc
14832024-11-27T20:46:54.428ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ae973228-9cf8-450f-8ac4-7d740fc62ad6") failed: Property not found. retry in 1.250219355s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ae973228-9cf8-450f-8ac4-7d740fc62ad6
14842024-11-27T20:46:54.444ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fb7409be-e1e9-41dc-ba28-37cdd7b9c8d6") failed: Property not found. retry in 569.832132ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fb7409be-e1e9-41dc-ba28-37cdd7b9c8d6
14852024-11-27T20:46:54.632ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_624b70de-5c05-41d7-9bc7-d6788785179f") failed: Property not found. retry in 1.440141338s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_624b70de-5c05-41d7-9bc7-d6788785179f
14862024-11-27T20:46:54.646ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3153c6ff-7972-4eff-961c-d5e1d29efabc") failed: Property not found. retry in 816.380244ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3153c6ff-7972-4eff-961c-d5e1d29efabc
14872024-11-27T20:46:54.680ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a189f197-7882-4220-a741-c3ab48d1538d") failed: Property not found. retry in 1.051295927s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a189f197-7882-4220-a741-c3ab48d1538d
14882024-11-27T20:46:54.695ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d13b0217-c0a6-4eaa-8098-4068c753e7f8") failed: Property not found. retry in 1.018951279s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d13b0217-c0a6-4eaa-8098-4068c753e7f8
14892024-11-27T20:46:54.706ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a687ab65-8cb5-438f-b716-9c6d0acfbb6d") failed: Property not found. retry in 749.0114ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a687ab65-8cb5-438f-b716-9c6d0acfbb6d
14902024-11-27T20:46:54.769ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b620ee63-750b-4cff-b1e4-2bb3459911f2") failed: Property not found. retry in 1.370954887s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b620ee63-750b-4cff-b1e4-2bb3459911f2
14912024-11-27T20:46:54.793ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_85b62460-1774-4b0f-80ef-e51e72587837") failed: Property not found. retry in 633.121565ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_85b62460-1774-4b0f-80ef-e51e72587837
14922024-11-27T20:46:54.936ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_dea39fd9-f9ae-4cd4-a4be-75231f93c875") failed: Property not found. retry in 1.289577042s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_dea39fd9-f9ae-4cd4-a4be-75231f93c875
14932024-11-27T20:46:55.030ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fb7409be-e1e9-41dc-ba28-37cdd7b9c8d6") failed: Property not found. retry in 1.429958432s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fb7409be-e1e9-41dc-ba28-37cdd7b9c8d6
14942024-11-27T20:46:55.043ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_77818842-4ce3-4fbc-b24e-bfe02c4a0922") failed: Property not found. retry in 546.269282ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_77818842-4ce3-4fbc-b24e-bfe02c4a0922
14952024-11-27T20:46:55.132ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_52f03443-0950-44b1-839a-35fd71795350") failed: Property not found. retry in 971.898612ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_52f03443-0950-44b1-839a-35fd71795350
14962024-11-27T20:46:55.222ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_36882fd9-de52-45bb-ad54-8d8a7a8975d3") failed: Property not found. retry in 605.423063ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_36882fd9-de52-45bb-ad54-8d8a7a8975d3
14972024-11-27T20:46:55.243ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e9e56728-efea-4219-afac-d4b3fc62d122") failed: Property not found. retry in 853.026567ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e9e56728-efea-4219-afac-d4b3fc62d122
14982024-11-27T20:46:55.299ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_916dfff1-8c7a-4ee9-859d-b29aab2b839b") failed: Property not found. retry in 526.101178ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_916dfff1-8c7a-4ee9-859d-b29aab2b839b
14992024-11-27T20:46:55.440ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_85b62460-1774-4b0f-80ef-e51e72587837") failed: Property not found. retry in 1.210586775s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_85b62460-1774-4b0f-80ef-e51e72587837
15002024-11-27T20:46:55.469ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a687ab65-8cb5-438f-b716-9c6d0acfbb6d") failed: Property not found. retry in 530.518383ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a687ab65-8cb5-438f-b716-9c6d0acfbb6d
15012024-11-27T20:46:55.482ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3153c6ff-7972-4eff-961c-d5e1d29efabc") failed: Property not found. retry in 1.285217162s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3153c6ff-7972-4eff-961c-d5e1d29efabc
15022024-11-27T20:46:55.536ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_28a08a69-cd1e-46f3-83b9-e52da0fd36e5") failed: Property not found. retry in 1.258998514s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_28a08a69-cd1e-46f3-83b9-e52da0fd36e5
15032024-11-27T20:46:55.602ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c3958fcf-f239-469b-9c1a-085eb2a46574") failed: Property not found. retry in 1.136924785s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c3958fcf-f239-469b-9c1a-085eb2a46574
15042024-11-27T20:46:55.613ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_77818842-4ce3-4fbc-b24e-bfe02c4a0922") failed: Property not found. retry in 887.047865ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_77818842-4ce3-4fbc-b24e-bfe02c4a0922
15052024-11-27T20:46:55.626ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ef029baa-d573-494d-9698-1690c9c57399") failed: Property not found. retry in 1.47091123s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ef029baa-d573-494d-9698-1690c9c57399
15062024-11-27T20:46:55.690ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ae973228-9cf8-450f-8ac4-7d740fc62ad6") failed: Property not found. retry in 1.307046127s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ae973228-9cf8-450f-8ac4-7d740fc62ad6
15072024-11-27T20:46:55.724ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1765ccc4-2c06-4c6d-ae19-b79c0f7578bc") failed: Property not found. retry in 894.19147ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1765ccc4-2c06-4c6d-ae19-b79c0f7578bc
15082024-11-27T20:46:55.739ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d13b0217-c0a6-4eaa-8098-4068c753e7f8") failed: Property not found. retry in 978.498575ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d13b0217-c0a6-4eaa-8098-4068c753e7f8
15092024-11-27T20:46:55.752ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a189f197-7882-4220-a741-c3ab48d1538d") failed: Property not found. retry in 545.903176ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a189f197-7882-4220-a741-c3ab48d1538d
15102024-11-27T20:46:55.840ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_916dfff1-8c7a-4ee9-859d-b29aab2b839b") failed: Property not found. retry in 1.232842858s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_916dfff1-8c7a-4ee9-859d-b29aab2b839b
15112024-11-27T20:46:55.856ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_36882fd9-de52-45bb-ad54-8d8a7a8975d3") failed: Property not found. retry in 658.817648ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_36882fd9-de52-45bb-ad54-8d8a7a8975d3
15122024-11-27T20:46:56.019ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a687ab65-8cb5-438f-b716-9c6d0acfbb6d") failed: Property not found. retry in 1.496014298s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a687ab65-8cb5-438f-b716-9c6d0acfbb6d
15132024-11-27T20:46:56.087ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_624b70de-5c05-41d7-9bc7-d6788785179f") failed: Property not found. retry in 820.114065ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_624b70de-5c05-41d7-9bc7-d6788785179f
15142024-11-27T20:46:56.109ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e9e56728-efea-4219-afac-d4b3fc62d122") failed: Property not found. retry in 694.852114ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e9e56728-efea-4219-afac-d4b3fc62d122
15152024-11-27T20:46:56.120ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_52f03443-0950-44b1-839a-35fd71795350") failed: Property not found. retry in 1.005517091s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_52f03443-0950-44b1-839a-35fd71795350
15162024-11-27T20:46:56.152ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b620ee63-750b-4cff-b1e4-2bb3459911f2") failed: Property not found. retry in 763.563256ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b620ee63-750b-4cff-b1e4-2bb3459911f2
15172024-11-27T20:46:56.235ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_dea39fd9-f9ae-4cd4-a4be-75231f93c875") failed: Property not found. retry in 758.796137ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_dea39fd9-f9ae-4cd4-a4be-75231f93c875
15182024-11-27T20:46:56.308ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a189f197-7882-4220-a741-c3ab48d1538d") failed: Property not found. retry in 597.629374ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a189f197-7882-4220-a741-c3ab48d1538d
15192024-11-27T20:46:56.469ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fb7409be-e1e9-41dc-ba28-37cdd7b9c8d6") failed: Property not found. retry in 1.22289173s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fb7409be-e1e9-41dc-ba28-37cdd7b9c8d6
15202024-11-27T20:46:56.509ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_77818842-4ce3-4fbc-b24e-bfe02c4a0922") failed: Property not found. retry in 1.235928319s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_77818842-4ce3-4fbc-b24e-bfe02c4a0922
15212024-11-27T20:46:56.522ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_36882fd9-de52-45bb-ad54-8d8a7a8975d3") failed: Property not found. retry in 816.18145ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_36882fd9-de52-45bb-ad54-8d8a7a8975d3
15222024-11-27T20:46:56.627ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1765ccc4-2c06-4c6d-ae19-b79c0f7578bc") failed: Property not found. retry in 775.992253ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1765ccc4-2c06-4c6d-ae19-b79c0f7578bc
15232024-11-27T20:46:56.659ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_85b62460-1774-4b0f-80ef-e51e72587837") failed: Property not found. retry in 825.385032ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_85b62460-1774-4b0f-80ef-e51e72587837
15242024-11-27T20:46:56.727ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d13b0217-c0a6-4eaa-8098-4068c753e7f8") failed: Property not found. retry in 1.342912422s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d13b0217-c0a6-4eaa-8098-4068c753e7f8
15252024-11-27T20:46:56.749ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c3958fcf-f239-469b-9c1a-085eb2a46574") failed: Property not found. retry in 1.443617751s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c3958fcf-f239-469b-9c1a-085eb2a46574
15262024-11-27T20:46:56.778ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3153c6ff-7972-4eff-961c-d5e1d29efabc") failed: Property not found. retry in 785.502399ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3153c6ff-7972-4eff-961c-d5e1d29efabc
15272024-11-27T20:46:56.803ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_28a08a69-cd1e-46f3-83b9-e52da0fd36e5") failed: Property not found. retry in 571.628508ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_28a08a69-cd1e-46f3-83b9-e52da0fd36e5
15282024-11-27T20:46:56.812ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e9e56728-efea-4219-afac-d4b3fc62d122") failed: Property not found. retry in 1.096919646s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e9e56728-efea-4219-afac-d4b3fc62d122
15292024-11-27T20:46:56.915ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a189f197-7882-4220-a741-c3ab48d1538d") failed: Property not found. retry in 874.295794ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a189f197-7882-4220-a741-c3ab48d1538d
15302024-11-27T20:46:56.927ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_624b70de-5c05-41d7-9bc7-d6788785179f") failed: Property not found. retry in 632.727893ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_624b70de-5c05-41d7-9bc7-d6788785179f
15312024-11-27T20:46:56.936ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b620ee63-750b-4cff-b1e4-2bb3459911f2") failed: Property not found. retry in 878.710455ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b620ee63-750b-4cff-b1e4-2bb3459911f2
15322024-11-27T20:46:57.005ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_dea39fd9-f9ae-4cd4-a4be-75231f93c875") failed: Property not found. retry in 562.640605ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_dea39fd9-f9ae-4cd4-a4be-75231f93c875
15332024-11-27T20:46:57.014ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ae973228-9cf8-450f-8ac4-7d740fc62ad6") failed: Property not found. retry in 945.53526ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ae973228-9cf8-450f-8ac4-7d740fc62ad6
15342024-11-27T20:46:57.084ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_916dfff1-8c7a-4ee9-859d-b29aab2b839b") failed: Property not found. retry in 802.463575ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_916dfff1-8c7a-4ee9-859d-b29aab2b839b
15352024-11-27T20:46:57.107ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ef029baa-d573-494d-9698-1690c9c57399") failed: Property not found. retry in 1.279170846s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ef029baa-d573-494d-9698-1690c9c57399
15362024-11-27T20:46:57.135ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_52f03443-0950-44b1-839a-35fd71795350") failed: Property not found. retry in 1.196030562s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_52f03443-0950-44b1-839a-35fd71795350
15372024-11-27T20:46:57.349ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_36882fd9-de52-45bb-ad54-8d8a7a8975d3") failed: Property not found. retry in 856.637377ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_36882fd9-de52-45bb-ad54-8d8a7a8975d3
15382024-11-27T20:46:57.385ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_28a08a69-cd1e-46f3-83b9-e52da0fd36e5") failed: Property not found. retry in 554.662604ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_28a08a69-cd1e-46f3-83b9-e52da0fd36e5
15392024-11-27T20:46:57.412ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1765ccc4-2c06-4c6d-ae19-b79c0f7578bc") failed: Property not found. retry in 794.710311ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1765ccc4-2c06-4c6d-ae19-b79c0f7578bc
15402024-11-27T20:46:57.494ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_85b62460-1774-4b0f-80ef-e51e72587837") failed: Property not found. retry in 895.764724ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_85b62460-1774-4b0f-80ef-e51e72587837
15412024-11-27T20:46:57.523ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a687ab65-8cb5-438f-b716-9c6d0acfbb6d") failed: Property not found. retry in 1.352300654s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a687ab65-8cb5-438f-b716-9c6d0acfbb6d
15422024-11-27T20:46:57.570ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_624b70de-5c05-41d7-9bc7-d6788785179f") failed: Property not found. retry in 1.433386277s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_624b70de-5c05-41d7-9bc7-d6788785179f
15432024-11-27T20:46:57.579ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3153c6ff-7972-4eff-961c-d5e1d29efabc") failed: Property not found. retry in 834.47335ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3153c6ff-7972-4eff-961c-d5e1d29efabc
15442024-11-27T20:46:57.588ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_dea39fd9-f9ae-4cd4-a4be-75231f93c875") failed: Property not found. retry in 744.766628ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_dea39fd9-f9ae-4cd4-a4be-75231f93c875
15452024-11-27T20:46:57.702ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fb7409be-e1e9-41dc-ba28-37cdd7b9c8d6") failed: Property not found. retry in 1.43297822s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fb7409be-e1e9-41dc-ba28-37cdd7b9c8d6
15462024-11-27T20:46:57.753ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_77818842-4ce3-4fbc-b24e-bfe02c4a0922") failed: Property not found. retry in 1.475286625s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_77818842-4ce3-4fbc-b24e-bfe02c4a0922
15472024-11-27T20:46:57.799ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a189f197-7882-4220-a741-c3ab48d1538d") failed: Property not found. retry in 1.128722495s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a189f197-7882-4220-a741-c3ab48d1538d
15482024-11-27T20:46:57.823ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b620ee63-750b-4cff-b1e4-2bb3459911f2") failed: Property not found. retry in 1.274198702s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b620ee63-750b-4cff-b1e4-2bb3459911f2
15492024-11-27T20:46:57.896ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_916dfff1-8c7a-4ee9-859d-b29aab2b839b") failed: Property not found. retry in 507.462238ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_916dfff1-8c7a-4ee9-859d-b29aab2b839b
15502024-11-27T20:46:57.918ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e9e56728-efea-4219-afac-d4b3fc62d122") failed: Property not found. retry in 613.780003ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e9e56728-efea-4219-afac-d4b3fc62d122
15512024-11-27T20:46:57.949ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_28a08a69-cd1e-46f3-83b9-e52da0fd36e5") failed: Property not found. retry in 625.967658ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_28a08a69-cd1e-46f3-83b9-e52da0fd36e5
15522024-11-27T20:46:57.968ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ae973228-9cf8-450f-8ac4-7d740fc62ad6") failed: Property not found. retry in 1.474355264s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ae973228-9cf8-450f-8ac4-7d740fc62ad6
15532024-11-27T20:46:58.080ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d13b0217-c0a6-4eaa-8098-4068c753e7f8") failed: Property not found. retry in 935.977149ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d13b0217-c0a6-4eaa-8098-4068c753e7f8
15542024-11-27T20:46:58.203ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c3958fcf-f239-469b-9c1a-085eb2a46574") failed: Property not found. retry in 1.227896906s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c3958fcf-f239-469b-9c1a-085eb2a46574
15552024-11-27T20:46:58.215ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1765ccc4-2c06-4c6d-ae19-b79c0f7578bc") failed: Property not found. retry in 1.005282149s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1765ccc4-2c06-4c6d-ae19-b79c0f7578bc
15562024-11-27T20:46:58.223ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_36882fd9-de52-45bb-ad54-8d8a7a8975d3") failed: Property not found. retry in 1.109945686s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_36882fd9-de52-45bb-ad54-8d8a7a8975d3
15572024-11-27T20:46:58.341ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_52f03443-0950-44b1-839a-35fd71795350") failed: Property not found. retry in 1.372371299s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_52f03443-0950-44b1-839a-35fd71795350
15582024-11-27T20:46:58.349ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_dea39fd9-f9ae-4cd4-a4be-75231f93c875") failed: Property not found. retry in 735.135361ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_dea39fd9-f9ae-4cd4-a4be-75231f93c875
15592024-11-27T20:46:58.396ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ef029baa-d573-494d-9698-1690c9c57399") failed: Property not found. retry in 1.222299547s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ef029baa-d573-494d-9698-1690c9c57399
15602024-11-27T20:46:58.404ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_85b62460-1774-4b0f-80ef-e51e72587837") failed: Property not found. retry in 709.072576ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_85b62460-1774-4b0f-80ef-e51e72587837
15612024-11-27T20:46:58.412ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_916dfff1-8c7a-4ee9-859d-b29aab2b839b") failed: Property not found. retry in 784.883528ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_916dfff1-8c7a-4ee9-859d-b29aab2b839b
15622024-11-27T20:46:58.423ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3153c6ff-7972-4eff-961c-d5e1d29efabc") failed: Property not found. retry in 555.086726ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3153c6ff-7972-4eff-961c-d5e1d29efabc
15632024-11-27T20:46:58.542ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e9e56728-efea-4219-afac-d4b3fc62d122") failed: Property not found. retry in 639.925754ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e9e56728-efea-4219-afac-d4b3fc62d122
15642024-11-27T20:46:58.583ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_28a08a69-cd1e-46f3-83b9-e52da0fd36e5") failed: Property not found. retry in 886.016602ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_28a08a69-cd1e-46f3-83b9-e52da0fd36e5
15652024-11-27T20:46:58.886ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a687ab65-8cb5-438f-b716-9c6d0acfbb6d") failed: Property not found. retry in 999.337898ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a687ab65-8cb5-438f-b716-9c6d0acfbb6d
15662024-11-27T20:46:58.937ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a189f197-7882-4220-a741-c3ab48d1538d") failed: Property not found. retry in 1.035016605s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a189f197-7882-4220-a741-c3ab48d1538d
15672024-11-27T20:46:58.989ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3153c6ff-7972-4eff-961c-d5e1d29efabc") failed: Property not found. retry in 501.277533ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3153c6ff-7972-4eff-961c-d5e1d29efabc
15682024-11-27T20:46:59.014ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_624b70de-5c05-41d7-9bc7-d6788785179f") failed: Property not found. retry in 886.445986ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_624b70de-5c05-41d7-9bc7-d6788785179f
15692024-11-27T20:46:59.025ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d13b0217-c0a6-4eaa-8098-4068c753e7f8") failed: Property not found. retry in 600.46884ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d13b0217-c0a6-4eaa-8098-4068c753e7f8
15702024-11-27T20:46:59.093ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_dea39fd9-f9ae-4cd4-a4be-75231f93c875") failed: Property not found. retry in 665.432342ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_dea39fd9-f9ae-4cd4-a4be-75231f93c875
15712024-11-27T20:46:59.106ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b620ee63-750b-4cff-b1e4-2bb3459911f2") failed: Property not found. retry in 567.083283ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b620ee63-750b-4cff-b1e4-2bb3459911f2
15722024-11-27T20:46:59.122ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_85b62460-1774-4b0f-80ef-e51e72587837") failed: Property not found. retry in 1.232112591s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_85b62460-1774-4b0f-80ef-e51e72587837
15732024-11-27T20:46:59.144ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fb7409be-e1e9-41dc-ba28-37cdd7b9c8d6") failed: Property not found. retry in 1.466410102s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fb7409be-e1e9-41dc-ba28-37cdd7b9c8d6
15742024-11-27T20:46:59.190ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e9e56728-efea-4219-afac-d4b3fc62d122") failed: Property not found. retry in 709.220377ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e9e56728-efea-4219-afac-d4b3fc62d122
15752024-11-27T20:46:59.204ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_916dfff1-8c7a-4ee9-859d-b29aab2b839b") failed: Property not found. retry in 1.064422662s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_916dfff1-8c7a-4ee9-859d-b29aab2b839b
15762024-11-27T20:46:59.229ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1765ccc4-2c06-4c6d-ae19-b79c0f7578bc") failed: Property not found. retry in 1.246152005s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1765ccc4-2c06-4c6d-ae19-b79c0f7578bc
15772024-11-27T20:46:59.236ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_77818842-4ce3-4fbc-b24e-bfe02c4a0922") failed: Property not found. retry in 735.464674ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_77818842-4ce3-4fbc-b24e-bfe02c4a0922
15782024-11-27T20:46:59.342ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_36882fd9-de52-45bb-ad54-8d8a7a8975d3") failed: Property not found. retry in 1.15839264s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_36882fd9-de52-45bb-ad54-8d8a7a8975d3
15792024-11-27T20:46:59.441ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c3958fcf-f239-469b-9c1a-085eb2a46574") failed: Property not found. retry in 1.016594269s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c3958fcf-f239-469b-9c1a-085eb2a46574
15802024-11-27T20:46:59.451ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ae973228-9cf8-450f-8ac4-7d740fc62ad6") failed: Property not found. retry in 1.199135557s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ae973228-9cf8-450f-8ac4-7d740fc62ad6
15812024-11-27T20:46:59.479ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_28a08a69-cd1e-46f3-83b9-e52da0fd36e5") failed: Property not found. retry in 1.046350454s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_28a08a69-cd1e-46f3-83b9-e52da0fd36e5
15822024-11-27T20:46:59.499ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3153c6ff-7972-4eff-961c-d5e1d29efabc") failed: Property not found. retry in 1.188587487s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3153c6ff-7972-4eff-961c-d5e1d29efabc
15832024-11-27T20:46:59.631ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ef029baa-d573-494d-9698-1690c9c57399") failed: Property not found. retry in 601.926208ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ef029baa-d573-494d-9698-1690c9c57399
15842024-11-27T20:46:59.639ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d13b0217-c0a6-4eaa-8098-4068c753e7f8") failed: Property not found. retry in 581.999995ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d13b0217-c0a6-4eaa-8098-4068c753e7f8
15852024-11-27T20:46:59.682ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b620ee63-750b-4cff-b1e4-2bb3459911f2") failed: Property not found. retry in 867.242702ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b620ee63-750b-4cff-b1e4-2bb3459911f2
15862024-11-27T20:46:59.722ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_52f03443-0950-44b1-839a-35fd71795350") failed: Property not found. retry in 593.91919ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_52f03443-0950-44b1-839a-35fd71795350
15872024-11-27T20:46:59.767ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_dea39fd9-f9ae-4cd4-a4be-75231f93c875") failed: Property not found. retry in 656.361233ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_dea39fd9-f9ae-4cd4-a4be-75231f93c875
15882024-11-27T20:46:59.897ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a687ab65-8cb5-438f-b716-9c6d0acfbb6d") failed: Property not found. retry in 1.028342892s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a687ab65-8cb5-438f-b716-9c6d0acfbb6d
15892024-11-27T20:46:59.908ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e9e56728-efea-4219-afac-d4b3fc62d122") failed: Property not found. retry in 567.846925ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e9e56728-efea-4219-afac-d4b3fc62d122
15902024-11-27T20:46:59.915ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_624b70de-5c05-41d7-9bc7-d6788785179f") failed: Property not found. retry in 1.291592064s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_624b70de-5c05-41d7-9bc7-d6788785179f
15912024-11-27T20:46:59.981ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a189f197-7882-4220-a741-c3ab48d1538d") failed: Property not found. retry in 1.493594547s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a189f197-7882-4220-a741-c3ab48d1538d
15922024-11-27T20:46:59.989ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_77818842-4ce3-4fbc-b24e-bfe02c4a0922") failed: Property not found. retry in 768.267774ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_77818842-4ce3-4fbc-b24e-bfe02c4a0922
15932024-11-27T20:47:00.131ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 6.117334953s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e
15942024-11-27T20:47:00.233ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d13b0217-c0a6-4eaa-8098-4068c753e7f8") failed: Property not found. retry in 523.978994ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d13b0217-c0a6-4eaa-8098-4068c753e7f8
15952024-11-27T20:47:00.242ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ef029baa-d573-494d-9698-1690c9c57399") failed: Property not found. retry in 1.443693087s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ef029baa-d573-494d-9698-1690c9c57399
15962024-11-27T20:47:00.279ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_916dfff1-8c7a-4ee9-859d-b29aab2b839b") failed: Property not found. retry in 952.792987ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_916dfff1-8c7a-4ee9-859d-b29aab2b839b
15972024-11-27T20:47:00.325ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_52f03443-0950-44b1-839a-35fd71795350") failed: Property not found. retry in 613.999917ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_52f03443-0950-44b1-839a-35fd71795350
15982024-11-27T20:47:00.363ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_85b62460-1774-4b0f-80ef-e51e72587837") failed: Property not found. retry in 1.004863749s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_85b62460-1774-4b0f-80ef-e51e72587837
15992024-11-27T20:47:00.434ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_dea39fd9-f9ae-4cd4-a4be-75231f93c875") failed: Property not found. retry in 1.075369388s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_dea39fd9-f9ae-4cd4-a4be-75231f93c875
16002024-11-27T20:47:00.467ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c3958fcf-f239-469b-9c1a-085eb2a46574") failed: Property not found. retry in 960.324384ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c3958fcf-f239-469b-9c1a-085eb2a46574
16012024-11-27T20:47:00.485ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1765ccc4-2c06-4c6d-ae19-b79c0f7578bc") failed: Property not found. retry in 1.324077032s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1765ccc4-2c06-4c6d-ae19-b79c0f7578bc
16022024-11-27T20:47:00.493ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e9e56728-efea-4219-afac-d4b3fc62d122") failed: Property not found. retry in 647.878267ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e9e56728-efea-4219-afac-d4b3fc62d122
16032024-11-27T20:47:00.510ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_36882fd9-de52-45bb-ad54-8d8a7a8975d3") failed: Property not found. retry in 1.250233392s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_36882fd9-de52-45bb-ad54-8d8a7a8975d3
16042024-11-27T20:47:00.534ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_28a08a69-cd1e-46f3-83b9-e52da0fd36e5") failed: Property not found. retry in 993.911987ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_28a08a69-cd1e-46f3-83b9-e52da0fd36e5
16052024-11-27T20:47:00.559ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b620ee63-750b-4cff-b1e4-2bb3459911f2") failed: Property not found. retry in 815.35863ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b620ee63-750b-4cff-b1e4-2bb3459911f2
16062024-11-27T20:47:00.619ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fb7409be-e1e9-41dc-ba28-37cdd7b9c8d6") failed: Property not found. retry in 985.240276ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fb7409be-e1e9-41dc-ba28-37cdd7b9c8d6
16072024-11-27T20:47:00.660ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ae973228-9cf8-450f-8ac4-7d740fc62ad6") failed: Property not found. retry in 614.553209ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ae973228-9cf8-450f-8ac4-7d740fc62ad6
16082024-11-27T20:47:00.696ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3153c6ff-7972-4eff-961c-d5e1d29efabc") failed: Property not found. retry in 803.604865ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3153c6ff-7972-4eff-961c-d5e1d29efabc
16092024-11-27T20:47:00.766ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d13b0217-c0a6-4eaa-8098-4068c753e7f8") failed: Property not found. retry in 957.881186ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d13b0217-c0a6-4eaa-8098-4068c753e7f8
16102024-11-27T20:47:00.773ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_77818842-4ce3-4fbc-b24e-bfe02c4a0922") failed: Property not found. retry in 704.298176ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_77818842-4ce3-4fbc-b24e-bfe02c4a0922
16112024-11-27T20:47:00.933ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a687ab65-8cb5-438f-b716-9c6d0acfbb6d") failed: Property not found. retry in 710.641598ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a687ab65-8cb5-438f-b716-9c6d0acfbb6d
16122024-11-27T20:47:00.948ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_52f03443-0950-44b1-839a-35fd71795350") failed: Property not found. retry in 566.580501ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_52f03443-0950-44b1-839a-35fd71795350
16132024-11-27T20:47:01.152ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e9e56728-efea-4219-afac-d4b3fc62d122") failed: Property not found. retry in 740.823939ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e9e56728-efea-4219-afac-d4b3fc62d122
16142024-11-27T20:47:01.218ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_624b70de-5c05-41d7-9bc7-d6788785179f") failed: Property not found. retry in 1.491004963s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_624b70de-5c05-41d7-9bc7-d6788785179f
16152024-11-27T20:47:01.241ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_916dfff1-8c7a-4ee9-859d-b29aab2b839b") failed: Property not found. retry in 934.518023ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_916dfff1-8c7a-4ee9-859d-b29aab2b839b
16162024-11-27T20:47:01.286ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ae973228-9cf8-450f-8ac4-7d740fc62ad6") failed: Property not found. retry in 796.717807ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ae973228-9cf8-450f-8ac4-7d740fc62ad6
16172024-11-27T20:47:01.378ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_85b62460-1774-4b0f-80ef-e51e72587837") failed: Property not found. retry in 733.486961ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_85b62460-1774-4b0f-80ef-e51e72587837
16182024-11-27T20:47:01.387ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b620ee63-750b-4cff-b1e4-2bb3459911f2") failed: Property not found. retry in 1.152497485s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b620ee63-750b-4cff-b1e4-2bb3459911f2
16192024-11-27T20:47:01.485ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a189f197-7882-4220-a741-c3ab48d1538d") failed: Property not found. retry in 709.525931ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a189f197-7882-4220-a741-c3ab48d1538d
16202024-11-27T20:47:01.494ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_77818842-4ce3-4fbc-b24e-bfe02c4a0922") failed: Property not found. retry in 1.268360553s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_77818842-4ce3-4fbc-b24e-bfe02c4a0922
16212024-11-27T20:47:01.508ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3153c6ff-7972-4eff-961c-d5e1d29efabc") failed: Property not found. retry in 887.081653ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3153c6ff-7972-4eff-961c-d5e1d29efabc
16222024-11-27T20:47:01.517ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_dea39fd9-f9ae-4cd4-a4be-75231f93c875") failed: Property not found. retry in 1.047176098s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_dea39fd9-f9ae-4cd4-a4be-75231f93c875
16232024-11-27T20:47:01.527ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_52f03443-0950-44b1-839a-35fd71795350") failed: Property not found. retry in 1.104611882s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_52f03443-0950-44b1-839a-35fd71795350
16242024-11-27T20:47:01.540ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_28a08a69-cd1e-46f3-83b9-e52da0fd36e5") failed: Property not found. retry in 505.559428ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_28a08a69-cd1e-46f3-83b9-e52da0fd36e5
16252024-11-27T20:47:01.654ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a687ab65-8cb5-438f-b716-9c6d0acfbb6d") failed: Property not found. retry in 846.543457ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a687ab65-8cb5-438f-b716-9c6d0acfbb6d
16262024-11-27T20:47:01.696ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ef029baa-d573-494d-9698-1690c9c57399") failed: Property not found. retry in 1.379418842s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ef029baa-d573-494d-9698-1690c9c57399
16272024-11-27T20:47:01.902ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e9e56728-efea-4219-afac-d4b3fc62d122") failed: Property not found. retry in 1.227187765s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e9e56728-efea-4219-afac-d4b3fc62d122
16282024-11-27T20:47:02.092ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ae973228-9cf8-450f-8ac4-7d740fc62ad6") failed: Property not found. retry in 847.795143ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ae973228-9cf8-450f-8ac4-7d740fc62ad6
16292024-11-27T20:47:02.121ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_85b62460-1774-4b0f-80ef-e51e72587837") failed: Property not found. retry in 989.703342ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_85b62460-1774-4b0f-80ef-e51e72587837
16302024-11-27T20:47:02.205ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a189f197-7882-4220-a741-c3ab48d1538d") failed: Property not found. retry in 891.612816ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a189f197-7882-4220-a741-c3ab48d1538d
16312024-11-27T20:47:03.140ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_85b62460-1774-4b0f-80ef-e51e72587837") failed: Property not found. retry in 1.055485865s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_85b62460-1774-4b0f-80ef-e51e72587837
16322024-11-27T20:47:04.218ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_85b62460-1774-4b0f-80ef-e51e72587837") failed: Property not found. retry in 1.068108186s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_85b62460-1774-4b0f-80ef-e51e72587837
16332024-11-27T20:47:05.331ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_pantry_28a08a69-cd1e-46f3-83b9-e52da0fd36e5
16342024-11-27T20:47:05.331ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_external_dns_d13b0217-c0a6-4eaa-8098-4068c753e7f8
16352024-11-27T20:47:05.331ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_external_dns_ef029baa-d573-494d-9698-1690c9c57399
16362024-11-27T20:47:05.331ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_e9e56728-efea-4219-afac-d4b3fc62d122
16372024-11-27T20:47:05.331ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_52f03443-0950-44b1-839a-35fd71795350
16382024-11-27T20:47:05.331ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_3153c6ff-7972-4eff-961c-d5e1d29efabc
16392024-11-27T20:47:05.331ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_nexus_fb7409be-e1e9-41dc-ba28-37cdd7b9c8d6
16402024-11-27T20:47:05.331ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_pantry_916dfff1-8c7a-4ee9-859d-b29aab2b839b
16412024-11-27T20:47:05.331ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_nexus_ae973228-9cf8-450f-8ac4-7d740fc62ad6
16422024-11-27T20:47:05.331ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_pantry_c3958fcf-f239-469b-9c1a-085eb2a46574
16432024-11-27T20:47:05.331ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_oximeter_dea39fd9-f9ae-4cd4-a4be-75231f93c875
16442024-11-27T20:47:05.331ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_clickhouse_85b62460-1774-4b0f-80ef-e51e72587837
16452024-11-27T20:47:05.331ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_a189f197-7882-4220-a741-c3ab48d1538d
16462024-11-27T20:47:05.331ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_624b70de-5c05-41d7-9bc7-d6788785179f
16472024-11-27T20:47:05.331ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_b620ee63-750b-4cff-b1e4-2bb3459911f2
16482024-11-27T20:47:05.331ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_1765ccc4-2c06-4c6d-ae19-b79c0f7578bc
16492024-11-27T20:47:05.331ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_a687ab65-8cb5-438f-b716-9c6d0acfbb6d
16502024-11-27T20:47:05.332ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_nexus_77818842-4ce3-4fbc-b24e-bfe02c4a0922
16512024-11-27T20:47:05.332ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_36882fd9-de52-45bb-ad54-8d8a7a8975d3
16522024-11-27T20:47:05.334ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/71828714-15a3-4f82-918a-cbabee4531fa/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
16532024-11-27T20:47:05.337ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/f58570a3-13b1-4b0c-ac0c-e8a0652f7ced/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
16542024-11-27T20:47:05.347ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39340289 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:64977 req_id = bc277817-99eb-498e-b007-bf69b83ff7e0 response_code = 204 uri = /omicron-zones
16552024-11-27T20:47:05.359ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1435
16562024-11-27T20:47:05.360ZINFOSledAgent (RSS): Writing ledger to /pool/int/71828714-15a3-4f82-918a-cbabee4531fa/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
16572024-11-27T20:47:05.361ZINFOSledAgent (RSS): Writing ledger to /pool/int/f58570a3-13b1-4b0c-ac0c-e8a0652f7ced/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
16582024-11-27T20:47:05.553ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:774
16592024-11-27T20:47:05.561ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::b]:12221 file = sled-agent/src/rack_setup/service.rs:786
16602024-11-27T20:47:05.612ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, rib_priority: None, vlan_id: None, }, ], switch: Switch0, tx_eq: None, uplink_port_fec: Some( None, ), uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:1000
16612024-11-27T20:47:05.951ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/0f7812c1-7dc7-4ef4-bd3e-c3ab0830f824/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1062
16622024-11-27T20:47:06.075ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/0f7812c1-7dc7-4ef4-bd3e-c3ab0830f824/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1062
16632024-11-27T20:47:06.349ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/0f7812c1-7dc7-4ef4-bd3e-c3ab0830f824/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1062
16642024-11-27T20:47:06.350ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 23.933243589s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e
16652024-11-27T20:47:06.527ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/0f7812c1-7dc7-4ef4-bd3e-c3ab0830f824/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1062
16662024-11-27T20:47:06.631ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/0f7812c1-7dc7-4ef4-bd3e-c3ab0830f824/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1062
16672024-11-27T20:47:06.907ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/0f7812c1-7dc7-4ef4-bd3e-c3ab0830f824/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1062
16682024-11-27T20:47:07.229ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/0f7812c1-7dc7-4ef4-bd3e-c3ab0830f824/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1062
16692024-11-27T20:47:07.393ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/0f7812c1-7dc7-4ef4-bd3e-c3ab0830f824/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1062
16702024-11-27T20:47:07.712ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/0f7812c1-7dc7-4ef4-bd3e-c3ab0830f824/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1062
16712024-11-27T20:47:08.202ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/0f7812c1-7dc7-4ef4-bd3e-c3ab0830f824/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1062
16722024-11-27T20:47:08.716ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:51159
16732024-11-27T20:47:08.716ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:51159 req_id = fa5bce8b-4907-4834-904a-9fe3e710664f response_code = 200 uri = /baseboard
16742024-11-27T20:47:08.726ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/0f7812c1-7dc7-4ef4-bd3e-c3ab0830f824/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1062
16752024-11-27T20:47:09.308ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/0f7812c1-7dc7-4ef4-bd3e-c3ab0830f824/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1062
16762024-11-27T20:47:09.751ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/0f7812c1-7dc7-4ef4-bd3e-c3ab0830f824/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1062
16772024-11-27T20:47:12.413ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 403 Forbidden; headers: {"content-type": "application/json", "x-request-id": "c47da4c9-42eb-4cc7-a9ed-52521027e4ef", "content-length": "113", "date": "Wed, 27 Nov 2024 20:47:11 GMT"}; value: Error { error_code: Some("Forbidden"), message: "Forbidden", request_id: "c47da4c9-42eb-4cc7-a9ed-52521027e4ef" } file = sled-agent/src/rack_setup/service.rs:1062
16782024-11-27T20:47:14.944ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "1dc96039-c587-42dc-9887-9902d3ce22f2", "content-length": "173", "date": "Wed, 27 Nov 2024 20:47:14 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"0f7812c1-7dc7-4ef4-bd3e-c3ab0830f824\"", request_id: "1dc96039-c587-42dc-9887-9902d3ce22f2" } file = sled-agent/src/rack_setup/service.rs:1062
16792024-11-27T20:47:18.936ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "ff1e3125-495c-4fcc-a7d1-dc6da47b0a96", "content-length": "173", "date": "Wed, 27 Nov 2024 20:47:18 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"0f17ab63-f38a-412f-a653-029795d7304e\"", request_id: "ff1e3125-495c-4fcc-a7d1-dc6da47b0a96" } file = sled-agent/src/rack_setup/service.rs:1062
16802024-11-27T20:47:21.306ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "25f23dff-e5cf-4d3b-b6fd-df4b1c6501eb", "content-length": "173", "date": "Wed, 27 Nov 2024 20:47:21 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"0f17ab63-f38a-412f-a653-029795d7304e\"", request_id: "25f23dff-e5cf-4d3b-b6fd-df4b1c6501eb" } file = sled-agent/src/rack_setup/service.rs:1062
16812024-11-27T20:47:24.433ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "701a4fcc-6b99-4a60-930e-e5ecb8439a9d", "content-length": "173", "date": "Wed, 27 Nov 2024 20:47:23 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"0f17ab63-f38a-412f-a653-029795d7304e\"", request_id: "701a4fcc-6b99-4a60-930e-e5ecb8439a9d" } file = sled-agent/src/rack_setup/service.rs:1062
16822024-11-27T20:47:26.171ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "3ebe6dc7-6171-48c1-bbd9-702d6a3ea59b", "content-length": "173", "date": "Wed, 27 Nov 2024 20:47:26 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"0f17ab63-f38a-412f-a653-029795d7304e\"", request_id: "3ebe6dc7-6171-48c1-bbd9-702d6a3ea59b" } file = sled-agent/src/rack_setup/service.rs:1062
16832024-11-27T20:47:28.037ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "7db99d39-71bb-455a-8ca6-7c8d72a0dde0", "content-length": "173", "date": "Wed, 27 Nov 2024 20:47:27 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"0f17ab63-f38a-412f-a653-029795d7304e\"", request_id: "7db99d39-71bb-455a-8ca6-7c8d72a0dde0" } file = sled-agent/src/rack_setup/service.rs:1062
16842024-11-27T20:47:30.467ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "328014cb-0bf5-47d8-8493-498bb1addc88", "content-length": "173", "date": "Wed, 27 Nov 2024 20:47:30 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"0f17ab63-f38a-412f-a653-029795d7304e\"", request_id: "328014cb-0bf5-47d8-8493-498bb1addc88" } file = sled-agent/src/rack_setup/service.rs:1062
16852024-11-27T20:47:33.869ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:500 new_generation = 1 old_generation = 1 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e
16862024-11-27T20:47:33.963ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34598
16872024-11-27T20:47:33.965ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
16882024-11-27T20:47:33.966ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
16892024-11-27T20:47:33.966ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/71828714-15a3-4f82-918a-cbabee4531fa/config/omicron-zones.json file = common/src/ledger.rs:177
16902024-11-27T20:47:33.975ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/f58570a3-13b1-4b0c-ac0c-e8a0652f7ced/config/omicron-zones.json file = common/src/ledger.rs:177
16912024-11-27T20:47:33.987ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ff99775c-fb56-419e-aef8-9c8117494384 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16922024-11-27T20:47:33.987ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_ff99775c-fb56-419e-aef8-9c8117494384
16932024-11-27T20:47:34.013ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 54375e11-a569-4c64-8c24-c6dfba089c32 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16942024-11-27T20:47:34.014ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_54375e11-a569-4c64-8c24-c6dfba089c32
16952024-11-27T20:47:34.037ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a7344162-b09f-4fab-9022-409ee4ca9964 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16962024-11-27T20:47:34.037ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_a7344162-b09f-4fab-9022-409ee4ca9964
16972024-11-27T20:47:34.062ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 37e32039-a8dd-4947-8c19-c28ef6335cf2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16982024-11-27T20:47:34.062ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_37e32039-a8dd-4947-8c19-c28ef6335cf2
16992024-11-27T20:47:34.088ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c3225150-4706-46cb-9890-c4e173582acb (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17002024-11-27T20:47:34.088ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_c3225150-4706-46cb-9890-c4e173582acb
17012024-11-27T20:47:34.112ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4393a6b4-1740-4ce1-b6df-2d78fb8128b9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17022024-11-27T20:47:34.112ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_4393a6b4-1740-4ce1-b6df-2d78fb8128b9
17032024-11-27T20:47:34.132ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: bd1e9859-f391-4410-ac6a-94d84a761bf8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17042024-11-27T20:47:34.132ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_bd1e9859-f391-4410-ac6a-94d84a761bf8
17052024-11-27T20:47:34.155ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f94a6d1b-9178-4c13-817f-a77b6a6cd97e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17062024-11-27T20:47:34.155ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_f94a6d1b-9178-4c13-817f-a77b6a6cd97e
17072024-11-27T20:47:34.175ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 0b66aa68-555b-43d3-99fd-94013fc7fb74 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17082024-11-27T20:47:34.175ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_0b66aa68-555b-43d3-99fd-94013fc7fb74
17092024-11-27T20:47:34.188ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 223613 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34598 req_id = dcf98172-253a-4063-a5ac-a69ad74b924c response_code = 200 uri = /inventory
17102024-11-27T20:47:35.641ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56130
17112024-11-27T20:47:35.646ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 81c35812-3316-445b-a6f6-3aa12cbc0141, kind: Service { id: d13b0217-c0a6-4eaa-8098-4068c753e7f8 }, name: Name("external-dns-d13b0217-c0a6-4eaa-8098-4068c753e7f8"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 26])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8c3b27b2-7f68-49b4-b3f3-4525d795f2c5, kind: Service { id: ef029baa-d573-494d-9698-1690c9c57399 }, name: Name("external-dns-ef029baa-d573-494d-9698-1690c9c57399"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 142, 128])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 07c10885-dd61-4583-8ce1-a7179a48d3fa, kind: Service { id: 77818842-4ce3-4fbc-b24e-bfe02c4a0922 }, name: Name("nexus-77818842-4ce3-4fbc-b24e-bfe02c4a0922"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 187, 182])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7ec37840-3b01-4078-b834-03dbd8adf8dd, kind: Service { id: fb7409be-e1e9-41dc-ba28-37cdd7b9c8d6 }, name: Name("nexus-fb7409be-e1e9-41dc-ba28-37cdd7b9c8d6"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 220])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b9a4498e-d802-4925-8101-8f18c4e4f305, kind: Service { id: ae973228-9cf8-450f-8ac4-7d740fc62ad6 }, name: Name("nexus-ae973228-9cf8-450f-8ac4-7d740fc62ad6"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 168, 190])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17122024-11-27T20:47:35.646ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17132024-11-27T20:47:35.646ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17142024-11-27T20:47:35.646ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17152024-11-27T20:47:35.646ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17162024-11-27T20:47:35.646ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17172024-11-27T20:47:35.646ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
17182024-11-27T20:47:35.646ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4692 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56130 req_id = becc41a1-4f7c-45ec-a367-bdfa0c2706b3 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17192024-11-27T20:47:35.648ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:1072
17202024-11-27T20:47:35.928ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36362
17212024-11-27T20:47:35.928ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
17222024-11-27T20:47:35.928ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
17232024-11-27T20:47:35.928ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/71828714-15a3-4f82-918a-cbabee4531fa/config/omicron-zones.json file = common/src/ledger.rs:177
17242024-11-27T20:47:35.929ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/f58570a3-13b1-4b0c-ac0c-e8a0652f7ced/config/omicron-zones.json file = common/src/ledger.rs:177
17252024-11-27T20:47:35.942ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ff99775c-fb56-419e-aef8-9c8117494384 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17262024-11-27T20:47:35.942ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_ff99775c-fb56-419e-aef8-9c8117494384
17272024-11-27T20:47:35.967ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 54375e11-a569-4c64-8c24-c6dfba089c32 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17282024-11-27T20:47:35.967ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_54375e11-a569-4c64-8c24-c6dfba089c32
17292024-11-27T20:47:35.992ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a7344162-b09f-4fab-9022-409ee4ca9964 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17302024-11-27T20:47:35.993ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_a7344162-b09f-4fab-9022-409ee4ca9964
17312024-11-27T20:47:36.018ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 37e32039-a8dd-4947-8c19-c28ef6335cf2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17322024-11-27T20:47:36.018ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_37e32039-a8dd-4947-8c19-c28ef6335cf2
17332024-11-27T20:47:36.046ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c3225150-4706-46cb-9890-c4e173582acb (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17342024-11-27T20:47:36.046ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_c3225150-4706-46cb-9890-c4e173582acb
17352024-11-27T20:47:36.069ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4393a6b4-1740-4ce1-b6df-2d78fb8128b9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17362024-11-27T20:47:36.069ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_4393a6b4-1740-4ce1-b6df-2d78fb8128b9
17372024-11-27T20:47:36.081ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50503
17382024-11-27T20:47:36.085ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 81c35812-3316-445b-a6f6-3aa12cbc0141, kind: Service { id: d13b0217-c0a6-4eaa-8098-4068c753e7f8 }, name: Name("external-dns-d13b0217-c0a6-4eaa-8098-4068c753e7f8"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 26])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8c3b27b2-7f68-49b4-b3f3-4525d795f2c5, kind: Service { id: ef029baa-d573-494d-9698-1690c9c57399 }, name: Name("external-dns-ef029baa-d573-494d-9698-1690c9c57399"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 142, 128])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 07c10885-dd61-4583-8ce1-a7179a48d3fa, kind: Service { id: 77818842-4ce3-4fbc-b24e-bfe02c4a0922 }, name: Name("nexus-77818842-4ce3-4fbc-b24e-bfe02c4a0922"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 187, 182])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7ec37840-3b01-4078-b834-03dbd8adf8dd, kind: Service { id: fb7409be-e1e9-41dc-ba28-37cdd7b9c8d6 }, name: Name("nexus-fb7409be-e1e9-41dc-ba28-37cdd7b9c8d6"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 220])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b9a4498e-d802-4925-8101-8f18c4e4f305, kind: Service { id: ae973228-9cf8-450f-8ac4-7d740fc62ad6 }, name: Name("nexus-ae973228-9cf8-450f-8ac4-7d740fc62ad6"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 168, 190])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17392024-11-27T20:47:36.085ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17402024-11-27T20:47:36.085ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17412024-11-27T20:47:36.085ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17422024-11-27T20:47:36.085ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17432024-11-27T20:47:36.085ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17442024-11-27T20:47:36.085ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
17452024-11-27T20:47:36.085ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 670 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50503 req_id = 5c785032-adb1-41cf-a83b-8764664edcf0 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17462024-11-27T20:47:36.091ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: bd1e9859-f391-4410-ac6a-94d84a761bf8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17472024-11-27T20:47:36.091ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_bd1e9859-f391-4410-ac6a-94d84a761bf8
17482024-11-27T20:47:36.113ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f94a6d1b-9178-4c13-817f-a77b6a6cd97e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17492024-11-27T20:47:36.113ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_f94a6d1b-9178-4c13-817f-a77b6a6cd97e
17502024-11-27T20:47:36.134ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 0b66aa68-555b-43d3-99fd-94013fc7fb74 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17512024-11-27T20:47:36.134ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_0b66aa68-555b-43d3-99fd-94013fc7fb74
17522024-11-27T20:47:36.146ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 217952 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36362 req_id = 610600d8-f87e-4e70-91b3-992dfec68738 response_code = 200 uri = /inventory
17532024-11-27T20:47:37.193ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36968
17542024-11-27T20:47:37.194ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 81c35812-3316-445b-a6f6-3aa12cbc0141, kind: Service { id: d13b0217-c0a6-4eaa-8098-4068c753e7f8 }, name: Name("external-dns-d13b0217-c0a6-4eaa-8098-4068c753e7f8"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 26])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8c3b27b2-7f68-49b4-b3f3-4525d795f2c5, kind: Service { id: ef029baa-d573-494d-9698-1690c9c57399 }, name: Name("external-dns-ef029baa-d573-494d-9698-1690c9c57399"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 142, 128])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 07c10885-dd61-4583-8ce1-a7179a48d3fa, kind: Service { id: 77818842-4ce3-4fbc-b24e-bfe02c4a0922 }, name: Name("nexus-77818842-4ce3-4fbc-b24e-bfe02c4a0922"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 187, 182])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7ec37840-3b01-4078-b834-03dbd8adf8dd, kind: Service { id: fb7409be-e1e9-41dc-ba28-37cdd7b9c8d6 }, name: Name("nexus-fb7409be-e1e9-41dc-ba28-37cdd7b9c8d6"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 220])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b9a4498e-d802-4925-8101-8f18c4e4f305, kind: Service { id: ae973228-9cf8-450f-8ac4-7d740fc62ad6 }, name: Name("nexus-ae973228-9cf8-450f-8ac4-7d740fc62ad6"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 168, 190])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17552024-11-27T20:47:37.194ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17562024-11-27T20:47:37.194ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17572024-11-27T20:47:37.194ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17582024-11-27T20:47:37.194ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17592024-11-27T20:47:37.194ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17602024-11-27T20:47:37.194ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
17612024-11-27T20:47:37.194ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 327 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36968 req_id = a865835e-5f30-4fbf-87a4-3bdb74a78558 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17622024-11-27T20:47:37.246ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39558
17632024-11-27T20:47:37.246ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 81c35812-3316-445b-a6f6-3aa12cbc0141, kind: Service { id: d13b0217-c0a6-4eaa-8098-4068c753e7f8 }, name: Name("external-dns-d13b0217-c0a6-4eaa-8098-4068c753e7f8"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 26])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8c3b27b2-7f68-49b4-b3f3-4525d795f2c5, kind: Service { id: ef029baa-d573-494d-9698-1690c9c57399 }, name: Name("external-dns-ef029baa-d573-494d-9698-1690c9c57399"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 142, 128])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 07c10885-dd61-4583-8ce1-a7179a48d3fa, kind: Service { id: 77818842-4ce3-4fbc-b24e-bfe02c4a0922 }, name: Name("nexus-77818842-4ce3-4fbc-b24e-bfe02c4a0922"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 187, 182])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7ec37840-3b01-4078-b834-03dbd8adf8dd, kind: Service { id: fb7409be-e1e9-41dc-ba28-37cdd7b9c8d6 }, name: Name("nexus-fb7409be-e1e9-41dc-ba28-37cdd7b9c8d6"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 220])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b9a4498e-d802-4925-8101-8f18c4e4f305, kind: Service { id: ae973228-9cf8-450f-8ac4-7d740fc62ad6 }, name: Name("nexus-ae973228-9cf8-450f-8ac4-7d740fc62ad6"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 168, 190])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17642024-11-27T20:47:37.246ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17652024-11-27T20:47:37.246ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17662024-11-27T20:47:37.246ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17672024-11-27T20:47:37.246ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17682024-11-27T20:47:37.246ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17692024-11-27T20:47:37.246ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
17702024-11-27T20:47:37.246ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 272 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39558 req_id = b19ccee5-e8fd-4303-ae65-7e01d3a617b6 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17712024-11-27T20:47:38.753ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:32840
17722024-11-27T20:47:38.754ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:32840 req_id = ba292eab-b4c9-4289-9d1b-ac8acbf9e7c2 response_code = 200 uri = /baseboard
17732024-11-27T20:47:41.668ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:35289 remote_addr = [fd00:1122:3344:101::d]:63096 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e
17742024-11-27T20:47:41.705ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36425 local_addr = [fd00:1122:3344:101::1]:35289 method = GET remote_addr = [fd00:1122:3344:101::d]:63096 req_id = 5c40ccdf-850d-4bad-b1f9-046ddd8be773 response_code = 200 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e uri = /0f17ab63-f38a-412f-a653-029795d7304e
17752024-11-27T20:47:43.211ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50586
17762024-11-27T20:47:43.212ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1052 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50586 req_id = 9ce68393-b179-4527-a385-e1948a69dcd6 response_code = 200 uri = /vpc-routes
17772024-11-27T20:47:43.310ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e values = ExternalIpGatewayMap { mappings: {} }
17782024-11-27T20:47:43.310ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2082 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50586 req_id = 6922af60-2552-4b7f-93e3-fa8e81bd30ab response_code = 204 uri = /eip-gateways
17792024-11-27T20:47:43.406ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4455 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50586 req_id = 1cd593f8-39df-48fb-a34e-74a12b9b30a8 response_code = 204 uri = /vpc-routes
17802024-11-27T20:47:45.106ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49009
17812024-11-27T20:47:45.106ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49009 req_id = ffbfdef7-b5b9-44d4-b327-526b5b9afbb5 response_code = 200 uri = /vpc-routes
17822024-11-27T20:47:45.225ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e values = ExternalIpGatewayMap { mappings: {} }
17832024-11-27T20:47:45.225ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49009 req_id = 1e17a088-98cf-48af-9aa2-81ff17b10986 response_code = 204 uri = /eip-gateways
17842024-11-27T20:47:45.240ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 237 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49009 req_id = 7f05d934-ca0e-4f40-97d0-f8310e6dc263 response_code = 204 uri = /vpc-routes
17852024-11-27T20:47:45.357ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55305
17862024-11-27T20:47:45.358ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1635 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55305 req_id = d89f7b54-2911-4142-b991-51652384b076 response_code = 200 uri = /v2p
17872024-11-27T20:47:45.576ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52941
17882024-11-27T20:47:45.577ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
17892024-11-27T20:47:45.682ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
17902024-11-27T20:47:45.748ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 172007 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:52941 req_id = 7cf092f8-0d33-40b9-9ee1-96702d8f33e3 response_code = 204 uri = /switch-ports
17912024-11-27T20:47:45.748ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52941 req_id = 7575c640-2c7b-4a34-8951-bca33658479f response_code = 200 uri = /network-bootstore-config
17922024-11-27T20:47:45.831ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
17932024-11-27T20:47:45.831ZINFOSledAgent (bootstore): Writing ledger to /pool/int/71828714-15a3-4f82-918a-cbabee4531fa/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
17942024-11-27T20:47:45.833ZINFOSledAgent (bootstore): Writing ledger to /pool/int/f58570a3-13b1-4b0c-ac0c-e8a0652f7ced/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
17952024-11-27T20:47:45.833ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
17962024-11-27T20:47:45.833ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4217 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52941 req_id = 2a6dfc46-24a4-4952-823c-ae2929000b75 response_code = 204 uri = /network-bootstore-config
17972024-11-27T20:47:46.637ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61909
17982024-11-27T20:47:46.637ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61909 req_id = b80ba864-fc41-4428-a032-6d6a1571a01f response_code = 200 uri = /vpc-routes
17992024-11-27T20:47:46.662ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e values = ExternalIpGatewayMap { mappings: {} }
18002024-11-27T20:47:46.662ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61909 req_id = f5ef2dd6-574b-4044-ad0d-1ed19a7a5e7c response_code = 204 uri = /eip-gateways
18012024-11-27T20:47:46.758ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35663
18022024-11-27T20:47:46.758ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35663 req_id = 55a4339e-5ad1-4941-a0a0-242077204491 response_code = 200 uri = /v2p
18032024-11-27T20:47:46.766ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 220 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61909 req_id = f60568c8-c763-40f0-8f3e-1027bc4a2796 response_code = 204 uri = /vpc-routes
18042024-11-27T20:47:46.836ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48357
18052024-11-27T20:47:46.836ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
18062024-11-27T20:47:46.878ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
18072024-11-27T20:47:46.940ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104501 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48357 req_id = b529e528-84ac-4441-af7e-0b09b1fc3302 response_code = 204 uri = /switch-ports
18082024-11-27T20:47:46.941ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48357 req_id = 450b4551-4fad-4f98-a9b0-fa4585ba087c response_code = 200 uri = /network-bootstore-config
18092024-11-27T20:47:47.376ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48275
18102024-11-27T20:47:47.376ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48275 req_id = bb1c8368-f7b5-495b-9e57-438bcae5c1f7 response_code = 200 uri = /vpc-routes
18112024-11-27T20:47:47.446ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e values = ExternalIpGatewayMap { mappings: {} }
18122024-11-27T20:47:47.446ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48275 req_id = 8dac71e7-6574-4955-ad86-fbe97f21d82c response_code = 204 uri = /eip-gateways
18132024-11-27T20:47:47.450ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53630
18142024-11-27T20:47:47.450ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53630 req_id = 4e342d72-e1df-4bc9-bf71-7975c4f9b7f8 response_code = 200 uri = /v2p
18152024-11-27T20:47:47.460ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 313 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48275 req_id = b4e46501-a9b0-4f43-9f1e-685ff5ed053b response_code = 204 uri = /vpc-routes
18162024-11-27T20:47:47.678ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36844
18172024-11-27T20:47:47.678ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
18182024-11-27T20:47:47.716ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
18192024-11-27T20:47:47.773ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95067 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:36844 req_id = 9733c90d-9f4f-4cc6-b287-9d2ae032c153 response_code = 204 uri = /switch-ports
18202024-11-27T20:47:47.774ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36844 req_id = 1d3e4a30-5571-41aa-ba57-d6a00a44a15a response_code = 200 uri = /network-bootstore-config
18212024-11-27T20:48:08.791ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:41310
18222024-11-27T20:48:08.791ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:41310 req_id = 00a7764d-a9a8-4c18-8aa6-321b439a4f38 response_code = 200 uri = /baseboard
18232024-11-27T20:48:11.475ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6965 local_addr = [fd00:1122:3344:101::1]:35289 method = GET remote_addr = [fd00:1122:3344:101::d]:63096 req_id = c4a8b6e8-1db5-4706-b4bf-e4486a9abba1 response_code = 200 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e uri = /0f17ab63-f38a-412f-a653-029795d7304e
18242024-11-27T20:48:15.203ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38062
18252024-11-27T20:48:15.203ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38062 req_id = 014205e1-0c12-42e0-b422-f76f6b817e95 response_code = 200 uri = /vpc-routes
18262024-11-27T20:48:15.262ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e values = ExternalIpGatewayMap { mappings: {} }
18272024-11-27T20:48:15.262ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38062 req_id = 65b5c094-9235-4802-9a5c-e33711b1edb7 response_code = 204 uri = /eip-gateways
18282024-11-27T20:48:15.288ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 261 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38062 req_id = 8f015863-90e3-4a28-8091-24c469faa9f3 response_code = 204 uri = /vpc-routes
18292024-11-27T20:48:15.445ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57328
18302024-11-27T20:48:15.445ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57328 req_id = 77258812-9160-43d4-882d-ccd0f15240a4 response_code = 200 uri = /v2p
18312024-11-27T20:48:15.447ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57887
18322024-11-27T20:48:15.447ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
18332024-11-27T20:48:15.487ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
18342024-11-27T20:48:15.544ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97319 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:57887 req_id = 479dfb72-ad93-4545-846e-44b60b5b927e response_code = 204 uri = /switch-ports
18352024-11-27T20:48:15.544ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57887 req_id = 7f64e2ec-8d59-4700-97ce-ff2bb0881f03 response_code = 200 uri = /network-bootstore-config
18362024-11-27T20:48:16.643ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65239
18372024-11-27T20:48:16.643ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65239 req_id = c73bee46-4f74-4d44-9556-d76ff3f7ba39 response_code = 200 uri = /vpc-routes
18382024-11-27T20:48:16.701ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e values = ExternalIpGatewayMap { mappings: {} }
18392024-11-27T20:48:16.701ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:65239 req_id = 8b662d9d-ed4f-4abd-8b65-5c7afc454582 response_code = 204 uri = /eip-gateways
18402024-11-27T20:48:16.711ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 203 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:65239 req_id = 19dc779c-b248-41a2-b432-3ccd2aa2e6f4 response_code = 204 uri = /vpc-routes
18412024-11-27T20:48:16.818ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41929
18422024-11-27T20:48:16.818ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
18432024-11-27T20:48:16.864ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
18442024-11-27T20:48:16.930ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111750 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:41929 req_id = c9a3cfa0-e41b-4173-bd47-bd2c53403670 response_code = 204 uri = /switch-ports
18452024-11-27T20:48:16.930ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62449
18462024-11-27T20:48:16.930ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62449 req_id = ce3a2053-93f6-4775-8292-3ff6ea06300e response_code = 200 uri = /v2p
18472024-11-27T20:48:16.931ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41929 req_id = 06485838-9d25-440f-b7b6-b1f254e65b8b response_code = 200 uri = /network-bootstore-config
18482024-11-27T20:48:17.371ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44057
18492024-11-27T20:48:17.371ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44057 req_id = 6fcc1d25-891b-40ea-b540-8eb6fb3c0d7d response_code = 200 uri = /vpc-routes
18502024-11-27T20:48:17.442ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e values = ExternalIpGatewayMap { mappings: {} }
18512024-11-27T20:48:17.442ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44057 req_id = ac01a4e5-75f0-4067-ba09-cadae53c550b response_code = 204 uri = /eip-gateways
18522024-11-27T20:48:17.454ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 295 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44057 req_id = a4556b75-4588-432a-805f-4b575b0c95c1 response_code = 204 uri = /vpc-routes
18532024-11-27T20:48:17.591ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38529
18542024-11-27T20:48:17.591ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38529 req_id = c61c0dab-1f66-43b9-a329-ef196f7fab3b response_code = 200 uri = /v2p
18552024-11-27T20:48:17.724ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46261
18562024-11-27T20:48:17.724ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
18572024-11-27T20:48:17.765ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
18582024-11-27T20:48:17.826ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101839 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:46261 req_id = 71e19aea-667a-4767-9857-75f0a2fc8518 response_code = 204 uri = /switch-ports
18592024-11-27T20:48:17.826ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46261 req_id = 7add81ee-d0cc-4e73-9cd6-a2142d267f68 response_code = 200 uri = /network-bootstore-config
18602024-11-27T20:48:38.824ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:47394
18612024-11-27T20:48:38.825ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:47394 req_id = 5d18fcfd-e509-43f5-b9a7-58361269d778 response_code = 200 uri = /baseboard
18622024-11-27T20:48:41.478ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8215 local_addr = [fd00:1122:3344:101::1]:35289 method = GET remote_addr = [fd00:1122:3344:101::d]:63096 req_id = 84625495-7057-4952-bf15-59b0a25c1512 response_code = 200 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e uri = /0f17ab63-f38a-412f-a653-029795d7304e
18632024-11-27T20:48:45.250ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64169
18642024-11-27T20:48:45.250ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64169 req_id = b0d2ba58-5b02-46e2-ac52-4e5fee2d9d96 response_code = 200 uri = /vpc-routes
18652024-11-27T20:48:45.256ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65475
18662024-11-27T20:48:45.256ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
18672024-11-27T20:48:45.297ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
18682024-11-27T20:48:45.365ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108689 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:65475 req_id = 5519916c-22c2-4be0-8d55-45bdfa7c51e8 response_code = 204 uri = /switch-ports
18692024-11-27T20:48:45.365ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e values = ExternalIpGatewayMap { mappings: {} }
18702024-11-27T20:48:45.365ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64169 req_id = ff047599-750c-4422-b6c9-c0740993a460 response_code = 204 uri = /eip-gateways
18712024-11-27T20:48:45.365ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 234 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65475 req_id = d5456e33-2508-4559-8477-8786a193500d response_code = 200 uri = /network-bootstore-config
18722024-11-27T20:48:45.377ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 222 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64169 req_id = 97bfbb4a-95cf-436e-8d17-a4d8660d68ad response_code = 204 uri = /vpc-routes
18732024-11-27T20:48:45.617ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45413
18742024-11-27T20:48:45.617ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45413 req_id = 61653326-6267-47be-8497-cb47a85752e7 response_code = 200 uri = /v2p
18752024-11-27T20:48:46.616ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62234
18762024-11-27T20:48:46.617ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62234 req_id = e0d9b1ef-9026-4d75-9bfc-4931782b533a response_code = 200 uri = /vpc-routes
18772024-11-27T20:48:46.633ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e values = ExternalIpGatewayMap { mappings: {} }
18782024-11-27T20:48:46.634ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62234 req_id = bbbef99d-861a-4803-8231-07a624eefccd response_code = 204 uri = /eip-gateways
18792024-11-27T20:48:46.642ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 222 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62234 req_id = 82e993fd-1cfe-407f-bc72-bc4a99083646 response_code = 204 uri = /vpc-routes
18802024-11-27T20:48:46.716ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42059
18812024-11-27T20:48:46.716ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42059 req_id = e54d2e6c-d838-471d-b2c5-406dd1f6dea5 response_code = 200 uri = /v2p
18822024-11-27T20:48:46.829ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44669
18832024-11-27T20:48:46.829ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
18842024-11-27T20:48:46.866ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
18852024-11-27T20:48:46.926ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96868 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:44669 req_id = df4cca3a-3e01-4c7e-96ed-2d905882eedf response_code = 204 uri = /switch-ports
18862024-11-27T20:48:46.926ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44669 req_id = 1525c1a7-437c-451e-9a2a-bf0606304db0 response_code = 200 uri = /network-bootstore-config
18872024-11-27T20:48:47.408ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54537
18882024-11-27T20:48:47.408ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54537 req_id = 018fdf44-bfb9-46a8-94dc-dcbc551f4d93 response_code = 200 uri = /vpc-routes
18892024-11-27T20:48:47.434ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47224
18902024-11-27T20:48:47.435ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47224 req_id = dbaeb846-2ed6-4e3b-9c34-ab2dbfd8320e response_code = 200 uri = /v2p
18912024-11-27T20:48:47.436ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e values = ExternalIpGatewayMap { mappings: {} }
18922024-11-27T20:48:47.436ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54537 req_id = 5d4aa18f-4a09-4c6c-9092-e8517541dadc response_code = 204 uri = /eip-gateways
18932024-11-27T20:48:47.444ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 240 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54537 req_id = 3b76adc3-806e-4e91-8ae7-28dab6d092d9 response_code = 204 uri = /vpc-routes
18942024-11-27T20:48:47.473ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59241
18952024-11-27T20:48:47.473ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
18962024-11-27T20:48:47.515ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
18972024-11-27T20:48:47.569ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96200 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:59241 req_id = 7b997422-9c39-4668-b76f-36bcd723bf51 response_code = 204 uri = /switch-ports
18982024-11-27T20:48:47.570ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59241 req_id = 6e6110c4-6d27-4c02-a1ae-fa6ed9d433a4 response_code = 200 uri = /network-bootstore-config
18992024-11-27T20:49:08.857ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:41461
19002024-11-27T20:49:08.858ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:41461 req_id = bdd54ff9-6f9b-4c38-b894-8b99492e096f response_code = 200 uri = /baseboard
19012024-11-27T20:49:11.478ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8066 local_addr = [fd00:1122:3344:101::1]:35289 method = GET remote_addr = [fd00:1122:3344:101::d]:63096 req_id = c98dde28-f44c-4e40-b743-042f44c2b053 response_code = 200 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e uri = /0f17ab63-f38a-412f-a653-029795d7304e
19022024-11-27T20:49:15.350ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42917
19032024-11-27T20:49:15.351ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42917 req_id = efd747c0-a069-4658-b509-ab05cb0ffd9f response_code = 200 uri = /vpc-routes
19042024-11-27T20:49:15.406ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64754
19052024-11-27T20:49:15.406ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64754 req_id = c911cf78-31d0-4c84-9017-a6104fe42021 response_code = 200 uri = /v2p
19062024-11-27T20:49:15.552ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e values = ExternalIpGatewayMap { mappings: {} }
19072024-11-27T20:49:15.552ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42917 req_id = 4c767770-fc2a-448e-84a8-b11504bd21d2 response_code = 204 uri = /eip-gateways
19082024-11-27T20:49:15.563ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 209 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42917 req_id = d539e042-8ffc-4a24-817a-77c95e2d1ddf response_code = 204 uri = /vpc-routes
19092024-11-27T20:49:15.592ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53438
19102024-11-27T20:49:15.592ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19112024-11-27T20:49:15.629ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19122024-11-27T20:49:15.681ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89555 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:53438 req_id = 55f133f8-64de-4c24-84c1-3433acd32043 response_code = 204 uri = /switch-ports
19132024-11-27T20:49:15.681ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53438 req_id = c5f6d666-85f2-472b-9e88-47b52c7a8f8f response_code = 200 uri = /network-bootstore-config
19142024-11-27T20:49:16.787ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57840
19152024-11-27T20:49:16.787ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57840 req_id = dd0b89b4-dbda-4828-9217-506c49da284b response_code = 200 uri = /vpc-routes
19162024-11-27T20:49:16.837ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e values = ExternalIpGatewayMap { mappings: {} }
19172024-11-27T20:49:16.837ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57840 req_id = 2e1088fb-158c-45ed-938e-b2d810e31b53 response_code = 204 uri = /eip-gateways
19182024-11-27T20:49:16.847ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 254 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57840 req_id = 709cc755-a760-4f32-a5ca-5bece2a7c297 response_code = 204 uri = /vpc-routes
19192024-11-27T20:49:16.896ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43747
19202024-11-27T20:49:16.896ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43747 req_id = 2dd322f5-eb53-45cc-ae96-758566e9af23 response_code = 200 uri = /v2p
19212024-11-27T20:49:16.951ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61378
19222024-11-27T20:49:16.951ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19232024-11-27T20:49:16.990ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19242024-11-27T20:49:17.045ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93380 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:61378 req_id = 619994fe-44ab-4316-9415-41c6a305adce response_code = 204 uri = /switch-ports
19252024-11-27T20:49:17.045ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61378 req_id = 4c4e8776-e0e7-4035-9f04-4362da00038a response_code = 200 uri = /network-bootstore-config
19262024-11-27T20:49:17.623ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45372
19272024-11-27T20:49:17.623ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45372 req_id = a3c22d43-68f0-4905-b2e6-f249e6d3a05d response_code = 200 uri = /vpc-routes
19282024-11-27T20:49:17.664ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e values = ExternalIpGatewayMap { mappings: {} }
19292024-11-27T20:49:17.664ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45372 req_id = 19a70697-e76d-4d95-9527-c9dfa6ad7f8a response_code = 204 uri = /eip-gateways
19302024-11-27T20:49:17.674ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 237 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45372 req_id = eb58675b-0a9c-483b-a301-6416d674856c response_code = 204 uri = /vpc-routes
19312024-11-27T20:49:17.766ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34421
19322024-11-27T20:49:17.766ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34421 req_id = d97c29dc-45bf-45b0-ac62-354a83cc7075 response_code = 200 uri = /v2p
19332024-11-27T20:49:17.809ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65452
19342024-11-27T20:49:17.809ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19352024-11-27T20:49:17.844ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19362024-11-27T20:49:17.899ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90426 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:65452 req_id = 7fa552af-67bf-4ce0-8663-7273a6129df1 response_code = 204 uri = /switch-ports
19372024-11-27T20:49:17.899ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65452 req_id = 838459b4-a672-4a11-8c2f-078594d031b1 response_code = 200 uri = /network-bootstore-config
19382024-11-27T20:49:38.890ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:60992
19392024-11-27T20:49:38.890ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 30 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:60992 req_id = 0a329952-818e-473b-876d-32695d2570ad response_code = 200 uri = /baseboard
19402024-11-27T20:49:41.478ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7516 local_addr = [fd00:1122:3344:101::1]:35289 method = GET remote_addr = [fd00:1122:3344:101::d]:63096 req_id = 495f22f3-61ea-4c78-8866-95cdfe9fb6b3 response_code = 200 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e uri = /0f17ab63-f38a-412f-a653-029795d7304e
19412024-11-27T20:49:45.243ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61644
19422024-11-27T20:49:45.243ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61644 req_id = afe52110-0766-4f2a-ab3b-75e54481136e response_code = 200 uri = /vpc-routes
19432024-11-27T20:49:45.286ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e values = ExternalIpGatewayMap { mappings: {} }
19442024-11-27T20:49:45.286ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61644 req_id = d9e82c00-4e9e-457a-a5f2-a3ef83e09afc response_code = 204 uri = /eip-gateways
19452024-11-27T20:49:45.351ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52394
19462024-11-27T20:49:45.351ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52394 req_id = 8db8cff0-fa22-474c-aeb1-162f8eaf2add response_code = 200 uri = /v2p
19472024-11-27T20:49:45.361ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 242 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61644 req_id = 3dc553f6-7b44-46d9-a68a-85a56dfa889e response_code = 204 uri = /vpc-routes
19482024-11-27T20:49:45.399ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37116
19492024-11-27T20:49:45.400ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19502024-11-27T20:49:45.437ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19512024-11-27T20:49:45.495ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95730 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:37116 req_id = 9899b252-f053-4b8b-a8c0-b3fdd43820bb response_code = 204 uri = /switch-ports
19522024-11-27T20:49:45.496ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37116 req_id = b74e7cb4-6060-45ea-b30c-4001c88cd4b3 response_code = 200 uri = /network-bootstore-config
19532024-11-27T20:49:46.592ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51594
19542024-11-27T20:49:46.592ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51594 req_id = a05660fc-e96a-46b5-840f-24ed7d3a18c0 response_code = 200 uri = /vpc-routes
19552024-11-27T20:49:46.653ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e values = ExternalIpGatewayMap { mappings: {} }
19562024-11-27T20:49:46.653ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51594 req_id = 330fc949-5273-4bcc-9726-f36f0df8a231 response_code = 204 uri = /eip-gateways
19572024-11-27T20:49:46.665ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51594 req_id = bbd19191-f270-4006-b2e0-8231e72af2e0 response_code = 204 uri = /vpc-routes
19582024-11-27T20:49:46.822ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50907
19592024-11-27T20:49:46.822ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50907 req_id = 54125b76-2375-4808-86c3-f1c9d312ce8b response_code = 200 uri = /v2p
19602024-11-27T20:49:46.933ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51393
19612024-11-27T20:49:46.933ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19622024-11-27T20:49:46.972ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19632024-11-27T20:49:47.029ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95642 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:51393 req_id = ae5b7989-66c4-4145-a6c2-b2c93df1add4 response_code = 204 uri = /switch-ports
19642024-11-27T20:49:47.029ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51393 req_id = 60628c26-3761-48c1-9164-90bf97b11287 response_code = 200 uri = /network-bootstore-config
19652024-11-27T20:49:47.282ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39607
19662024-11-27T20:49:47.282ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39607 req_id = 9b1dd5f2-e3e4-4852-b8f1-07ee8bc9bdef response_code = 200 uri = /vpc-routes
19672024-11-27T20:49:47.326ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e values = ExternalIpGatewayMap { mappings: {} }
19682024-11-27T20:49:47.326ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39607 req_id = 97809f16-504c-4fe2-9af5-6bad37a7385a response_code = 204 uri = /eip-gateways
19692024-11-27T20:49:47.335ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 303 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39607 req_id = 79d6f3f3-3b9d-46fc-b919-65d69dcc28e9 response_code = 204 uri = /vpc-routes
19702024-11-27T20:49:47.376ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60648
19712024-11-27T20:49:47.376ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60648 req_id = 51a2bced-7a71-40ef-ab58-26e2573c40fa response_code = 200 uri = /v2p
19722024-11-27T20:49:47.380ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43389
19732024-11-27T20:49:47.380ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19742024-11-27T20:49:47.417ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19752024-11-27T20:49:47.472ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91572 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:43389 req_id = 9a424b99-d6d3-4466-b8c4-bbbe89f36068 response_code = 204 uri = /switch-ports
19762024-11-27T20:49:47.472ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43389 req_id = 2d90c38f-f860-490b-b301-d926b12fc2a3 response_code = 200 uri = /network-bootstore-config
19772024-11-27T20:49:59.485ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
19782024-11-27T20:50:08.924ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:33555
19792024-11-27T20:50:08.924ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:33555 req_id = 4bba18ff-ff58-426c-b783-79dd9523f72f response_code = 200 uri = /baseboard
19802024-11-27T20:50:11.478ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7184 local_addr = [fd00:1122:3344:101::1]:35289 method = GET remote_addr = [fd00:1122:3344:101::d]:63096 req_id = 7d6934de-844b-4c29-969e-8273c8825c2a response_code = 200 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e uri = /0f17ab63-f38a-412f-a653-029795d7304e
19812024-11-27T20:50:15.274ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37067
19822024-11-27T20:50:15.274ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37067 req_id = b49311d0-1828-4d78-8798-dd67809fab48 response_code = 200 uri = /vpc-routes
19832024-11-27T20:50:15.321ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e values = ExternalIpGatewayMap { mappings: {} }
19842024-11-27T20:50:15.321ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37067 req_id = 069e7510-3cc6-4f19-91db-7efa641d9d8a response_code = 204 uri = /eip-gateways
19852024-11-27T20:50:15.332ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 281 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37067 req_id = ad2b6564-91df-4f56-b0ea-e6ffde360f0c response_code = 204 uri = /vpc-routes
19862024-11-27T20:50:15.426ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41779
19872024-11-27T20:50:15.426ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41779 req_id = a24a8af4-e816-480e-b70e-1180823cd64f response_code = 200 uri = /v2p
19882024-11-27T20:50:15.445ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59183
19892024-11-27T20:50:15.445ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19902024-11-27T20:50:15.482ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19912024-11-27T20:50:15.537ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91520 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:59183 req_id = c61ebdaf-5917-42cf-908a-ecf38185258e response_code = 204 uri = /switch-ports
19922024-11-27T20:50:15.537ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59183 req_id = 9d6d6ae4-a85c-41e7-8c66-84c4df1d3ba0 response_code = 200 uri = /network-bootstore-config
19932024-11-27T20:50:16.757ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54026
19942024-11-27T20:50:16.757ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54026 req_id = b68b42ad-2f66-46b2-a47d-e7c007af4a22 response_code = 200 uri = /vpc-routes
19952024-11-27T20:50:16.774ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e values = ExternalIpGatewayMap { mappings: {} }
19962024-11-27T20:50:16.774ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54026 req_id = 1c16ad25-c3ef-448b-8d15-c549e4b6cef9 response_code = 204 uri = /eip-gateways
19972024-11-27T20:50:16.783ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 190 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54026 req_id = 6ccb2f56-cf1a-4d53-a15b-4f965965c4c3 response_code = 204 uri = /vpc-routes
19982024-11-27T20:50:16.937ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42445
19992024-11-27T20:50:16.937ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42445 req_id = e422b684-2b07-4586-804f-ab03a524c973 response_code = 200 uri = /v2p
20002024-11-27T20:50:17.041ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45283
20012024-11-27T20:50:17.041ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20022024-11-27T20:50:17.080ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20032024-11-27T20:50:17.152ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110750 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:45283 req_id = 14dab427-4785-4c1b-a56f-0c12e4410eae response_code = 204 uri = /switch-ports
20042024-11-27T20:50:17.152ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45283 req_id = 53196378-9ae3-4750-aa16-12ec97f13bab response_code = 200 uri = /network-bootstore-config
20052024-11-27T20:50:17.467ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54644
20062024-11-27T20:50:17.467ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54644 req_id = ecc42fee-248b-4b1f-892b-307de1f7fcd4 response_code = 200 uri = /vpc-routes
20072024-11-27T20:50:17.507ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e values = ExternalIpGatewayMap { mappings: {} }
20082024-11-27T20:50:17.507ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54644 req_id = 34ea93c8-9d4c-4374-953a-ea35f01f3a75 response_code = 204 uri = /eip-gateways
20092024-11-27T20:50:17.534ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33302
20102024-11-27T20:50:17.534ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33302 req_id = 56931d30-7906-448f-a456-c9134d478a07 response_code = 200 uri = /v2p
20112024-11-27T20:50:17.543ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 311 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54644 req_id = 6f2d7023-322d-4f7f-a506-e5a98d146ebd response_code = 204 uri = /vpc-routes
20122024-11-27T20:50:17.565ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49710
20132024-11-27T20:50:17.566ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20142024-11-27T20:50:17.602ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20152024-11-27T20:50:17.655ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89529 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:49710 req_id = f1379bf2-8af5-4e81-b17e-a72d3d25d39c response_code = 204 uri = /switch-ports
20162024-11-27T20:50:17.655ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49710 req_id = 92abddea-6c11-4bc6-9e31-c0f6defdc3e9 response_code = 200 uri = /network-bootstore-config
20172024-11-27T20:50:38.957ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:63755
20182024-11-27T20:50:38.957ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:63755 req_id = 71569459-ed4e-4a32-a0f7-4c2e17ea19b5 response_code = 200 uri = /baseboard
20192024-11-27T20:50:41.481ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7777 local_addr = [fd00:1122:3344:101::1]:35289 method = GET remote_addr = [fd00:1122:3344:101::d]:63096 req_id = aeff4645-ab4d-4626-8e1d-88293c40886d response_code = 200 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e uri = /0f17ab63-f38a-412f-a653-029795d7304e
20202024-11-27T20:50:45.144ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63553
20212024-11-27T20:50:45.144ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63553 req_id = f9cbdf79-0876-4c30-b84d-b00ba2b57805 response_code = 200 uri = /vpc-routes
20222024-11-27T20:50:45.191ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e values = ExternalIpGatewayMap { mappings: {} }
20232024-11-27T20:50:45.191ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63553 req_id = 308d91e7-3b55-4dd8-b3f6-93599b4a8f71 response_code = 204 uri = /eip-gateways
20242024-11-27T20:50:45.200ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 253 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63553 req_id = 817deb17-2347-4a29-bb3a-79f71a457f12 response_code = 204 uri = /vpc-routes
20252024-11-27T20:50:45.226ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36050
20262024-11-27T20:50:45.226ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20272024-11-27T20:50:45.266ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20282024-11-27T20:50:45.323ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96414 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:36050 req_id = ce141b8c-07e3-4656-8049-6ee2fee8f2fe response_code = 204 uri = /switch-ports
20292024-11-27T20:50:45.323ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38653
20302024-11-27T20:50:45.323ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 167 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38653 req_id = c08b3eba-33ec-4279-9f78-25cce3400f91 response_code = 200 uri = /v2p
20312024-11-27T20:50:45.323ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 237 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36050 req_id = 9b08164b-71af-458e-9346-ab5c0faae6d9 response_code = 200 uri = /network-bootstore-config
20322024-11-27T20:50:46.603ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37647
20332024-11-27T20:50:46.603ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37647 req_id = e4cd84b5-5bdc-4089-a9e1-75505b70d2d3 response_code = 200 uri = /vpc-routes
20342024-11-27T20:50:46.645ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e values = ExternalIpGatewayMap { mappings: {} }
20352024-11-27T20:50:46.646ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37647 req_id = d56a2f0c-df68-444b-9143-070498918c40 response_code = 204 uri = /eip-gateways
20362024-11-27T20:50:46.655ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 240 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37647 req_id = fdfb0a24-54d9-406f-a06a-2df4d22ad025 response_code = 204 uri = /vpc-routes
20372024-11-27T20:50:46.714ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38670
20382024-11-27T20:50:46.714ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20392024-11-27T20:50:46.753ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20402024-11-27T20:50:46.806ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92630 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:38670 req_id = 682f7011-4775-40a5-bf8f-dde3543137ea response_code = 204 uri = /switch-ports
20412024-11-27T20:50:46.806ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50501
20422024-11-27T20:50:46.807ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 204 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50501 req_id = 2cf812d6-5650-4113-9d81-85f0d3b4a964 response_code = 200 uri = /v2p
20432024-11-27T20:50:46.807ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 228 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38670 req_id = 17750ca5-4202-4aa6-8cba-e1faafd84c0e response_code = 200 uri = /network-bootstore-config
20442024-11-27T20:50:47.450ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43370
20452024-11-27T20:50:47.450ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43370 req_id = fd59ad1a-bfe3-48a4-9976-3feb74178ec9 response_code = 200 uri = /vpc-routes
20462024-11-27T20:50:47.498ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e values = ExternalIpGatewayMap { mappings: {} }
20472024-11-27T20:50:47.498ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43370 req_id = 87e450a3-34e4-436f-ac63-abd3b4cf4531 response_code = 204 uri = /eip-gateways
20482024-11-27T20:50:47.507ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 250 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43370 req_id = 66a945e7-a5e0-4174-ba1c-32ab600a29f4 response_code = 204 uri = /vpc-routes
20492024-11-27T20:50:47.526ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38014
20502024-11-27T20:50:47.526ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20512024-11-27T20:50:47.566ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20522024-11-27T20:50:47.619ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92636 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:38014 req_id = 92e405cb-cf83-4a29-9fd9-180f26614266 response_code = 204 uri = /switch-ports
20532024-11-27T20:50:47.619ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37639
20542024-11-27T20:50:47.619ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 160 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37639 req_id = 6d2a1f49-2bf2-41fc-ab7e-3785483546f6 response_code = 200 uri = /v2p
20552024-11-27T20:50:47.619ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 230 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38014 req_id = 6c057607-58bb-42e1-a74c-62ea516adbb3 response_code = 200 uri = /network-bootstore-config
20562024-11-27T20:51:08.993ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:55517
20572024-11-27T20:51:08.993ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 69 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:55517 req_id = a62aa6fa-d339-4708-8f65-b05e5c789e92 response_code = 200 uri = /baseboard
20582024-11-27T20:51:11.479ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7115 local_addr = [fd00:1122:3344:101::1]:35289 method = GET remote_addr = [fd00:1122:3344:101::d]:63096 req_id = 28cdcfd6-062a-44de-b96d-a2d10b35398d response_code = 200 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e uri = /0f17ab63-f38a-412f-a653-029795d7304e
20592024-11-27T20:51:15.305ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60859
20602024-11-27T20:51:15.306ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60859 req_id = 52ab20cd-d85d-4be1-b959-a18407235b1a response_code = 200 uri = /vpc-routes
20612024-11-27T20:51:15.352ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e values = ExternalIpGatewayMap { mappings: {} }
20622024-11-27T20:51:15.352ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60859 req_id = 79617e10-c908-46af-93bb-94e0683fa555 response_code = 204 uri = /eip-gateways
20632024-11-27T20:51:15.596ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36392
20642024-11-27T20:51:15.597ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36392 req_id = 91bca5a8-a1f3-4ae6-ad99-62b95306450a response_code = 200 uri = /v2p
20652024-11-27T20:51:15.600ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 205 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60859 req_id = 9517e97d-50b8-4e71-8d0d-31a1af8dc5c3 response_code = 204 uri = /vpc-routes
20662024-11-27T20:51:15.656ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56835
20672024-11-27T20:51:15.656ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20682024-11-27T20:51:15.695ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20692024-11-27T20:51:15.749ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93012 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:56835 req_id = 7509db03-1de3-4248-8b8b-642c68d56c0b response_code = 204 uri = /switch-ports
20702024-11-27T20:51:15.749ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56835 req_id = bd410953-54dd-445b-89b5-c2120df81293 response_code = 200 uri = /network-bootstore-config
20712024-11-27T20:51:16.694ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63325
20722024-11-27T20:51:16.694ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63325 req_id = 407a0366-55f1-4a45-a63c-ec9e24470fe5 response_code = 200 uri = /vpc-routes
20732024-11-27T20:51:16.708ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e values = ExternalIpGatewayMap { mappings: {} }
20742024-11-27T20:51:16.708ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63325 req_id = 0824e6da-1286-467e-8c7c-c16730e0b17f response_code = 204 uri = /eip-gateways
20752024-11-27T20:51:16.867ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53444
20762024-11-27T20:51:16.868ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53444 req_id = b276027f-9534-480c-b16d-25ae757c2554 response_code = 200 uri = /v2p
20772024-11-27T20:51:16.877ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 228 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63325 req_id = 48f977fe-3d0f-4442-befa-6c2f72a50042 response_code = 204 uri = /vpc-routes
20782024-11-27T20:51:16.964ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49888
20792024-11-27T20:51:16.964ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20802024-11-27T20:51:17.004ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20812024-11-27T20:51:17.058ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94166 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:49888 req_id = bbfda0db-75b6-420b-befb-db3988795db9 response_code = 204 uri = /switch-ports
20822024-11-27T20:51:17.059ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49888 req_id = 6e51c410-624d-43a9-9029-b258e2f54911 response_code = 200 uri = /network-bootstore-config
20832024-11-27T20:51:17.477ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46271
20842024-11-27T20:51:17.477ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46271 req_id = 95da33de-e690-4570-a56a-7a637b3d76de response_code = 200 uri = /vpc-routes
20852024-11-27T20:51:17.543ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e values = ExternalIpGatewayMap { mappings: {} }
20862024-11-27T20:51:17.543ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46271 req_id = 7e9419e6-4b2f-4e8e-9dce-74a3321c33ba response_code = 204 uri = /eip-gateways
20872024-11-27T20:51:17.553ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 270 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46271 req_id = 4fc7d36b-a891-4304-b91d-82e7007e0f59 response_code = 204 uri = /vpc-routes
20882024-11-27T20:51:17.615ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37775
20892024-11-27T20:51:17.615ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20902024-11-27T20:51:17.656ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20912024-11-27T20:51:17.716ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101005 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:37775 req_id = 6828f04a-00df-4a13-b5da-d7a6083993da response_code = 204 uri = /switch-ports
20922024-11-27T20:51:17.716ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65107
20932024-11-27T20:51:17.716ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 199 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65107 req_id = a54d4552-7292-40ed-bd2e-1d72e21af22d response_code = 200 uri = /v2p
20942024-11-27T20:51:17.716ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 233 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37775 req_id = 423e00ac-64ad-47ed-90b1-2f85c2464ceb response_code = 200 uri = /network-bootstore-config
20952024-11-27T20:51:39.027ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:52645
20962024-11-27T20:51:39.027ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:52645 req_id = 8b186ed1-e8d5-4af0-9307-73fb2c112ecc response_code = 200 uri = /baseboard
20972024-11-27T20:51:41.480ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7418 local_addr = [fd00:1122:3344:101::1]:35289 method = GET remote_addr = [fd00:1122:3344:101::d]:63096 req_id = df092789-42da-4461-8f2c-0812670b29a4 response_code = 200 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e uri = /0f17ab63-f38a-412f-a653-029795d7304e
20982024-11-27T20:51:45.198ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63540
20992024-11-27T20:51:45.198ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63540 req_id = 487c1e15-119e-4120-b8d0-f7f8f1eb2683 response_code = 200 uri = /vpc-routes
21002024-11-27T20:51:45.256ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e values = ExternalIpGatewayMap { mappings: {} }
21012024-11-27T20:51:45.256ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63540 req_id = f6737a9f-006e-453b-a557-ef99e42a9021 response_code = 204 uri = /eip-gateways
21022024-11-27T20:51:45.267ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 248 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63540 req_id = 533d6cc7-e488-4202-9f12-e28e3b9f107c response_code = 204 uri = /vpc-routes
21032024-11-27T20:51:45.296ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62706
21042024-11-27T20:51:45.296ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62706 req_id = d18562dc-1e9d-4228-b388-8359b5a41952 response_code = 200 uri = /v2p
21052024-11-27T20:51:45.331ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56979
21062024-11-27T20:51:45.332ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21072024-11-27T20:51:45.372ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21082024-11-27T20:51:45.428ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96209 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:56979 req_id = 82599a11-d675-4baa-8d1b-ae45953f9ee4 response_code = 204 uri = /switch-ports
21092024-11-27T20:51:45.428ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56979 req_id = 010111c0-af04-4423-ba66-da7d7ae6da38 response_code = 200 uri = /network-bootstore-config
21102024-11-27T20:51:46.672ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55784
21112024-11-27T20:51:46.672ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55784 req_id = f7179232-8ebc-4ce5-8123-c4cab06fb06c response_code = 200 uri = /vpc-routes
21122024-11-27T20:51:46.691ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e values = ExternalIpGatewayMap { mappings: {} }
21132024-11-27T20:51:46.692ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55784 req_id = 59bd48b9-7eaa-48ea-a192-a2c82a311d31 response_code = 204 uri = /eip-gateways
21142024-11-27T20:51:46.705ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 192 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55784 req_id = d6f822b2-af8c-493e-8284-4f7a1d126f0a response_code = 204 uri = /vpc-routes
21152024-11-27T20:51:46.734ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44856
21162024-11-27T20:51:46.734ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21172024-11-27T20:51:46.773ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21182024-11-27T20:51:46.829ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94924 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:44856 req_id = 473d7c9d-645c-455d-aa86-24512a2fc9c4 response_code = 204 uri = /switch-ports
21192024-11-27T20:51:46.829ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58200
21202024-11-27T20:51:46.830ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 308 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44856 req_id = db988a74-0679-4dc2-ab83-bb99d0ea9e5c response_code = 200 uri = /network-bootstore-config
21212024-11-27T20:51:46.830ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 245 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58200 req_id = fd7a1c45-7ce6-4aac-b64d-fff68bbea1f0 response_code = 200 uri = /v2p
21222024-11-27T20:51:47.311ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45923
21232024-11-27T20:51:47.311ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45923 req_id = 43009288-b51b-46b1-913b-bda281430347 response_code = 200 uri = /vpc-routes
21242024-11-27T20:51:47.324ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e values = ExternalIpGatewayMap { mappings: {} }
21252024-11-27T20:51:47.324ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45923 req_id = 53c3a8b3-4429-4938-a185-8b3e17cf71e8 response_code = 204 uri = /eip-gateways
21262024-11-27T20:51:47.333ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 235 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45923 req_id = 0ed3942a-af33-4374-8349-5242e43f9f9d response_code = 204 uri = /vpc-routes
21272024-11-27T20:51:47.390ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61884
21282024-11-27T20:51:47.390ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61884 req_id = 5ff06664-301a-4a40-855c-6ce4151d6bf8 response_code = 200 uri = /v2p
21292024-11-27T20:51:47.413ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54456
21302024-11-27T20:51:47.413ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21312024-11-27T20:51:47.448ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21322024-11-27T20:51:47.503ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89254 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:54456 req_id = a9326c17-e06e-4208-91e2-2c24f904f754 response_code = 204 uri = /switch-ports
21332024-11-27T20:51:47.503ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54456 req_id = c45c8cd7-b2db-4752-a8b6-c5ec33f1052e response_code = 200 uri = /network-bootstore-config
21342024-11-27T20:52:09.061ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49428
21352024-11-27T20:52:09.061ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49428 req_id = d1952fdf-7ea4-4a18-8184-f369bb3fbc02 response_code = 200 uri = /baseboard
21362024-11-27T20:52:11.479ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6854 local_addr = [fd00:1122:3344:101::1]:35289 method = GET remote_addr = [fd00:1122:3344:101::d]:63096 req_id = 4eaa7b46-66b1-4952-a486-9389cbfc87f8 response_code = 200 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e uri = /0f17ab63-f38a-412f-a653-029795d7304e
21372024-11-27T20:52:15.244ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35191
21382024-11-27T20:52:15.245ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 186 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35191 req_id = a48150f7-8aa4-4822-a95f-660c86cfb33f response_code = 200 uri = /v2p
21392024-11-27T20:52:15.254ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46149
21402024-11-27T20:52:15.254ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46149 req_id = 6af2b98d-4da1-4b73-b2dd-2a8d6c9c0247 response_code = 200 uri = /vpc-routes
21412024-11-27T20:52:15.306ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e values = ExternalIpGatewayMap { mappings: {} }
21422024-11-27T20:52:15.306ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46149 req_id = c211aab9-f20e-4256-bb3d-d92895f66581 response_code = 204 uri = /eip-gateways
21432024-11-27T20:52:15.315ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 368 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46149 req_id = c739a16b-508e-4bc6-887b-966fab359b72 response_code = 204 uri = /vpc-routes
21442024-11-27T20:52:15.478ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45212
21452024-11-27T20:52:15.478ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21462024-11-27T20:52:15.519ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21472024-11-27T20:52:15.576ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98057 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:45212 req_id = 4e99265d-30b3-4745-924f-4bcafb16f5e2 response_code = 204 uri = /switch-ports
21482024-11-27T20:52:15.577ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61269
21492024-11-27T20:52:15.577ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45212 req_id = 2cd926ba-b2bb-4687-88c4-267fc9830ab5 response_code = 200 uri = /network-bootstore-config
21502024-11-27T20:52:15.577ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 81c35812-3316-445b-a6f6-3aa12cbc0141, kind: Service { id: d13b0217-c0a6-4eaa-8098-4068c753e7f8 }, name: Name("external-dns-d13b0217-c0a6-4eaa-8098-4068c753e7f8"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 26])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8c3b27b2-7f68-49b4-b3f3-4525d795f2c5, kind: Service { id: ef029baa-d573-494d-9698-1690c9c57399 }, name: Name("external-dns-ef029baa-d573-494d-9698-1690c9c57399"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 142, 128])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 07c10885-dd61-4583-8ce1-a7179a48d3fa, kind: Service { id: 77818842-4ce3-4fbc-b24e-bfe02c4a0922 }, name: Name("nexus-77818842-4ce3-4fbc-b24e-bfe02c4a0922"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 187, 182])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7ec37840-3b01-4078-b834-03dbd8adf8dd, kind: Service { id: fb7409be-e1e9-41dc-ba28-37cdd7b9c8d6 }, name: Name("nexus-fb7409be-e1e9-41dc-ba28-37cdd7b9c8d6"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 220])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b9a4498e-d802-4925-8101-8f18c4e4f305, kind: Service { id: ae973228-9cf8-450f-8ac4-7d740fc62ad6 }, name: Name("nexus-ae973228-9cf8-450f-8ac4-7d740fc62ad6"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 168, 190])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
21512024-11-27T20:52:15.577ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21522024-11-27T20:52:15.577ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21532024-11-27T20:52:15.577ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21542024-11-27T20:52:15.577ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21552024-11-27T20:52:15.577ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21562024-11-27T20:52:15.577ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
21572024-11-27T20:52:15.577ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 442 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61269 req_id = 62ec89ca-31d9-4f7a-9402-ce82cbb8fe44 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
21582024-11-27T20:52:16.840ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64672
21592024-11-27T20:52:16.840ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64672 req_id = 7627bb62-b6d0-4c34-ac74-e919991acd3d response_code = 200 uri = /vpc-routes
21602024-11-27T20:52:16.898ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e values = ExternalIpGatewayMap { mappings: {} }
21612024-11-27T20:52:16.898ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64672 req_id = 89e1b7f1-4ee7-4ee0-b8e2-1523c2a84fee response_code = 204 uri = /eip-gateways
21622024-11-27T20:52:16.911ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 321 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64672 req_id = dd5ab7d4-ff0a-4fbf-8f79-bdcdebd0ca88 response_code = 204 uri = /vpc-routes
21632024-11-27T20:52:17.064ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45174
21642024-11-27T20:52:17.064ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45174 req_id = d655a678-2767-4ca9-8349-ce12fe61f390 response_code = 200 uri = /v2p
21652024-11-27T20:52:17.086ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48975
21662024-11-27T20:52:17.086ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21672024-11-27T20:52:17.128ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21682024-11-27T20:52:17.224ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138349 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48975 req_id = d02357bf-fce7-428b-add7-3fc2e0f64ffb response_code = 204 uri = /switch-ports
21692024-11-27T20:52:17.224ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48975 req_id = 40484097-8fd9-4ccd-a8c9-183bd194c3bf response_code = 200 uri = /network-bootstore-config
21702024-11-27T20:52:17.326ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61179
21712024-11-27T20:52:17.326ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 81c35812-3316-445b-a6f6-3aa12cbc0141, kind: Service { id: d13b0217-c0a6-4eaa-8098-4068c753e7f8 }, name: Name("external-dns-d13b0217-c0a6-4eaa-8098-4068c753e7f8"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 26])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8c3b27b2-7f68-49b4-b3f3-4525d795f2c5, kind: Service { id: ef029baa-d573-494d-9698-1690c9c57399 }, name: Name("external-dns-ef029baa-d573-494d-9698-1690c9c57399"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 142, 128])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 07c10885-dd61-4583-8ce1-a7179a48d3fa, kind: Service { id: 77818842-4ce3-4fbc-b24e-bfe02c4a0922 }, name: Name("nexus-77818842-4ce3-4fbc-b24e-bfe02c4a0922"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 187, 182])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7ec37840-3b01-4078-b834-03dbd8adf8dd, kind: Service { id: fb7409be-e1e9-41dc-ba28-37cdd7b9c8d6 }, name: Name("nexus-fb7409be-e1e9-41dc-ba28-37cdd7b9c8d6"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 220])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b9a4498e-d802-4925-8101-8f18c4e4f305, kind: Service { id: ae973228-9cf8-450f-8ac4-7d740fc62ad6 }, name: Name("nexus-ae973228-9cf8-450f-8ac4-7d740fc62ad6"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 168, 190])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
21722024-11-27T20:52:17.326ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21732024-11-27T20:52:17.326ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21742024-11-27T20:52:17.326ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21752024-11-27T20:52:17.326ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21762024-11-27T20:52:17.326ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21772024-11-27T20:52:17.326ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
21782024-11-27T20:52:17.326ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 431 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61179 req_id = 30197f80-e48b-4fb6-bdde-5e361a21ee22 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
21792024-11-27T20:52:17.505ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50765
21802024-11-27T20:52:17.505ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50765 req_id = 8ecb4731-64fe-4de3-aed9-1528faf08396 response_code = 200 uri = /vpc-routes
21812024-11-27T20:52:17.553ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e values = ExternalIpGatewayMap { mappings: {} }
21822024-11-27T20:52:17.553ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50765 req_id = 076437f8-93cc-4905-873b-4743b0a17ac1 response_code = 204 uri = /eip-gateways
21832024-11-27T20:52:17.561ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 251 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50765 req_id = f88594c2-6930-429e-8c11-e73dcdd1232d response_code = 204 uri = /vpc-routes
21842024-11-27T20:52:17.564ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55600
21852024-11-27T20:52:17.564ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21862024-11-27T20:52:17.605ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21872024-11-27T20:52:17.662ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98325 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:55600 req_id = a434a0ba-b80b-4eaf-968c-62200ee02175 response_code = 204 uri = /switch-ports
21882024-11-27T20:52:17.663ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55795
21892024-11-27T20:52:17.663ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55600 req_id = 2c06e5fd-280e-4041-8cef-b48448e2df0e response_code = 200 uri = /network-bootstore-config
21902024-11-27T20:52:17.663ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 172 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55795 req_id = 4948d89c-7da9-4c4b-81e5-ede590127d7d response_code = 200 uri = /v2p
21912024-11-27T20:52:17.677ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50842
21922024-11-27T20:52:17.677ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 81c35812-3316-445b-a6f6-3aa12cbc0141, kind: Service { id: d13b0217-c0a6-4eaa-8098-4068c753e7f8 }, name: Name("external-dns-d13b0217-c0a6-4eaa-8098-4068c753e7f8"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 26])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8c3b27b2-7f68-49b4-b3f3-4525d795f2c5, kind: Service { id: ef029baa-d573-494d-9698-1690c9c57399 }, name: Name("external-dns-ef029baa-d573-494d-9698-1690c9c57399"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 142, 128])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 07c10885-dd61-4583-8ce1-a7179a48d3fa, kind: Service { id: 77818842-4ce3-4fbc-b24e-bfe02c4a0922 }, name: Name("nexus-77818842-4ce3-4fbc-b24e-bfe02c4a0922"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 187, 182])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7ec37840-3b01-4078-b834-03dbd8adf8dd, kind: Service { id: fb7409be-e1e9-41dc-ba28-37cdd7b9c8d6 }, name: Name("nexus-fb7409be-e1e9-41dc-ba28-37cdd7b9c8d6"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 220])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b9a4498e-d802-4925-8101-8f18c4e4f305, kind: Service { id: ae973228-9cf8-450f-8ac4-7d740fc62ad6 }, name: Name("nexus-ae973228-9cf8-450f-8ac4-7d740fc62ad6"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 168, 190])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
21932024-11-27T20:52:17.677ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21942024-11-27T20:52:17.677ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21952024-11-27T20:52:17.677ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21962024-11-27T20:52:17.677ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21972024-11-27T20:52:17.677ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21982024-11-27T20:52:17.677ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
21992024-11-27T20:52:17.677ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 337 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50842 req_id = 935792d4-30f7-4027-824c-5184394c5d8b response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
22002024-11-27T20:52:39.094ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:62731
22012024-11-27T20:52:39.095ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:62731 req_id = c6853baf-dcd6-42c1-b19c-711bdc58ef3e response_code = 200 uri = /baseboard
22022024-11-27T20:52:41.481ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7975 local_addr = [fd00:1122:3344:101::1]:35289 method = GET remote_addr = [fd00:1122:3344:101::d]:63096 req_id = 449c7f31-ac0d-4e96-b331-820dea52f4e8 response_code = 200 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e uri = /0f17ab63-f38a-412f-a653-029795d7304e
22032024-11-27T20:52:45.128ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34989
22042024-11-27T20:52:45.128ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34989 req_id = c734d28d-53c7-43ec-abe1-8819acb043c2 response_code = 200 uri = /vpc-routes
22052024-11-27T20:52:45.171ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e values = ExternalIpGatewayMap { mappings: {} }
22062024-11-27T20:52:45.171ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34989 req_id = 2189459f-c19a-4552-afdb-d52a44df22ba response_code = 204 uri = /eip-gateways
22072024-11-27T20:52:45.211ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48279
22082024-11-27T20:52:45.211ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48279 req_id = 19f579de-579c-40e6-a4df-34f43a8f341d response_code = 200 uri = /v2p
22092024-11-27T20:52:45.218ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 213 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34989 req_id = a948b3ca-b077-40c4-9276-d4737917d81b response_code = 204 uri = /vpc-routes
22102024-11-27T20:52:45.226ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40176
22112024-11-27T20:52:45.226ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22122024-11-27T20:52:45.266ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22132024-11-27T20:52:45.321ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94251 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:40176 req_id = ea9bbb35-1989-4dc4-8e54-3150b6829d61 response_code = 204 uri = /switch-ports
22142024-11-27T20:52:45.321ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40176 req_id = 61037ef8-23ba-4de0-b7db-c58e4f90141f response_code = 200 uri = /network-bootstore-config
22152024-11-27T20:52:46.739ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53721
22162024-11-27T20:52:46.739ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53721 req_id = e49cdb55-d5a7-4405-9501-4005124e738a response_code = 200 uri = /vpc-routes
22172024-11-27T20:52:46.753ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e values = ExternalIpGatewayMap { mappings: {} }
22182024-11-27T20:52:46.753ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53721 req_id = 8dbe905f-9969-4979-bf8d-29d73f9f1c8b response_code = 204 uri = /eip-gateways
22192024-11-27T20:52:46.790ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46439
22202024-11-27T20:52:46.791ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46439 req_id = 40d49dfc-dcbb-4d9f-acc7-918fcbdf791c response_code = 200 uri = /v2p
22212024-11-27T20:52:46.800ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 266 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53721 req_id = b64283ab-6463-47d2-a2b2-448b7fc345e3 response_code = 204 uri = /vpc-routes
22222024-11-27T20:52:46.841ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54776
22232024-11-27T20:52:46.841ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22242024-11-27T20:52:46.884ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22252024-11-27T20:52:46.945ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103718 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:54776 req_id = 4afb6077-6b10-453b-8f36-7005fbb1c653 response_code = 204 uri = /switch-ports
22262024-11-27T20:52:46.945ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54776 req_id = c5917c7c-0935-45bb-b199-45eda4e4731d response_code = 200 uri = /network-bootstore-config
22272024-11-27T20:52:47.323ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35195
22282024-11-27T20:52:47.323ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35195 req_id = 2977dbc1-40e5-464c-800c-449f91f5a1c9 response_code = 200 uri = /vpc-routes
22292024-11-27T20:52:47.337ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e values = ExternalIpGatewayMap { mappings: {} }
22302024-11-27T20:52:47.337ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35195 req_id = db796aaa-bd12-4ba7-8432-4dad3b5c72bd response_code = 204 uri = /eip-gateways
22312024-11-27T20:52:47.345ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 239 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35195 req_id = aa609f15-c981-4053-adcc-ed3d635e3f56 response_code = 204 uri = /vpc-routes
22322024-11-27T20:52:47.446ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60248
22332024-11-27T20:52:47.447ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60248 req_id = 5b020ab5-4d43-4c43-8f1b-9b9df57d01d7 response_code = 200 uri = /v2p
22342024-11-27T20:52:47.504ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40263
22352024-11-27T20:52:47.504ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22362024-11-27T20:52:47.542ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22372024-11-27T20:52:47.601ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97375 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:40263 req_id = 7b4cd953-df3e-4145-aa69-3b404e034a77 response_code = 204 uri = /switch-ports
22382024-11-27T20:52:47.601ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40263 req_id = be32693d-b455-4fd1-b586-c28543bb74f1 response_code = 200 uri = /network-bootstore-config
22392024-11-27T20:53:09.127ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:46585
22402024-11-27T20:53:09.127ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:46585 req_id = 1f81032f-08bf-41e4-84ce-94b0582e7344 response_code = 200 uri = /baseboard
22412024-11-27T20:53:11.481ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7782 local_addr = [fd00:1122:3344:101::1]:35289 method = GET remote_addr = [fd00:1122:3344:101::d]:63096 req_id = 759c47d2-9e49-473c-9ad9-70f39b77b969 response_code = 200 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e uri = /0f17ab63-f38a-412f-a653-029795d7304e
22422024-11-27T20:53:15.225ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46456
22432024-11-27T20:53:15.225ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46456 req_id = 7f427c80-8e55-4834-8cff-830a067aaf28 response_code = 200 uri = /vpc-routes
22442024-11-27T20:53:15.238ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e values = ExternalIpGatewayMap { mappings: {} }
22452024-11-27T20:53:15.238ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46456 req_id = c589ea3e-991e-457e-bd22-e46799496566 response_code = 204 uri = /eip-gateways
22462024-11-27T20:53:15.423ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42802
22472024-11-27T20:53:15.423ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42802 req_id = 15be1aab-7cf8-44e1-afdb-1367eadf5b1c response_code = 200 uri = /v2p
22482024-11-27T20:53:15.427ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 231 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46456 req_id = 341d8198-af0b-4ed5-9425-012969a5458b response_code = 204 uri = /vpc-routes
22492024-11-27T20:53:15.746ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54577
22502024-11-27T20:53:15.746ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22512024-11-27T20:53:15.783ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22522024-11-27T20:53:15.842ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96326 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:54577 req_id = 9a658890-29e4-4ba7-ab16-e0c8df38d2d2 response_code = 204 uri = /switch-ports
22532024-11-27T20:53:15.842ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54577 req_id = ff03b48d-8c08-4448-b455-06ee111325a6 response_code = 200 uri = /network-bootstore-config
22542024-11-27T20:53:16.642ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43355
22552024-11-27T20:53:16.642ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43355 req_id = c2ad605f-c43e-4e79-9502-3c119a7bf4c7 response_code = 200 uri = /vpc-routes
22562024-11-27T20:53:16.709ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e values = ExternalIpGatewayMap { mappings: {} }
22572024-11-27T20:53:16.709ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43355 req_id = f80c1ede-913e-425f-975c-861060f0016d response_code = 204 uri = /eip-gateways
22582024-11-27T20:53:16.720ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 254 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43355 req_id = febe518d-963e-4127-b7b1-f10f2e922acc response_code = 204 uri = /vpc-routes
22592024-11-27T20:53:16.940ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45239
22602024-11-27T20:53:16.941ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45239 req_id = a2b4acbe-820e-412b-a6f5-353ffcd5c961 response_code = 200 uri = /v2p
22612024-11-27T20:53:16.963ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48107
22622024-11-27T20:53:16.963ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22632024-11-27T20:53:17.000ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22642024-11-27T20:53:17.061ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97975 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48107 req_id = b3b03996-165b-47e9-8c5c-f9e61c200520 response_code = 204 uri = /switch-ports
22652024-11-27T20:53:17.064ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48107 req_id = aae89b61-7705-42c1-a2ae-3494e1c039ef response_code = 200 uri = /network-bootstore-config
22662024-11-27T20:53:17.414ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61871
22672024-11-27T20:53:17.414ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61871 req_id = 7f9f991d-c741-417d-b2c4-fe28e8980c2e response_code = 200 uri = /vpc-routes
22682024-11-27T20:53:17.478ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e values = ExternalIpGatewayMap { mappings: {} }
22692024-11-27T20:53:17.478ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61871 req_id = eff0c89a-0eb1-484f-8fba-a1b0ac3ee929 response_code = 204 uri = /eip-gateways
22702024-11-27T20:53:17.488ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 370 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61871 req_id = 551bbddf-d905-444e-a5d4-b89c1cd52c6d response_code = 204 uri = /vpc-routes
22712024-11-27T20:53:17.564ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58891
22722024-11-27T20:53:17.564ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22732024-11-27T20:53:17.604ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22742024-11-27T20:53:17.660ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96036 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:58891 req_id = af48eb68-7956-4cca-b8ef-5c89473709a9 response_code = 204 uri = /switch-ports
22752024-11-27T20:53:17.661ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64168
22762024-11-27T20:53:17.661ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 207 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64168 req_id = 4c0c41e1-ba27-409e-8941-3dfb0c1679b1 response_code = 200 uri = /v2p
22772024-11-27T20:53:17.661ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 352 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58891 req_id = 55d7c92e-b0f7-48e6-b829-5f0ffc93fd58 response_code = 200 uri = /network-bootstore-config
22782024-11-27T20:53:39.161ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:40615
22792024-11-27T20:53:39.162ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:40615 req_id = 074224d5-3e47-4d23-9e4c-5b753429496f response_code = 200 uri = /baseboard
22802024-11-27T20:53:41.482ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7570 local_addr = [fd00:1122:3344:101::1]:35289 method = GET remote_addr = [fd00:1122:3344:101::d]:63096 req_id = 714a2cb9-a69e-4fe7-9fa1-8d20485dd005 response_code = 200 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e uri = /0f17ab63-f38a-412f-a653-029795d7304e
22812024-11-27T20:53:45.188ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64754
22822024-11-27T20:53:45.188ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64754 req_id = 5ba68abb-a23d-491f-842c-3a486fd8ffdd response_code = 200 uri = /vpc-routes
22832024-11-27T20:53:45.229ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e values = ExternalIpGatewayMap { mappings: {} }
22842024-11-27T20:53:45.229ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64754 req_id = 87926b2b-863f-4eba-b43f-4a534d1f16bd response_code = 204 uri = /eip-gateways
22852024-11-27T20:53:45.237ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 281 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64754 req_id = 93c970f8-baa8-4a1a-81fd-7e5963f4c583 response_code = 204 uri = /vpc-routes
22862024-11-27T20:53:45.296ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38991
22872024-11-27T20:53:45.296ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38991 req_id = 33f61b24-5fae-4e7c-bef2-74ba80c80eb3 response_code = 200 uri = /v2p
22882024-11-27T20:53:45.310ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47361
22892024-11-27T20:53:45.311ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22902024-11-27T20:53:45.349ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22912024-11-27T20:53:45.406ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96007 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:47361 req_id = 9f21f2ae-dbeb-4780-a0e0-6aa5514da0f7 response_code = 204 uri = /switch-ports
22922024-11-27T20:53:45.407ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47361 req_id = 86ef796a-dfa6-4740-abfb-2eeedd9ce7eb response_code = 200 uri = /network-bootstore-config
22932024-11-27T20:53:46.687ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44265
22942024-11-27T20:53:46.687ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44265 req_id = 53942ad8-baf5-4de3-96e0-cdc967a4c5d1 response_code = 200 uri = /vpc-routes
22952024-11-27T20:53:46.705ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e values = ExternalIpGatewayMap { mappings: {} }
22962024-11-27T20:53:46.705ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44265 req_id = 383f32b2-1e67-4cd9-83b8-16366c744514 response_code = 204 uri = /eip-gateways
22972024-11-27T20:53:46.714ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 233 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44265 req_id = 429c7d1a-38ce-4fe7-a505-e194fd05b01d response_code = 204 uri = /vpc-routes
22982024-11-27T20:53:46.756ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62590
22992024-11-27T20:53:46.756ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23002024-11-27T20:53:46.795ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23012024-11-27T20:53:46.852ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95627 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:62590 req_id = 528aa131-31a5-496c-a785-94eef9727f78 response_code = 204 uri = /switch-ports
23022024-11-27T20:53:46.852ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42585
23032024-11-27T20:53:46.852ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 189 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42585 req_id = 85d0b98b-1c95-4960-94c9-5bf1ebc2c502 response_code = 200 uri = /v2p
23042024-11-27T20:53:46.853ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 225 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62590 req_id = 50dbd40b-e09e-4389-a389-f7efb537ff54 response_code = 200 uri = /network-bootstore-config
23052024-11-27T20:53:47.321ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36092
23062024-11-27T20:53:47.321ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36092 req_id = 9262292a-85dc-44a3-9fbf-81c6566dab90 response_code = 200 uri = /vpc-routes
23072024-11-27T20:53:47.369ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e values = ExternalIpGatewayMap { mappings: {} }
23082024-11-27T20:53:47.369ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36092 req_id = 2a1eea77-e9c1-4f1a-b3ba-1c817c218a79 response_code = 204 uri = /eip-gateways
23092024-11-27T20:53:47.378ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 216 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36092 req_id = c67c9e75-8d77-4cdd-8a21-d4f23b139066 response_code = 204 uri = /vpc-routes
23102024-11-27T20:53:47.416ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42420
23112024-11-27T20:53:47.416ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23122024-11-27T20:53:47.454ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23132024-11-27T20:53:47.510ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94211 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:42420 req_id = b6615273-bc09-46ff-a56d-e1dec7dc8406 response_code = 204 uri = /switch-ports
23142024-11-27T20:53:47.510ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45645
23152024-11-27T20:53:47.511ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 190 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45645 req_id = b9ba90ad-82f6-4a9a-853e-80f8f7bf065d response_code = 200 uri = /v2p
23162024-11-27T20:53:47.511ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 245 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42420 req_id = 7feb923c-b066-4f3a-bed3-6cbd5c2ac055 response_code = 200 uri = /network-bootstore-config
23172024-11-27T20:54:09.194ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:46453
23182024-11-27T20:54:09.194ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:46453 req_id = f0b5b2f9-b041-419a-b87c-68864e2c2e69 response_code = 200 uri = /baseboard
23192024-11-27T20:54:11.482ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7493 local_addr = [fd00:1122:3344:101::1]:35289 method = GET remote_addr = [fd00:1122:3344:101::d]:63096 req_id = 65a15b9a-27c5-4505-9ec5-9bfe40436af9 response_code = 200 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e uri = /0f17ab63-f38a-412f-a653-029795d7304e
23202024-11-27T20:54:15.299ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37609
23212024-11-27T20:54:15.300ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37609 req_id = e0c0dd44-62c4-438b-9321-d17c8137726b response_code = 200 uri = /v2p
23222024-11-27T20:54:15.370ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35878
23232024-11-27T20:54:15.370ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35878 req_id = 936780cc-e83f-4045-b216-d98c755063c9 response_code = 200 uri = /vpc-routes
23242024-11-27T20:54:15.385ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e values = ExternalIpGatewayMap { mappings: {} }
23252024-11-27T20:54:15.385ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35878 req_id = 9898a718-9691-4896-ac65-9c45202b5cf5 response_code = 204 uri = /eip-gateways
23262024-11-27T20:54:15.393ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 254 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35878 req_id = 75ca73c6-d502-4240-ab53-d1b6e1ee1f99 response_code = 204 uri = /vpc-routes
23272024-11-27T20:54:15.464ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57637
23282024-11-27T20:54:15.464ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23292024-11-27T20:54:15.503ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23302024-11-27T20:54:15.556ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91524 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:57637 req_id = 6129013e-06c0-498b-8216-da7186a4f0b5 response_code = 204 uri = /switch-ports
23312024-11-27T20:54:15.556ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 210 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57637 req_id = e2711eb2-19cd-41e4-a4da-a4a3293223ff response_code = 200 uri = /network-bootstore-config
23322024-11-27T20:54:16.811ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57602
23332024-11-27T20:54:16.811ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57602 req_id = a6d95760-0a77-4f9f-a809-1aba6dc383c6 response_code = 200 uri = /vpc-routes
23342024-11-27T20:54:16.861ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e values = ExternalIpGatewayMap { mappings: {} }
23352024-11-27T20:54:16.861ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57602 req_id = 65c5b47a-60cb-4e7e-98b7-08c13fd79c51 response_code = 204 uri = /eip-gateways
23362024-11-27T20:54:16.869ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 212 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57602 req_id = 23c2beef-ac84-44fa-bee6-5df7b4ab58a6 response_code = 204 uri = /vpc-routes
23372024-11-27T20:54:16.923ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58525
23382024-11-27T20:54:16.924ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58525 req_id = 1e3b28b7-3997-49c7-9f19-f745e53df2b2 response_code = 200 uri = /v2p
23392024-11-27T20:54:16.953ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55015
23402024-11-27T20:54:16.953ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23412024-11-27T20:54:16.993ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23422024-11-27T20:54:17.056ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102574 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:55015 req_id = 295c6043-bbca-43bd-a6fb-de39b1f99c15 response_code = 204 uri = /switch-ports
23432024-11-27T20:54:17.056ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55015 req_id = 77f6b365-573f-4e2a-ab81-eb0eb8feafa8 response_code = 200 uri = /network-bootstore-config
23442024-11-27T20:54:17.560ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52266
23452024-11-27T20:54:17.560ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52266 req_id = d8d03d43-9f77-49d1-8f61-75b076b902ad response_code = 200 uri = /vpc-routes
23462024-11-27T20:54:17.578ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60487
23472024-11-27T20:54:17.578ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60487 req_id = 7bca56ee-a12d-4395-84e7-352fb0e144a5 response_code = 200 uri = /v2p
23482024-11-27T20:54:17.608ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e values = ExternalIpGatewayMap { mappings: {} }
23492024-11-27T20:54:17.608ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52266 req_id = 8485c581-7128-4cd6-be74-6a325c13bc01 response_code = 204 uri = /eip-gateways
23502024-11-27T20:54:17.615ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 189 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52266 req_id = 1a5fe01a-edc5-4167-8c1b-e2754ab9b5d4 response_code = 204 uri = /vpc-routes
23512024-11-27T20:54:17.656ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45294
23522024-11-27T20:54:17.656ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23532024-11-27T20:54:17.693ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23542024-11-27T20:54:17.748ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91975 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:45294 req_id = e791b732-3cba-4d2a-b7aa-39ecc0175955 response_code = 204 uri = /switch-ports
23552024-11-27T20:54:17.748ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45294 req_id = da29c764-97c3-424b-b811-8b2f9b00e0fa response_code = 200 uri = /network-bootstore-config
23562024-11-27T20:54:39.226ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:58675
23572024-11-27T20:54:39.226ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:58675 req_id = 9d8ae63e-7799-4478-81a6-2cb806a9be92 response_code = 200 uri = /baseboard
23582024-11-27T20:54:41.483ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7429 local_addr = [fd00:1122:3344:101::1]:35289 method = GET remote_addr = [fd00:1122:3344:101::d]:63096 req_id = c1bc1cd9-323d-4528-8c97-63297616eda6 response_code = 200 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e uri = /0f17ab63-f38a-412f-a653-029795d7304e
23592024-11-27T20:54:45.058ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:197
23602024-11-27T20:54:45.058ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
23612024-11-27T20:54:45.088ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35145
23622024-11-27T20:54:45.089ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35145 req_id = f71a0bc2-e945-4d17-b101-e481f5419170 response_code = 200 uri = /vpc-routes
23632024-11-27T20:54:45.098ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1953, tv_nsec: 470654622 } time_to_next_cleanup = 599.99999984s
23642024-11-27T20:54:45.147ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e values = ExternalIpGatewayMap { mappings: {} }
23652024-11-27T20:54:45.147ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35145 req_id = 3bb7403c-a91b-4aef-bbe2-75646a6a9f47 response_code = 204 uri = /eip-gateways
23662024-11-27T20:54:45.239ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55803
23672024-11-27T20:54:45.239ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 241 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55803 req_id = 95b417e9-d649-4b10-9cd1-60516f49c0d6 response_code = 200 uri = /v2p
23682024-11-27T20:54:45.253ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 300 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35145 req_id = 41901a83-d64d-42a6-84ce-8460538a000b response_code = 204 uri = /vpc-routes
23692024-11-27T20:54:45.333ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63193
23702024-11-27T20:54:45.333ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23712024-11-27T20:54:45.385ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23722024-11-27T20:54:45.444ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110100 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:63193 req_id = 8e1c1934-bfc3-4fbb-95c0-84528f1abdfd response_code = 204 uri = /switch-ports
23732024-11-27T20:54:45.444ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63193 req_id = 62c9dc38-bbd9-466a-bf19-24855e247d52 response_code = 200 uri = /network-bootstore-config
23742024-11-27T20:54:46.675ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34721
23752024-11-27T20:54:46.675ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34721 req_id = b67f39ea-78fe-4a72-b135-fe5e508d0097 response_code = 200 uri = /vpc-routes
23762024-11-27T20:54:46.717ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e values = ExternalIpGatewayMap { mappings: {} }
23772024-11-27T20:54:46.718ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34721 req_id = d8d5bc09-622a-43e5-9819-217dd73b6b23 response_code = 204 uri = /eip-gateways
23782024-11-27T20:54:46.727ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 244 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34721 req_id = a3b57787-af7c-45b3-9a1c-b711d38e533e response_code = 204 uri = /vpc-routes
23792024-11-27T20:54:46.759ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62013
23802024-11-27T20:54:46.760ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62013 req_id = f69996fd-0e46-453f-b3d0-1e3119611010 response_code = 200 uri = /v2p
23812024-11-27T20:54:46.825ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48826
23822024-11-27T20:54:46.825ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23832024-11-27T20:54:46.865ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23842024-11-27T20:54:46.927ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102095 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48826 req_id = 592aabe6-6518-4d4d-be22-91a0979dbb53 response_code = 204 uri = /switch-ports
23852024-11-27T20:54:46.927ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48826 req_id = a5cbc52e-ada3-44e6-a67e-ad5b4542111b response_code = 200 uri = /network-bootstore-config
23862024-11-27T20:54:47.309ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63838
23872024-11-27T20:54:47.309ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63838 req_id = a394734d-7f25-4c37-8267-155ffbf75a6d response_code = 200 uri = /vpc-routes
23882024-11-27T20:54:47.349ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e values = ExternalIpGatewayMap { mappings: {} }
23892024-11-27T20:54:47.349ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63838 req_id = 8d9b9d87-b115-44ad-ad2a-7ea407caf92e response_code = 204 uri = /eip-gateways
23902024-11-27T20:54:47.359ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 220 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63838 req_id = 237e11ab-860a-43ec-8e9e-dfe0e8c937e2 response_code = 204 uri = /vpc-routes
23912024-11-27T20:54:47.448ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43991
23922024-11-27T20:54:47.448ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43991 req_id = e78868ae-db91-4500-bc46-ebf8c1070e20 response_code = 200 uri = /v2p
23932024-11-27T20:54:47.493ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61334
23942024-11-27T20:54:47.493ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23952024-11-27T20:54:47.533ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23962024-11-27T20:54:47.585ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91907 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:61334 req_id = 62e7e998-1aa8-4163-a8bb-d5d55a772852 response_code = 204 uri = /switch-ports
23972024-11-27T20:54:47.585ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61334 req_id = 17ccf0f2-2288-49f9-8e5c-f3a4c63f8275 response_code = 200 uri = /network-bootstore-config
23982024-11-27T20:54:59.491ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
23992024-11-27T20:55:09.259ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:35535
24002024-11-27T20:55:09.259ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:35535 req_id = eee5ebec-0c98-4b09-bb5a-f00008738351 response_code = 200 uri = /baseboard
24012024-11-27T20:55:11.484ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8514 local_addr = [fd00:1122:3344:101::1]:35289 method = GET remote_addr = [fd00:1122:3344:101::d]:63096 req_id = 7ca5c119-d2d7-41f2-8038-2283cada3024 response_code = 200 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e uri = /0f17ab63-f38a-412f-a653-029795d7304e
24022024-11-27T20:55:15.220ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62876
24032024-11-27T20:55:15.220ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62876 req_id = 12256774-70cd-4ce8-abbb-de054db40801 response_code = 200 uri = /vpc-routes
24042024-11-27T20:55:15.238ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e values = ExternalIpGatewayMap { mappings: {} }
24052024-11-27T20:55:15.238ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62876 req_id = b9b841cd-029e-4f0b-b451-6471bcf6ddfa response_code = 204 uri = /eip-gateways
24062024-11-27T20:55:15.481ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50661
24072024-11-27T20:55:15.481ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50661 req_id = 9fad9ca4-2d8e-454e-924f-73a1921ea8c9 response_code = 200 uri = /v2p
24082024-11-27T20:55:15.485ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 231 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62876 req_id = fe4879c0-36da-4850-b637-d033a9873bde response_code = 204 uri = /vpc-routes
24092024-11-27T20:55:15.580ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41805
24102024-11-27T20:55:15.581ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24112024-11-27T20:55:15.618ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24122024-11-27T20:55:15.677ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96276 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:41805 req_id = 9be6d71b-e89f-48dc-9379-3fc00c51a9a6 response_code = 204 uri = /switch-ports
24132024-11-27T20:55:15.677ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 208 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41805 req_id = 00564e1b-d657-4d97-8c2d-be8dc576250d response_code = 200 uri = /network-bootstore-config
24142024-11-27T20:55:16.964ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41545
24152024-11-27T20:55:16.964ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41545 req_id = 4206a927-e4c7-4454-9452-40a61a667494 response_code = 200 uri = /vpc-routes
24162024-11-27T20:55:16.994ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33197
24172024-11-27T20:55:16.994ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 169 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33197 req_id = b9c789c0-827c-4e29-9e6e-942744b170d5 response_code = 200 uri = /v2p
24182024-11-27T20:55:17.052ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e values = ExternalIpGatewayMap { mappings: {} }
24192024-11-27T20:55:17.052ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41545 req_id = e4207e96-0c7e-4dec-b093-72406b40722c response_code = 204 uri = /eip-gateways
24202024-11-27T20:55:17.065ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 278 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41545 req_id = 2d1e9060-58e4-43e2-b73c-d9f8c9736592 response_code = 204 uri = /vpc-routes
24212024-11-27T20:55:17.091ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54696
24222024-11-27T20:55:17.091ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24232024-11-27T20:55:17.154ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24242024-11-27T20:55:17.236ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 144917 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:54696 req_id = 176a017d-9a98-4349-9dfc-7d19bce67a0d response_code = 204 uri = /switch-ports
24252024-11-27T20:55:17.237ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54696 req_id = 42b8720a-03bc-43f2-bcad-8392d79e4ad9 response_code = 200 uri = /network-bootstore-config
24262024-11-27T20:55:17.348ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48465
24272024-11-27T20:55:17.349ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48465 req_id = 5e402572-dc90-406d-992f-bdf07e4cdeee response_code = 200 uri = /vpc-routes
24282024-11-27T20:55:17.400ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e values = ExternalIpGatewayMap { mappings: {} }
24292024-11-27T20:55:17.400ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48465 req_id = 8b0734fa-9ea5-4261-ad2c-b63769b386b9 response_code = 204 uri = /eip-gateways
24302024-11-27T20:55:17.415ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 267 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48465 req_id = 5e6587a7-f195-45b8-88bf-25ff47a314b4 response_code = 204 uri = /vpc-routes
24312024-11-27T20:55:17.558ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41646
24322024-11-27T20:55:17.558ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 172 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41646 req_id = 443d4034-e116-40e5-84eb-0ae96e741fba response_code = 200 uri = /v2p
24332024-11-27T20:55:17.614ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56611
24342024-11-27T20:55:17.614ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24352024-11-27T20:55:17.655ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24362024-11-27T20:55:17.714ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99497 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:56611 req_id = d37a6527-7c15-4ec8-9c9a-961056322c7e response_code = 204 uri = /switch-ports
24372024-11-27T20:55:17.714ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56611 req_id = 784aaa0e-fd4f-485d-959c-3c33310daa4a response_code = 200 uri = /network-bootstore-config
24382024-11-27T20:55:39.294ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53052
24392024-11-27T20:55:39.295ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53052 req_id = 5efb895e-a3ca-4d1d-bae6-e7624c08f456 response_code = 200 uri = /baseboard
24402024-11-27T20:55:41.483ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7520 local_addr = [fd00:1122:3344:101::1]:35289 method = GET remote_addr = [fd00:1122:3344:101::d]:63096 req_id = 8f6a9377-eb84-4fd3-a50b-7f85eed149c5 response_code = 200 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e uri = /0f17ab63-f38a-412f-a653-029795d7304e
24412024-11-27T20:55:45.114ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34255
24422024-11-27T20:55:45.114ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34255 req_id = 823729eb-5cd7-4278-9ada-016bf4cf4db9 response_code = 200 uri = /vpc-routes
24432024-11-27T20:55:45.164ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e values = ExternalIpGatewayMap { mappings: {} }
24442024-11-27T20:55:45.164ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34255 req_id = 3bd9411b-7e0b-474a-83d2-cb4ecb31ed43 response_code = 204 uri = /eip-gateways
24452024-11-27T20:55:45.173ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 251 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34255 req_id = ccd98fc1-0fbd-4919-b816-58c208760eaa response_code = 204 uri = /vpc-routes
24462024-11-27T20:55:45.215ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43301
24472024-11-27T20:55:45.215ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43301 req_id = b847818f-7a4b-4a73-abb4-fa2627efdb8a response_code = 200 uri = /v2p
24482024-11-27T20:55:45.260ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57648
24492024-11-27T20:55:45.260ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24502024-11-27T20:55:45.299ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24512024-11-27T20:55:45.355ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95585 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:57648 req_id = e18aa346-0b38-41af-9565-2e02e56b2437 response_code = 204 uri = /switch-ports
24522024-11-27T20:55:45.356ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57648 req_id = e6620013-54d6-4197-9482-74df0207f079 response_code = 200 uri = /network-bootstore-config
24532024-11-27T20:55:46.653ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63687
24542024-11-27T20:55:46.653ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63687 req_id = d6cf4e04-7f6c-4fda-b035-433166241992 response_code = 200 uri = /vpc-routes
24552024-11-27T20:55:46.667ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e values = ExternalIpGatewayMap { mappings: {} }
24562024-11-27T20:55:46.667ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63687 req_id = c19c41c6-8b99-4bf9-b9da-7c974f6af081 response_code = 204 uri = /eip-gateways
24572024-11-27T20:55:46.676ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 180 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63687 req_id = 0d7e308a-dc94-4043-9618-396e34866721 response_code = 204 uri = /vpc-routes
24582024-11-27T20:55:46.749ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62101
24592024-11-27T20:55:46.749ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62101 req_id = e99fb5d7-5496-4d61-b182-c11a87729ea0 response_code = 200 uri = /v2p
24602024-11-27T20:55:46.750ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35254
24612024-11-27T20:55:46.750ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24622024-11-27T20:55:46.788ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24632024-11-27T20:55:46.841ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90496 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:35254 req_id = d7172020-e0db-48ee-a96e-96ebc259b7ae response_code = 204 uri = /switch-ports
24642024-11-27T20:55:46.841ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35254 req_id = e3f95b6d-a6a5-4183-a568-232a2ee36529 response_code = 200 uri = /network-bootstore-config
24652024-11-27T20:55:47.392ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54585
24662024-11-27T20:55:47.392ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54585 req_id = aa40e37e-249a-443f-921e-e56f1278875d response_code = 200 uri = /vpc-routes
24672024-11-27T20:55:47.413ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33227
24682024-11-27T20:55:47.414ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33227 req_id = 93dd3727-5144-4681-94cd-831f4e564579 response_code = 200 uri = /v2p
24692024-11-27T20:55:47.432ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e values = ExternalIpGatewayMap { mappings: {} }
24702024-11-27T20:55:47.432ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54585 req_id = 612daea1-7fc1-4227-bb7d-0d2b9ad5b5cc response_code = 204 uri = /eip-gateways
24712024-11-27T20:55:47.442ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 274 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54585 req_id = 883921c9-ff57-4a96-9487-f1fd4d58aaad response_code = 204 uri = /vpc-routes
24722024-11-27T20:55:47.467ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65506
24732024-11-27T20:55:47.467ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24742024-11-27T20:55:47.506ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24752024-11-27T20:55:47.564ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97242 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:65506 req_id = e53eabfd-0be7-45a1-bc02-004277e38402 response_code = 204 uri = /switch-ports
24762024-11-27T20:55:47.564ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65506 req_id = 83ae3f4b-9fec-4516-b016-40029397efb6 response_code = 200 uri = /network-bootstore-config
24772024-11-27T20:56:09.328ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:47505
24782024-11-27T20:56:09.328ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:47505 req_id = b7d0157b-0727-41c5-b5e1-530fb68ec26f response_code = 200 uri = /baseboard
24792024-11-27T20:56:11.484ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7765 local_addr = [fd00:1122:3344:101::1]:35289 method = GET remote_addr = [fd00:1122:3344:101::d]:63096 req_id = f8dc22e5-59da-4c50-a180-f96c52527de3 response_code = 200 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e uri = /0f17ab63-f38a-412f-a653-029795d7304e
24802024-11-27T20:56:15.216ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58347
24812024-11-27T20:56:15.216ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58347 req_id = b07b94d5-96cc-4337-9fee-12b8ddedf215 response_code = 200 uri = /vpc-routes
24822024-11-27T20:56:15.238ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e values = ExternalIpGatewayMap { mappings: {} }
24832024-11-27T20:56:15.238ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58347 req_id = dcf2cdb9-5cc7-4380-ad2b-bee05cd95676 response_code = 204 uri = /eip-gateways
24842024-11-27T20:56:15.249ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 277 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58347 req_id = 650ee55b-8ca0-4ad5-87b2-bc64d000c4f6 response_code = 204 uri = /vpc-routes
24852024-11-27T20:56:15.375ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37438
24862024-11-27T20:56:15.376ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37438 req_id = 3abf21ba-0a42-42de-aec5-7bf471ea0ded response_code = 200 uri = /v2p
24872024-11-27T20:56:15.419ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44575
24882024-11-27T20:56:15.420ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24892024-11-27T20:56:15.458ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24902024-11-27T20:56:15.512ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92811 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:44575 req_id = 1f549423-4884-4bdf-8672-2dbc5d2f9a84 response_code = 204 uri = /switch-ports
24912024-11-27T20:56:15.513ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44575 req_id = be7eefd8-f588-43ae-8f4d-e718efd7732a response_code = 200 uri = /network-bootstore-config
24922024-11-27T20:56:16.770ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43321
24932024-11-27T20:56:16.770ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43321 req_id = aa5db350-d5e8-4983-87e9-4b78578f3a75 response_code = 200 uri = /vpc-routes
24942024-11-27T20:56:16.785ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e values = ExternalIpGatewayMap { mappings: {} }
24952024-11-27T20:56:16.785ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43321 req_id = 047936ec-26c8-4e71-b1d2-9e2a4a6a3708 response_code = 204 uri = /eip-gateways
24962024-11-27T20:56:16.889ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37585
24972024-11-27T20:56:16.889ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37585 req_id = b1a6a46b-3ac8-49f9-a278-61ca6d2a4a3c response_code = 200 uri = /v2p
24982024-11-27T20:56:16.896ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 185 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43321 req_id = 303643d5-f640-4817-9c78-71ddb74cd86c response_code = 204 uri = /vpc-routes
24992024-11-27T20:56:17.140ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40580
25002024-11-27T20:56:17.140ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25012024-11-27T20:56:17.200ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25022024-11-27T20:56:17.264ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124276 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:40580 req_id = b74c28cd-7bde-47a0-a474-45e39ae29cad response_code = 204 uri = /switch-ports
25032024-11-27T20:56:17.264ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40580 req_id = 222bca06-546f-40c6-a5fc-09ba2461377d response_code = 200 uri = /network-bootstore-config
25042024-11-27T20:56:17.325ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55369
25052024-11-27T20:56:17.325ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55369 req_id = de82e98f-b641-4600-9c62-283c67a3f1ba response_code = 200 uri = /vpc-routes
25062024-11-27T20:56:17.383ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e values = ExternalIpGatewayMap { mappings: {} }
25072024-11-27T20:56:17.383ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55369 req_id = 7e77c1d2-0c98-44bb-9e19-2a63767e30a4 response_code = 204 uri = /eip-gateways
25082024-11-27T20:56:17.393ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 282 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55369 req_id = 8e67b6f1-d857-48a8-bcb5-953dde0e83b2 response_code = 204 uri = /vpc-routes
25092024-11-27T20:56:17.664ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57191
25102024-11-27T20:56:17.664ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57191 req_id = 6ae11233-7c7f-4185-9347-f7a4beeb9e25 response_code = 200 uri = /v2p
25112024-11-27T20:56:17.696ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47061
25122024-11-27T20:56:17.696ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25132024-11-27T20:56:17.733ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25142024-11-27T20:56:17.786ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90735 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:47061 req_id = bdec3187-ed15-4870-9a92-0319c88be9d0 response_code = 204 uri = /switch-ports
25152024-11-27T20:56:17.787ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47061 req_id = 187af2fc-5b75-4f8e-b87c-20379c0a819f response_code = 200 uri = /network-bootstore-config
25162024-11-27T20:56:39.366ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:55209
25172024-11-27T20:56:39.366ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:55209 req_id = 9a6adea7-66cf-482e-b059-2f41754d7121 response_code = 200 uri = /baseboard
25182024-11-27T20:56:41.484ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7211 local_addr = [fd00:1122:3344:101::1]:35289 method = GET remote_addr = [fd00:1122:3344:101::d]:63096 req_id = 4cae18b4-af8d-4320-b9d6-51576cba73b7 response_code = 200 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e uri = /0f17ab63-f38a-412f-a653-029795d7304e
25192024-11-27T20:56:45.110ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42842
25202024-11-27T20:56:45.111ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42842 req_id = c0e6d8c2-8f03-4e81-8472-d0534b41a5bf response_code = 200 uri = /vpc-routes
25212024-11-27T20:56:45.130ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34459
25222024-11-27T20:56:45.130ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34459 req_id = a7c85a08-6069-4d5b-8937-9f47c138d5c9 response_code = 200 uri = /v2p
25232024-11-27T20:56:45.169ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e values = ExternalIpGatewayMap { mappings: {} }
25242024-11-27T20:56:45.169ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42842 req_id = 99245ac8-3b6f-42ca-861b-d021afc17a1b response_code = 204 uri = /eip-gateways
25252024-11-27T20:56:45.177ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 239 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42842 req_id = ec2ccf7c-ebd3-4794-84c9-41c3db88644e response_code = 204 uri = /vpc-routes
25262024-11-27T20:56:45.275ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41282
25272024-11-27T20:56:45.275ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25282024-11-27T20:56:45.313ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25292024-11-27T20:56:45.364ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88945 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:41282 req_id = 94c9e307-9d19-40c4-b3d6-632ba84fa5e0 response_code = 204 uri = /switch-ports
25302024-11-27T20:56:45.365ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41282 req_id = 930c7257-6c36-42c7-b927-1719d96b3f7b response_code = 200 uri = /network-bootstore-config
25312024-11-27T20:56:46.676ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35920
25322024-11-27T20:56:46.677ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35920 req_id = 0e781e62-2b3d-477f-8f6f-0f990d8d22e0 response_code = 200 uri = /vpc-routes
25332024-11-27T20:56:46.717ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e values = ExternalIpGatewayMap { mappings: {} }
25342024-11-27T20:56:46.717ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35920 req_id = 602c9c9d-00f4-4948-ba5a-89e7015fd7dc response_code = 204 uri = /eip-gateways
25352024-11-27T20:56:46.726ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35920 req_id = a97c706c-772c-4c14-88f5-32d97bb6d013 response_code = 204 uri = /vpc-routes
25362024-11-27T20:56:46.752ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54919
25372024-11-27T20:56:46.752ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54919 req_id = 9debcc24-6b14-4b5c-b72d-27f0fea7dc32 response_code = 200 uri = /v2p
25382024-11-27T20:56:46.820ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43538
25392024-11-27T20:56:46.820ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25402024-11-27T20:56:46.858ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25412024-11-27T20:56:46.917ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96446 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:43538 req_id = 74933515-c5ba-4e7e-97d1-4a52879a0027 response_code = 204 uri = /switch-ports
25422024-11-27T20:56:46.917ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43538 req_id = b823195b-acaf-4b21-8b74-1e0e54d23217 response_code = 200 uri = /network-bootstore-config
25432024-11-27T20:56:47.307ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45215
25442024-11-27T20:56:47.308ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45215 req_id = 4ce396fe-808d-4978-b14c-2943448285ad response_code = 200 uri = /vpc-routes
25452024-11-27T20:56:47.351ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e values = ExternalIpGatewayMap { mappings: {} }
25462024-11-27T20:56:47.351ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45215 req_id = 2ff88be9-9b85-434d-9ae0-42ba5a0964ee response_code = 204 uri = /eip-gateways
25472024-11-27T20:56:47.361ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 261 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45215 req_id = 23bb8010-00b1-4c29-b87c-1b6895e1272d response_code = 204 uri = /vpc-routes
25482024-11-27T20:56:47.370ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44673
25492024-11-27T20:56:47.370ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44673 req_id = 94ccd70c-f5fd-4c1a-bf63-d541d163fd12 response_code = 200 uri = /v2p
25502024-11-27T20:56:47.420ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50110
25512024-11-27T20:56:47.420ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25522024-11-27T20:56:47.454ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25532024-11-27T20:56:47.507ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87556 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:50110 req_id = 6cfe9bee-a2e5-4ce6-a68f-b738d87c1fa7 response_code = 204 uri = /switch-ports
25542024-11-27T20:56:47.508ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50110 req_id = b42b0fe8-6e7e-4061-846d-7cc13404a8a9 response_code = 200 uri = /network-bootstore-config
25552024-11-27T20:57:09.399ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:50126
25562024-11-27T20:57:09.399ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:50126 req_id = 02705f53-504b-4da8-9ad2-64ab68702da8 response_code = 200 uri = /baseboard
25572024-11-27T20:57:11.485ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8019 local_addr = [fd00:1122:3344:101::1]:35289 method = GET remote_addr = [fd00:1122:3344:101::d]:63096 req_id = c6f603a9-1b77-4005-8728-b46a0a4183a5 response_code = 200 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e uri = /0f17ab63-f38a-412f-a653-029795d7304e
25582024-11-27T20:57:15.375ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65463
25592024-11-27T20:57:15.375ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65463 req_id = 6f6c3a86-d3ad-4e48-8eb9-b9c5b0ebca6f response_code = 200 uri = /vpc-routes
25602024-11-27T20:57:15.418ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e values = ExternalIpGatewayMap { mappings: {} }
25612024-11-27T20:57:15.418ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:65463 req_id = 7b02a1b2-fdc2-4567-925c-aff5bf97df9c response_code = 204 uri = /eip-gateways
25622024-11-27T20:57:15.428ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 258 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:65463 req_id = ce006ee0-2a88-475e-9a98-bd49aebd75be response_code = 204 uri = /vpc-routes
25632024-11-27T20:57:15.502ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55772
25642024-11-27T20:57:15.502ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55772 req_id = aa7cda04-64c1-411a-9438-0ab0060d7ea2 response_code = 200 uri = /v2p
25652024-11-27T20:57:15.546ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49925
25662024-11-27T20:57:15.546ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25672024-11-27T20:57:15.585ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25682024-11-27T20:57:15.646ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100406 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:49925 req_id = d322b673-3efd-4614-b8fd-057253be5679 response_code = 204 uri = /switch-ports
25692024-11-27T20:57:15.646ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48623
25702024-11-27T20:57:15.647ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38228
25712024-11-27T20:57:15.647ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
25722024-11-27T20:57:15.647ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
25732024-11-27T20:57:15.647ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/71828714-15a3-4f82-918a-cbabee4531fa/config/omicron-zones.json file = common/src/ledger.rs:177
25742024-11-27T20:57:15.647ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 309 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49925 req_id = a7c6cbf6-f40e-40fd-bd6f-b9f5cc79faa6 response_code = 200 uri = /network-bootstore-config
25752024-11-27T20:57:15.647ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 81c35812-3316-445b-a6f6-3aa12cbc0141, kind: Service { id: d13b0217-c0a6-4eaa-8098-4068c753e7f8 }, name: Name("external-dns-d13b0217-c0a6-4eaa-8098-4068c753e7f8"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 26])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8c3b27b2-7f68-49b4-b3f3-4525d795f2c5, kind: Service { id: ef029baa-d573-494d-9698-1690c9c57399 }, name: Name("external-dns-ef029baa-d573-494d-9698-1690c9c57399"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 142, 128])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 07c10885-dd61-4583-8ce1-a7179a48d3fa, kind: Service { id: 77818842-4ce3-4fbc-b24e-bfe02c4a0922 }, name: Name("nexus-77818842-4ce3-4fbc-b24e-bfe02c4a0922"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 187, 182])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7ec37840-3b01-4078-b834-03dbd8adf8dd, kind: Service { id: fb7409be-e1e9-41dc-ba28-37cdd7b9c8d6 }, name: Name("nexus-fb7409be-e1e9-41dc-ba28-37cdd7b9c8d6"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 220])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b9a4498e-d802-4925-8101-8f18c4e4f305, kind: Service { id: ae973228-9cf8-450f-8ac4-7d740fc62ad6 }, name: Name("nexus-ae973228-9cf8-450f-8ac4-7d740fc62ad6"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 168, 190])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
25762024-11-27T20:57:15.647ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25772024-11-27T20:57:15.647ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25782024-11-27T20:57:15.647ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25792024-11-27T20:57:15.647ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25802024-11-27T20:57:15.647ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25812024-11-27T20:57:15.647ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
25822024-11-27T20:57:15.647ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 563 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48623 req_id = a7306588-dc3b-43e9-b016-a0e96d241c6d response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
25832024-11-27T20:57:15.647ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/f58570a3-13b1-4b0c-ac0c-e8a0652f7ced/config/omicron-zones.json file = common/src/ledger.rs:177
25842024-11-27T20:57:15.660ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ff99775c-fb56-419e-aef8-9c8117494384 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
25852024-11-27T20:57:15.660ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_ff99775c-fb56-419e-aef8-9c8117494384
25862024-11-27T20:57:15.682ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 54375e11-a569-4c64-8c24-c6dfba089c32 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
25872024-11-27T20:57:15.682ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_54375e11-a569-4c64-8c24-c6dfba089c32
25882024-11-27T20:57:15.701ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a7344162-b09f-4fab-9022-409ee4ca9964 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
25892024-11-27T20:57:15.701ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_a7344162-b09f-4fab-9022-409ee4ca9964
25902024-11-27T20:57:15.721ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 37e32039-a8dd-4947-8c19-c28ef6335cf2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
25912024-11-27T20:57:15.721ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_37e32039-a8dd-4947-8c19-c28ef6335cf2
25922024-11-27T20:57:15.739ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c3225150-4706-46cb-9890-c4e173582acb (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
25932024-11-27T20:57:15.739ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_c3225150-4706-46cb-9890-c4e173582acb
25942024-11-27T20:57:15.762ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4393a6b4-1740-4ce1-b6df-2d78fb8128b9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
25952024-11-27T20:57:15.762ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_4393a6b4-1740-4ce1-b6df-2d78fb8128b9
25962024-11-27T20:57:15.779ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: bd1e9859-f391-4410-ac6a-94d84a761bf8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
25972024-11-27T20:57:15.779ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_bd1e9859-f391-4410-ac6a-94d84a761bf8
25982024-11-27T20:57:15.797ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f94a6d1b-9178-4c13-817f-a77b6a6cd97e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
25992024-11-27T20:57:15.798ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_f94a6d1b-9178-4c13-817f-a77b6a6cd97e
26002024-11-27T20:57:15.815ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 0b66aa68-555b-43d3-99fd-94013fc7fb74 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26012024-11-27T20:57:15.815ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_0b66aa68-555b-43d3-99fd-94013fc7fb74
26022024-11-27T20:57:15.825ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 178179 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38228 req_id = 157053f3-3c72-4537-95c3-0288a1ca09e0 response_code = 200 uri = /inventory
26032024-11-27T20:57:16.808ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49954
26042024-11-27T20:57:16.808ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49954 req_id = dcd6acff-5846-4763-9151-d71255e4d3a3 response_code = 200 uri = /vpc-routes
26052024-11-27T20:57:16.864ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e values = ExternalIpGatewayMap { mappings: {} }
26062024-11-27T20:57:16.864ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49954 req_id = 970c7a1d-4631-41be-a6f6-e4e53c8f5db5 response_code = 204 uri = /eip-gateways
26072024-11-27T20:57:16.878ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 287 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49954 req_id = 0b4396c8-4c9b-4a96-8f9f-d1009386534f response_code = 204 uri = /vpc-routes
26082024-11-27T20:57:17.074ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63954
26092024-11-27T20:57:17.074ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63954 req_id = 95a39cf8-70e3-4f11-90c2-f3c6bcf9016f response_code = 200 uri = /v2p
26102024-11-27T20:57:17.157ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38585
26112024-11-27T20:57:17.157ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
26122024-11-27T20:57:17.158ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
26132024-11-27T20:57:17.158ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/71828714-15a3-4f82-918a-cbabee4531fa/config/omicron-zones.json file = common/src/ledger.rs:177
26142024-11-27T20:57:17.158ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/f58570a3-13b1-4b0c-ac0c-e8a0652f7ced/config/omicron-zones.json file = common/src/ledger.rs:177
26152024-11-27T20:57:17.174ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ff99775c-fb56-419e-aef8-9c8117494384 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26162024-11-27T20:57:17.174ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50698
26172024-11-27T20:57:17.174ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_ff99775c-fb56-419e-aef8-9c8117494384
26182024-11-27T20:57:17.181ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26192024-11-27T20:57:17.218ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 54375e11-a569-4c64-8c24-c6dfba089c32 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26202024-11-27T20:57:17.218ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_54375e11-a569-4c64-8c24-c6dfba089c32
26212024-11-27T20:57:17.245ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26222024-11-27T20:57:17.255ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a7344162-b09f-4fab-9022-409ee4ca9964 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26232024-11-27T20:57:17.255ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_a7344162-b09f-4fab-9022-409ee4ca9964
26242024-11-27T20:57:17.273ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52464
26252024-11-27T20:57:17.274ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 81c35812-3316-445b-a6f6-3aa12cbc0141, kind: Service { id: d13b0217-c0a6-4eaa-8098-4068c753e7f8 }, name: Name("external-dns-d13b0217-c0a6-4eaa-8098-4068c753e7f8"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 26])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8c3b27b2-7f68-49b4-b3f3-4525d795f2c5, kind: Service { id: ef029baa-d573-494d-9698-1690c9c57399 }, name: Name("external-dns-ef029baa-d573-494d-9698-1690c9c57399"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 142, 128])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 07c10885-dd61-4583-8ce1-a7179a48d3fa, kind: Service { id: 77818842-4ce3-4fbc-b24e-bfe02c4a0922 }, name: Name("nexus-77818842-4ce3-4fbc-b24e-bfe02c4a0922"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 187, 182])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7ec37840-3b01-4078-b834-03dbd8adf8dd, kind: Service { id: fb7409be-e1e9-41dc-ba28-37cdd7b9c8d6 }, name: Name("nexus-fb7409be-e1e9-41dc-ba28-37cdd7b9c8d6"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 220])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b9a4498e-d802-4925-8101-8f18c4e4f305, kind: Service { id: ae973228-9cf8-450f-8ac4-7d740fc62ad6 }, name: Name("nexus-ae973228-9cf8-450f-8ac4-7d740fc62ad6"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 168, 190])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
26262024-11-27T20:57:17.274ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26272024-11-27T20:57:17.281ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26282024-11-27T20:57:17.281ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26292024-11-27T20:57:17.281ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26302024-11-27T20:57:17.281ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26312024-11-27T20:57:17.281ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
26322024-11-27T20:57:17.281ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8147 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52464 req_id = 855b2f23-b27c-4633-86f4-aad24c96ffbf response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
26332024-11-27T20:57:17.291ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 37e32039-a8dd-4947-8c19-c28ef6335cf2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26342024-11-27T20:57:17.291ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_37e32039-a8dd-4947-8c19-c28ef6335cf2
26352024-11-27T20:57:17.324ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c3225150-4706-46cb-9890-c4e173582acb (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26362024-11-27T20:57:17.324ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_c3225150-4706-46cb-9890-c4e173582acb
26372024-11-27T20:57:17.334ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 154209 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:50698 req_id = 9b4dff44-2d3a-411c-8007-cfaeb5cf9c68 response_code = 204 uri = /switch-ports
26382024-11-27T20:57:17.334ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50698 req_id = 12d2c93d-e181-43d8-8ce6-c331588af3bf response_code = 200 uri = /network-bootstore-config
26392024-11-27T20:57:17.355ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4393a6b4-1740-4ce1-b6df-2d78fb8128b9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26402024-11-27T20:57:17.355ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_4393a6b4-1740-4ce1-b6df-2d78fb8128b9
26412024-11-27T20:57:17.379ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: bd1e9859-f391-4410-ac6a-94d84a761bf8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26422024-11-27T20:57:17.379ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_bd1e9859-f391-4410-ac6a-94d84a761bf8
26432024-11-27T20:57:17.406ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f94a6d1b-9178-4c13-817f-a77b6a6cd97e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26442024-11-27T20:57:17.406ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_f94a6d1b-9178-4c13-817f-a77b6a6cd97e
26452024-11-27T20:57:17.430ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 0b66aa68-555b-43d3-99fd-94013fc7fb74 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26462024-11-27T20:57:17.430ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_0b66aa68-555b-43d3-99fd-94013fc7fb74
26472024-11-27T20:57:17.443ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 285599 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38585 req_id = 3d9f7cbc-f442-4026-94f2-bb03d0bb02f9 response_code = 200 uri = /inventory
26482024-11-27T20:57:17.458ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33674
26492024-11-27T20:57:17.459ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33674 req_id = 1614f700-89f7-4b4a-8cc1-99a0c726b0ec response_code = 200 uri = /vpc-routes
26502024-11-27T20:57:17.571ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54496
26512024-11-27T20:57:17.571ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54496 req_id = 9f2006c4-df6d-489e-a0c5-c19b44fbc72b response_code = 200 uri = /v2p
26522024-11-27T20:57:17.585ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e values = ExternalIpGatewayMap { mappings: {} }
26532024-11-27T20:57:17.585ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33674 req_id = 0e2b5111-beb2-45ad-920d-82ab94f94a86 response_code = 204 uri = /eip-gateways
26542024-11-27T20:57:17.593ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 265 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33674 req_id = 10c10682-c720-4a85-9b96-7a5efd39b878 response_code = 204 uri = /vpc-routes
26552024-11-27T20:57:17.672ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60111
26562024-11-27T20:57:17.672ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
26572024-11-27T20:57:17.672ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
26582024-11-27T20:57:17.672ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/71828714-15a3-4f82-918a-cbabee4531fa/config/omicron-zones.json file = common/src/ledger.rs:177
26592024-11-27T20:57:17.672ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/f58570a3-13b1-4b0c-ac0c-e8a0652f7ced/config/omicron-zones.json file = common/src/ledger.rs:177
26602024-11-27T20:57:17.685ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ff99775c-fb56-419e-aef8-9c8117494384 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26612024-11-27T20:57:17.685ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_ff99775c-fb56-419e-aef8-9c8117494384
26622024-11-27T20:57:17.710ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 54375e11-a569-4c64-8c24-c6dfba089c32 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26632024-11-27T20:57:17.710ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_54375e11-a569-4c64-8c24-c6dfba089c32
26642024-11-27T20:57:17.733ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36763
26652024-11-27T20:57:17.733ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 81c35812-3316-445b-a6f6-3aa12cbc0141, kind: Service { id: d13b0217-c0a6-4eaa-8098-4068c753e7f8 }, name: Name("external-dns-d13b0217-c0a6-4eaa-8098-4068c753e7f8"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 26])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8c3b27b2-7f68-49b4-b3f3-4525d795f2c5, kind: Service { id: ef029baa-d573-494d-9698-1690c9c57399 }, name: Name("external-dns-ef029baa-d573-494d-9698-1690c9c57399"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 142, 128])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 07c10885-dd61-4583-8ce1-a7179a48d3fa, kind: Service { id: 77818842-4ce3-4fbc-b24e-bfe02c4a0922 }, name: Name("nexus-77818842-4ce3-4fbc-b24e-bfe02c4a0922"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 187, 182])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7ec37840-3b01-4078-b834-03dbd8adf8dd, kind: Service { id: fb7409be-e1e9-41dc-ba28-37cdd7b9c8d6 }, name: Name("nexus-fb7409be-e1e9-41dc-ba28-37cdd7b9c8d6"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 220])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b9a4498e-d802-4925-8101-8f18c4e4f305, kind: Service { id: ae973228-9cf8-450f-8ac4-7d740fc62ad6 }, name: Name("nexus-ae973228-9cf8-450f-8ac4-7d740fc62ad6"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 168, 190])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
26662024-11-27T20:57:17.733ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26672024-11-27T20:57:17.733ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26682024-11-27T20:57:17.733ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26692024-11-27T20:57:17.733ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26702024-11-27T20:57:17.733ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26712024-11-27T20:57:17.733ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
26722024-11-27T20:57:17.733ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 473 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36763 req_id = 26e5300a-b2c0-4564-bde1-1163d9148b28 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
26732024-11-27T20:57:17.734ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a7344162-b09f-4fab-9022-409ee4ca9964 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26742024-11-27T20:57:17.734ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_a7344162-b09f-4fab-9022-409ee4ca9964
26752024-11-27T20:57:17.752ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35894
26762024-11-27T20:57:17.752ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26772024-11-27T20:57:17.756ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 37e32039-a8dd-4947-8c19-c28ef6335cf2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26782024-11-27T20:57:17.756ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_37e32039-a8dd-4947-8c19-c28ef6335cf2
26792024-11-27T20:57:17.783ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c3225150-4706-46cb-9890-c4e173582acb (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26802024-11-27T20:57:17.783ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_c3225150-4706-46cb-9890-c4e173582acb
26812024-11-27T20:57:17.794ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26822024-11-27T20:57:17.808ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4393a6b4-1740-4ce1-b6df-2d78fb8128b9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26832024-11-27T20:57:17.809ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_4393a6b4-1740-4ce1-b6df-2d78fb8128b9
26842024-11-27T20:57:17.833ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: bd1e9859-f391-4410-ac6a-94d84a761bf8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26852024-11-27T20:57:17.834ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_bd1e9859-f391-4410-ac6a-94d84a761bf8
26862024-11-27T20:57:17.854ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101856 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:35894 req_id = 3560904b-fa1b-4186-97f6-87c80105febd response_code = 204 uri = /switch-ports
26872024-11-27T20:57:17.854ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35894 req_id = 017e714b-c695-474a-8521-5c20492734e7 response_code = 200 uri = /network-bootstore-config
26882024-11-27T20:57:17.857ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f94a6d1b-9178-4c13-817f-a77b6a6cd97e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26892024-11-27T20:57:17.857ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_f94a6d1b-9178-4c13-817f-a77b6a6cd97e
26902024-11-27T20:57:17.880ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 0b66aa68-555b-43d3-99fd-94013fc7fb74 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26912024-11-27T20:57:17.880ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_0b66aa68-555b-43d3-99fd-94013fc7fb74
26922024-11-27T20:57:17.892ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 219826 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60111 req_id = ca20602d-c52d-467c-a3a8-7287b2fccfed response_code = 200 uri = /inventory
26932024-11-27T20:57:39.432ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:46551
26942024-11-27T20:57:39.432ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:46551 req_id = 0d6e60ea-5c9b-4a89-9bbc-8997688149f8 response_code = 200 uri = /baseboard
26952024-11-27T20:57:41.486ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7845 local_addr = [fd00:1122:3344:101::1]:35289 method = GET remote_addr = [fd00:1122:3344:101::d]:63096 req_id = 19c5d342-1b58-4e27-a0f7-d554bc0d8f51 response_code = 200 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e uri = /0f17ab63-f38a-412f-a653-029795d7304e
26962024-11-27T20:57:45.166ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37061
26972024-11-27T20:57:45.166ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37061 req_id = 609a2055-0df1-4043-a353-7a77739e896f response_code = 200 uri = /vpc-routes
26982024-11-27T20:57:45.180ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e values = ExternalIpGatewayMap { mappings: {} }
26992024-11-27T20:57:45.180ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37061 req_id = 86328060-1108-4ad2-8d61-9e2b802d705f response_code = 204 uri = /eip-gateways
27002024-11-27T20:57:45.189ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 256 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37061 req_id = d54f0637-8c0d-4490-a348-05cbb28d8d96 response_code = 204 uri = /vpc-routes
27012024-11-27T20:57:45.324ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57999
27022024-11-27T20:57:45.324ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57999 req_id = 933a6107-531c-47f6-8b1c-5518f35d5906 response_code = 200 uri = /v2p
27032024-11-27T20:57:45.392ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42092
27042024-11-27T20:57:45.392ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27052024-11-27T20:57:45.429ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27062024-11-27T20:57:45.484ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92503 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:42092 req_id = 2e4cc041-b3b7-4e90-8ff3-eecd8f9dc3aa response_code = 204 uri = /switch-ports
27072024-11-27T20:57:45.485ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42092 req_id = 13842cb1-07a3-438b-a098-6398d7f14657 response_code = 200 uri = /network-bootstore-config
27082024-11-27T20:57:46.707ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59635
27092024-11-27T20:57:46.707ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59635 req_id = 06c08bd5-cd96-4539-a054-f60acb2279d7 response_code = 200 uri = /v2p
27102024-11-27T20:57:46.741ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46105
27112024-11-27T20:57:46.741ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46105 req_id = 15ae9599-28ad-426a-b983-ae193e9fabf1 response_code = 200 uri = /vpc-routes
27122024-11-27T20:57:46.757ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e values = ExternalIpGatewayMap { mappings: {} }
27132024-11-27T20:57:46.757ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46105 req_id = 0b3ffe8c-d15d-4258-a968-5bb95743fc3c response_code = 204 uri = /eip-gateways
27142024-11-27T20:57:46.766ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 281 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46105 req_id = 80a80d00-59e5-4a6e-b115-de9a914e09ad response_code = 204 uri = /vpc-routes
27152024-11-27T20:57:46.811ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44123
27162024-11-27T20:57:46.811ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27172024-11-27T20:57:46.849ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27182024-11-27T20:57:46.917ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106684 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:44123 req_id = e308cb63-d66d-41ff-8361-46a1d9b95eaa response_code = 204 uri = /switch-ports
27192024-11-27T20:57:46.918ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44123 req_id = 781bb05d-d56a-426f-94db-128d0cafd351 response_code = 200 uri = /network-bootstore-config
27202024-11-27T20:57:47.358ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35323
27212024-11-27T20:57:47.358ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35323 req_id = 3ff148f2-3868-402b-b0e5-291ef6966304 response_code = 200 uri = /vpc-routes
27222024-11-27T20:57:47.399ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e values = ExternalIpGatewayMap { mappings: {} }
27232024-11-27T20:57:47.399ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35323 req_id = 2bc02314-9e14-433e-99a2-99dd387cfc0d response_code = 204 uri = /eip-gateways
27242024-11-27T20:57:47.408ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 384 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35323 req_id = 82b97130-7296-4dd0-8603-8ae2ac1b01ee response_code = 204 uri = /vpc-routes
27252024-11-27T20:57:47.451ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63185
27262024-11-27T20:57:47.451ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27272024-11-27T20:57:47.491ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27282024-11-27T20:57:47.545ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94103 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:63185 req_id = 94800f84-6035-413b-ad58-e54b8c4f802d response_code = 204 uri = /switch-ports
27292024-11-27T20:57:47.545ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52625
27302024-11-27T20:57:47.546ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 190 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52625 req_id = 6e06b6a2-98f6-4816-b7ff-9c32ec21d85b response_code = 200 uri = /v2p
27312024-11-27T20:57:47.546ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 254 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63185 req_id = e0c9b85a-ff79-4083-af7e-3f30cb5159ef response_code = 200 uri = /network-bootstore-config
27322024-11-27T20:58:09.464ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:56665
27332024-11-27T20:58:09.464ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:56665 req_id = 21d78996-9361-4f50-b990-77b59e52c43d response_code = 200 uri = /baseboard
27342024-11-27T20:58:11.485ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7505 local_addr = [fd00:1122:3344:101::1]:35289 method = GET remote_addr = [fd00:1122:3344:101::d]:63096 req_id = 030ca33a-45cc-4ed6-abd3-eeec3198a06a response_code = 200 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e uri = /0f17ab63-f38a-412f-a653-029795d7304e
27352024-11-27T20:58:15.472ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44040
27362024-11-27T20:58:15.472ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44040 req_id = c5e4c3ae-af6c-49f5-a6dc-23a446357542 response_code = 200 uri = /vpc-routes
27372024-11-27T20:58:15.484ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64257
27382024-11-27T20:58:15.484ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64257 req_id = 3fe494d0-3d58-4330-84d4-b447e01b79aa response_code = 200 uri = /v2p
27392024-11-27T20:58:15.526ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e values = ExternalIpGatewayMap { mappings: {} }
27402024-11-27T20:58:15.526ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44040 req_id = 9bbddad4-688e-4664-89ed-12bcee8655b6 response_code = 204 uri = /eip-gateways
27412024-11-27T20:58:15.538ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 270 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44040 req_id = b095eca9-fd50-42d2-acae-e095e1066fb4 response_code = 204 uri = /vpc-routes
27422024-11-27T20:58:15.575ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55514
27432024-11-27T20:58:15.575ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27442024-11-27T20:58:15.615ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27452024-11-27T20:58:15.672ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97268 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:55514 req_id = c8dae461-39d8-4a84-923e-9d390a68a9c9 response_code = 204 uri = /switch-ports
27462024-11-27T20:58:15.672ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55514 req_id = e7c77c95-2d46-400b-bf7c-bc0339bcf11e response_code = 200 uri = /network-bootstore-config
27472024-11-27T20:58:16.791ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63930
27482024-11-27T20:58:16.792ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63930 req_id = 98799e98-2862-418e-8f5a-a5da4b0c9ade response_code = 200 uri = /vpc-routes
27492024-11-27T20:58:16.851ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e values = ExternalIpGatewayMap { mappings: {} }
27502024-11-27T20:58:16.851ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63930 req_id = 10ec0ece-3372-409d-a80a-3873aec6016d response_code = 204 uri = /eip-gateways
27512024-11-27T20:58:17.011ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49636
27522024-11-27T20:58:17.011ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49636 req_id = 04b5d60a-9148-4c88-ac70-4108cb653003 response_code = 200 uri = /v2p
27532024-11-27T20:58:17.018ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 245 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63930 req_id = 71d3a69e-4bf8-4276-aeb8-9d185794ba67 response_code = 204 uri = /vpc-routes
27542024-11-27T20:58:17.026ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42947
27552024-11-27T20:58:17.026ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27562024-11-27T20:58:17.063ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27572024-11-27T20:58:17.113ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86881 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:42947 req_id = e7746fe9-b9c2-40be-9dc7-0a33e8a7845d response_code = 204 uri = /switch-ports
27582024-11-27T20:58:17.113ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42947 req_id = 09fdb1e4-3f55-4494-9f3e-ca6920666480 response_code = 200 uri = /network-bootstore-config
27592024-11-27T20:58:17.353ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63481
27602024-11-27T20:58:17.354ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 242 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63481 req_id = 348901d5-3234-444e-bc95-6702db7f891b response_code = 200 uri = /v2p
27612024-11-27T20:58:17.641ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63913
27622024-11-27T20:58:17.641ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63913 req_id = 3d4a0ff8-bfaa-4d11-80dd-56301d161994 response_code = 200 uri = /vpc-routes
27632024-11-27T20:58:17.681ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e values = ExternalIpGatewayMap { mappings: {} }
27642024-11-27T20:58:17.681ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63913 req_id = 36831d30-b256-491c-9efa-6c8eea64c1c0 response_code = 204 uri = /eip-gateways
27652024-11-27T20:58:17.687ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33114
27662024-11-27T20:58:17.687ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27672024-11-27T20:58:17.725ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27682024-11-27T20:58:17.782ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95186 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:33114 req_id = 406befb9-3a86-4cce-91e3-271f1812dae4 response_code = 204 uri = /switch-ports
27692024-11-27T20:58:17.783ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 323 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63913 req_id = 07f5f61d-9ab0-4dbc-9b1a-db25828bf4b2 response_code = 204 uri = /vpc-routes
27702024-11-27T20:58:17.783ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33114 req_id = 5838330c-a4c5-41c4-9814-7e5adcf50f67 response_code = 200 uri = /network-bootstore-config
27712024-11-27T20:58:39.499ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:35864
27722024-11-27T20:58:39.499ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:35864 req_id = 169f79f1-8a49-462f-a3e4-1153bbd2faaa response_code = 200 uri = /baseboard
27732024-11-27T20:58:41.487ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7989 local_addr = [fd00:1122:3344:101::1]:35289 method = GET remote_addr = [fd00:1122:3344:101::d]:63096 req_id = 33c78459-d8e3-4468-a313-7d67666a507a response_code = 200 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e uri = /0f17ab63-f38a-412f-a653-029795d7304e
27742024-11-27T20:58:43.014ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34607
27752024-11-27T20:58:43.015ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34607 req_id = 71f9ef3b-7bbf-49df-86d5-7c622984da39 response_code = 200 uri = /v2p
27762024-11-27T20:58:43.017ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:874 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(3847769) }
27772024-11-27T20:58:43.018ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2649 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34607 req_id = 0a4880b2-6a66-4bed-b4eb-2c90744ca43a response_code = 204 uri = /v2p
27782024-11-27T20:58:43.188ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43098
27792024-11-27T20:58:43.203ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:555 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 4235b2fb-e1d4-46b4-a69a-c9513073afa7, kind: Instance { id: 3277d596-ee08-4efd-ad34-e77823f771a2 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(3847769), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4235b2fb-e1d4-46b4-a69a-c9513073afa7, kind: Instance { id: 3277d596-ee08-4efd-ad34-e77823f771a2 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(3847769), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4235b2fb-e1d4-46b4-a69a-c9513073afa7, kind: Instance { id: 3277d596-ee08-4efd-ad34-e77823f771a2 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(3847769), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(3847769))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4235b2fb-e1d4-46b4-a69a-c9513073afa7, kind: Instance { id: 3277d596-ee08-4efd-ad34-e77823f771a2 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(3847769), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-d976de80c22", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: d795bbda-85ba-47c9-93f9-5f7ed367c2f3, read_only_parent: Some(Volume { block_size: 512, id: b9ba29f9-60ce-4b01-be46-e5001cf8d500, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: f2d2238c-6bfd-4f7e-88a9-89dbdcc6d87e, key: Some("iCiWc2NWiwqC11f4l1OFUFTAgBop6OYI8AJJAa2MR9g="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::13]:19001", "[fd00:1122:3344:101::19]:19001", "[fd00:1122:3344:101::12]:19002"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: d795bbda-85ba-47c9-93f9-5f7ed367c2f3, key: Some("HLHN2XoguC0wiNICQaRuLCk69LtaGViPkMva1mOumgA="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::18]:19001", "[fd00:1122:3344:101::19]:19002", "[fd00:1122:3344:101::15]:19000"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-d976de80c22" }] }), cloud_init_bytes: Some(..) } instance_id = 3277d596-ee08-4efd-ad34-e77823f771a2 metadata = InstanceMetadata { silo_id: 0d4bca76-e5da-4e68-af42-5d673496c955, project_id: 95b4b53e-9ea8-4502-9984-e5dc5da5339b } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = 4c9047af-d15e-48bd-9684-9b5fcacade51 vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-11-27T20:58:43.186098862Z }
27802024-11-27T20:58:43.203ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:588 instance_id = 3277d596-ee08-4efd-ad34-e77823f771a2 migration_id = None propolis_id = 4c9047af-d15e-48bd-9684-9b5fcacade51
27812024-11-27T20:58:43.203ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1281 instance_id = 3277d596-ee08-4efd-ad34-e77823f771a2 migration_id = None propolis_id = 4c9047af-d15e-48bd-9684-9b5fcacade51 state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 4235b2fb-e1d4-46b4-a69a-c9513073afa7, kind: Instance { id: 3277d596-ee08-4efd-ad34-e77823f771a2 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(3847769), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4235b2fb-e1d4-46b4-a69a-c9513073afa7, kind: Instance { id: 3277d596-ee08-4efd-ad34-e77823f771a2 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(3847769), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4235b2fb-e1d4-46b4-a69a-c9513073afa7, kind: Instance { id: 3277d596-ee08-4efd-ad34-e77823f771a2 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(3847769), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(3847769))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4235b2fb-e1d4-46b4-a69a-c9513073afa7, kind: Instance { id: 3277d596-ee08-4efd-ad34-e77823f771a2 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(3847769), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-d976de80c22", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: d795bbda-85ba-47c9-93f9-5f7ed367c2f3, read_only_parent: Some(Volume { block_size: 512, id: b9ba29f9-60ce-4b01-be46-e5001cf8d500, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: f2d2238c-6bfd-4f7e-88a9-89dbdcc6d87e, key: Some("iCiWc2NWiwqC11f4l1OFUFTAgBop6OYI8AJJAa2MR9g="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::13]:19001", "[fd00:1122:3344:101::19]:19001", "[fd00:1122:3344:101::12]:19002"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: d795bbda-85ba-47c9-93f9-5f7ed367c2f3, key: Some("HLHN2XoguC0wiNICQaRuLCk69LtaGViPkMva1mOumgA="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::18]:19001", "[fd00:1122:3344:101::19]:19002", "[fd00:1122:3344:101::15]:19000"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-d976de80c22" }] }), cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-11-27T20:58:43.186098862Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
27822024-11-27T20:58:43.205ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 16828 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43098 req_id = 5f471cc9-faf2-4e37-b67f-06cca4575235 response_code = 200 uri = /vmms/4c9047af-d15e-48bd-9684-9b5fcacade51
27832024-11-27T20:58:43.295ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60827
27842024-11-27T20:58:43.297ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1596 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60827 req_id = e75c0779-0dc2-4811-8201-0831acfac377 response_code = 200 uri = /vmms/4c9047af-d15e-48bd-9684-9b5fcacade51/state
27852024-11-27T20:58:43.298ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 3847769 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
27862024-11-27T20:58:43.298ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
27872024-11-27T20:58:43.340ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_4c9047af-d15e-48bd-9684-9b5fcacade51 file = illumos-utils/src/zone.rs:325 instance_id = 3277d596-ee08-4efd-ad34-e77823f771a2 propolis_id = 4c9047af-d15e-48bd-9684-9b5fcacade51
27882024-11-27T20:58:43.364ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_4c9047af-d15e-48bd-9684-9b5fcacade51 file = illumos-utils/src/zone.rs:363 instance_id = 3277d596-ee08-4efd-ad34-e77823f771a2 propolis_id = 4c9047af-d15e-48bd-9684-9b5fcacade51
27892024-11-27T20:58:43.380ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37006
27902024-11-27T20:58:43.380ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37006 req_id = dd872622-0839-4508-a06b-4882a747366c response_code = 200 uri = /vpc-routes
27912024-11-27T20:58:43.407ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e values = ExternalIpGatewayMap { mappings: {4235b2fb-e1d4-46b4-a69a-c9513073afa7: {10.151.1.176: {ac86eeeb-e428-4047-b43a-009f1fcf5eaa}, 10.151.1.175: {ac86eeeb-e428-4047-b43a-009f1fcf5eaa}}} }
27922024-11-27T20:58:44.812ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_4c9047af-d15e-48bd-9684-9b5fcacade51: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = 3277d596-ee08-4efd-ad34-e77823f771a2 propolis_id = 4c9047af-d15e-48bd-9684-9b5fcacade51
27932024-11-27T20:58:44.812ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_4c9047af-d15e-48bd-9684-9b5fcacade51 zone file = illumos-utils/src/running_zone.rs:488 instance_id = 3277d596-ee08-4efd-ad34-e77823f771a2 propolis_id = 4c9047af-d15e-48bd-9684-9b5fcacade51 zone = oxz_propolis-server_4c9047af-d15e-48bd-9684-9b5fcacade51
27942024-11-27T20:58:45.011ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_4c9047af-d15e-48bd-9684-9b5fcacade51") failed: Property not found. retry in 39.344845ms file = illumos-utils/src/svc.rs:36 instance_id = 3277d596-ee08-4efd-ad34-e77823f771a2 propolis_id = 4c9047af-d15e-48bd-9684-9b5fcacade51 zone = oxz_propolis-server_4c9047af-d15e-48bd-9684-9b5fcacade51
27952024-11-27T20:58:45.060ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_4c9047af-d15e-48bd-9684-9b5fcacade51") failed: Property not found. retry in 123.512738ms file = illumos-utils/src/svc.rs:36 instance_id = 3277d596-ee08-4efd-ad34-e77823f771a2 propolis_id = 4c9047af-d15e-48bd-9684-9b5fcacade51 zone = oxz_propolis-server_4c9047af-d15e-48bd-9684-9b5fcacade51
27962024-11-27T20:58:45.201ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_4c9047af-d15e-48bd-9684-9b5fcacade51") failed: Property not found. retry in 225.259316ms file = illumos-utils/src/svc.rs:36 instance_id = 3277d596-ee08-4efd-ad34-e77823f771a2 propolis_id = 4c9047af-d15e-48bd-9684-9b5fcacade51 zone = oxz_propolis-server_4c9047af-d15e-48bd-9684-9b5fcacade51
27972024-11-27T20:58:45.264ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63811
27982024-11-27T20:58:45.365ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37480
27992024-11-27T20:58:45.365ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
28002024-11-27T20:58:45.406ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
28012024-11-27T20:58:45.462ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96504 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:37480 req_id = 0c64b7ff-95d3-413b-9091-4fe1578ce816 response_code = 204 uri = /switch-ports
28022024-11-27T20:58:45.462ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55566
28032024-11-27T20:58:45.466ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 858 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37480 req_id = cadc37ac-ac46-4c68-b585-a6d5bb71bd18 response_code = 200 uri = /network-bootstore-config
28042024-11-27T20:58:45.466ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 305 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55566 req_id = fc3a77fa-d81b-4a39-8439-388a0c3338e6 response_code = 200 uri = /v2p
28052024-11-27T20:58:45.477ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_4c9047af-d15e-48bd-9684-9b5fcacade51") failed: Property not found. retry in 390.939688ms file = illumos-utils/src/svc.rs:36 instance_id = 3277d596-ee08-4efd-ad34-e77823f771a2 propolis_id = 4c9047af-d15e-48bd-9684-9b5fcacade51 zone = oxz_propolis-server_4c9047af-d15e-48bd-9684-9b5fcacade51
28062024-11-27T20:58:45.881ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_4c9047af-d15e-48bd-9684-9b5fcacade51") failed: Property not found. retry in 1.116174617s file = illumos-utils/src/svc.rs:36 instance_id = 3277d596-ee08-4efd-ad34-e77823f771a2 propolis_id = 4c9047af-d15e-48bd-9684-9b5fcacade51 zone = oxz_propolis-server_4c9047af-d15e-48bd-9684-9b5fcacade51
28072024-11-27T20:58:46.611ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47486
28082024-11-27T20:58:46.820ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62553
28092024-11-27T20:58:46.820ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62553 req_id = 505b5c67-5d5f-415f-a378-78f243d7d53b response_code = 200 uri = /v2p
28102024-11-27T20:58:46.837ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37216
28112024-11-27T20:58:46.837ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37216 req_id = 443426ca-8785-45d9-986a-615b030b32c2 response_code = 200 uri = /vpc-routes
28122024-11-27T20:58:46.860ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e values = ExternalIpGatewayMap { mappings: {4235b2fb-e1d4-46b4-a69a-c9513073afa7: {10.151.1.176: {ac86eeeb-e428-4047-b43a-009f1fcf5eaa}, 10.151.1.175: {ac86eeeb-e428-4047-b43a-009f1fcf5eaa}}} }
28132024-11-27T20:58:46.860ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 173 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37216 req_id = 5bf9b995-1e50-466f-a427-366880e88f50 response_code = 204 uri = /eip-gateways
28142024-11-27T20:58:46.865ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60179
28152024-11-27T20:58:46.865ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
28162024-11-27T20:58:46.909ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
28172024-11-27T20:58:46.977ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112102 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:60179 req_id = d60c1c8b-f48c-4e7e-a466-93910b05a33b response_code = 204 uri = /switch-ports
28182024-11-27T20:58:46.978ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 264 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60179 req_id = c76622c0-9422-4fff-86e5-2a331cb54f90 response_code = 200 uri = /network-bootstore-config
28192024-11-27T20:58:46.981ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 506 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37216 req_id = 967b3cb7-57cb-4808-a034-a5ee35a58131 response_code = 204 uri = /vpc-routes
28202024-11-27T20:58:47.011ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_4c9047af-d15e-48bd-9684-9b5fcacade51") failed: Property not found. retry in 1.117103093s file = illumos-utils/src/svc.rs:36 instance_id = 3277d596-ee08-4efd-ad34-e77823f771a2 propolis_id = 4c9047af-d15e-48bd-9684-9b5fcacade51 zone = oxz_propolis-server_4c9047af-d15e-48bd-9684-9b5fcacade51
28212024-11-27T20:58:47.336ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48499
28222024-11-27T20:58:47.336ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48499 req_id = 654ad303-50f6-4654-954c-3ca3d48f325a response_code = 200 uri = /vpc-routes
28232024-11-27T20:58:47.343ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55920
28242024-11-27T20:58:47.388ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e values = ExternalIpGatewayMap { mappings: {4235b2fb-e1d4-46b4-a69a-c9513073afa7: {10.151.1.175: {ac86eeeb-e428-4047-b43a-009f1fcf5eaa}, 10.151.1.176: {ac86eeeb-e428-4047-b43a-009f1fcf5eaa}}} }
28252024-11-27T20:58:47.388ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48499 req_id = 6052405c-083e-4b14-b15f-025f94155ae7 response_code = 204 uri = /eip-gateways
28262024-11-27T20:58:47.406ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 302 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48499 req_id = 50bd6876-9f0b-4be4-9363-68cab2801e3c response_code = 204 uri = /vpc-routes
28272024-11-27T20:58:47.439ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36638
28282024-11-27T20:58:47.439ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
28292024-11-27T20:58:47.478ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
28302024-11-27T20:58:47.533ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93716 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:36638 req_id = de8efa7e-9066-4ef5-8e3b-06913a2a2cfc response_code = 204 uri = /switch-ports
28312024-11-27T20:58:47.533ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40348
28322024-11-27T20:58:47.533ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 221 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36638 req_id = 87b68a56-f47a-471e-b94a-f9491a078032 response_code = 200 uri = /network-bootstore-config
28332024-11-27T20:58:47.533ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 178 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40348 req_id = 67573ddb-6861-423c-b872-1ededd83ee79 response_code = 200 uri = /v2p
28342024-11-27T20:58:48.139ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_4c9047af-d15e-48bd-9684-9b5fcacade51") failed: Property not found. retry in 969.491563ms file = illumos-utils/src/svc.rs:36 instance_id = 3277d596-ee08-4efd-ad34-e77823f771a2 propolis_id = 4c9047af-d15e-48bd-9684-9b5fcacade51 zone = oxz_propolis-server_4c9047af-d15e-48bd-9684-9b5fcacade51
28352024-11-27T20:58:49.120ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_4c9047af-d15e-48bd-9684-9b5fcacade51") failed: Property not found. retry in 796.21937ms file = illumos-utils/src/svc.rs:36 instance_id = 3277d596-ee08-4efd-ad34-e77823f771a2 propolis_id = 4c9047af-d15e-48bd-9684-9b5fcacade51 zone = oxz_propolis-server_4c9047af-d15e-48bd-9684-9b5fcacade51
28362024-11-27T20:58:49.947ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_4c9047af-d15e-48bd-9684-9b5fcacade51 file = sled-agent/src/instance.rs:1786 instance_id = 3277d596-ee08-4efd-ad34-e77823f771a2 propolis_id = 4c9047af-d15e-48bd-9684-9b5fcacade51
28372024-11-27T20:58:49.956ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_4c9047af-d15e-48bd-9684-9b5fcacade51") failed: Property not found. retry in 45.189421ms file = illumos-utils/src/svc.rs:36 instance_id = 3277d596-ee08-4efd-ad34-e77823f771a2 propolis_id = 4c9047af-d15e-48bd-9684-9b5fcacade51
28382024-11-27T20:58:50.012ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_4c9047af-d15e-48bd-9684-9b5fcacade51") failed: Property not found. retry in 113.045292ms file = illumos-utils/src/svc.rs:36 instance_id = 3277d596-ee08-4efd-ad34-e77823f771a2 propolis_id = 4c9047af-d15e-48bd-9684-9b5fcacade51
28392024-11-27T20:58:50.136ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_4c9047af-d15e-48bd-9684-9b5fcacade51") failed: Property not found. retry in 118.902485ms file = illumos-utils/src/svc.rs:36 instance_id = 3277d596-ee08-4efd-ad34-e77823f771a2 propolis_id = 4c9047af-d15e-48bd-9684-9b5fcacade51
28402024-11-27T20:58:50.265ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_4c9047af-d15e-48bd-9684-9b5fcacade51") failed: Property not found. retry in 560.286644ms file = illumos-utils/src/svc.rs:36 instance_id = 3277d596-ee08-4efd-ad34-e77823f771a2 propolis_id = 4c9047af-d15e-48bd-9684-9b5fcacade51
28412024-11-27T20:58:50.837ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:1795 instance_id = 3277d596-ee08-4efd-ad34-e77823f771a2 propolis_id = 4c9047af-d15e-48bd-9684-9b5fcacade51
28422024-11-27T20:58:50.875ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:1819 instance_id = 3277d596-ee08-4efd-ad34-e77823f771a2 propolis_id = 4c9047af-d15e-48bd-9684-9b5fcacade51
28432024-11-27T20:58:51.014ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:932 instance_id = 3277d596-ee08-4efd-ad34-e77823f771a2 propolis_id = 4c9047af-d15e-48bd-9684-9b5fcacade51
28442024-11-27T20:58:51.016ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1243 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e
28452024-11-27T20:58:51.016ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3669927 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55920 req_id = b7795b94-d937-4a71-971d-8d0172352609 response_code = 200 uri = /vmms/4c9047af-d15e-48bd-9684-9b5fcacade51/state
28462024-11-27T20:58:51.016ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7608987 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37006 req_id = e06c698c-79eb-46f3-93d7-1b80e5a38b07 response_code = 204 uri = /eip-gateways
28472024-11-27T20:58:51.016ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5751798 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63811 req_id = b06cf43f-9faa-4d96-9c4c-c4d1f3b0f754 response_code = 200 uri = /vmms/4c9047af-d15e-48bd-9684-9b5fcacade51/state
28482024-11-27T20:58:51.016ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4404375 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47486 req_id = 6f145d73-4dee-4fb7-8469-bd278885c0aa response_code = 200 uri = /vmms/4c9047af-d15e-48bd-9684-9b5fcacade51/state
28492024-11-27T20:58:51.017ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2024-11-27T20:58:51.017623676Z } file = sled-agent/src/instance.rs:780 instance_id = 3277d596-ee08-4efd-ad34-e77823f771a2 propolis_id = 4c9047af-d15e-48bd-9684-9b5fcacade51
28502024-11-27T20:58:51.017ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 3277d596-ee08-4efd-ad34-e77823f771a2 new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-11-27T20:58:51.017623676Z } propolis_id = 4c9047af-d15e-48bd-9684-9b5fcacade51
28512024-11-27T20:58:51.017ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 3277d596-ee08-4efd-ad34-e77823f771a2 propolis_id = 4c9047af-d15e-48bd-9684-9b5fcacade51 state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-11-27T20:58:51.017623676Z }, migration_in: None, migration_out: None }
28522024-11-27T20:58:51.029ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2024-11-27T20:58:51.029608337Z } file = sled-agent/src/instance.rs:780 instance_id = 3277d596-ee08-4efd-ad34-e77823f771a2 propolis_id = 4c9047af-d15e-48bd-9684-9b5fcacade51
28532024-11-27T20:58:51.029ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 3277d596-ee08-4efd-ad34-e77823f771a2 new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-27T20:58:51.029608337Z } propolis_id = 4c9047af-d15e-48bd-9684-9b5fcacade51
28542024-11-27T20:58:51.029ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 3277d596-ee08-4efd-ad34-e77823f771a2 propolis_id = 4c9047af-d15e-48bd-9684-9b5fcacade51 state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-27T20:58:51.029608337Z }, migration_in: None, migration_out: None }
28552024-11-27T20:58:51.140ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:486 new_vers = RouterVersion { router_id: 9f9cb57c-2bba-4e11-93bd-733c64b25084, version: 3 } old_vers = RouterVersion { router_id: 9f9cb57c-2bba-4e11-93bd-733c64b25084, version: 3 } subnet = RouterId { vni: Vni(3847769), kind: System }
28562024-11-27T20:58:51.140ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 270 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37006 req_id = f958808a-f237-4c38-90d5-f279164a1405 response_code = 204 uri = /vpc-routes
28572024-11-27T20:58:51.182ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42617
28582024-11-27T20:58:51.182ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42617 req_id = 818f126a-14c5-4946-9882-77711de6f013 response_code = 200 uri = /vpc-routes
28592024-11-27T20:58:51.232ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e values = ExternalIpGatewayMap { mappings: {4235b2fb-e1d4-46b4-a69a-c9513073afa7: {10.151.1.175: {ac86eeeb-e428-4047-b43a-009f1fcf5eaa}, 10.151.1.176: {ac86eeeb-e428-4047-b43a-009f1fcf5eaa}}} }
28602024-11-27T20:58:51.232ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42617 req_id = 7bda1462-62d9-43ee-a760-9f94e126669b response_code = 204 uri = /eip-gateways
28612024-11-27T20:58:51.249ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 234 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42617 req_id = a1ddf31e-f9c5-4187-890c-7148545e69a0 response_code = 204 uri = /vpc-routes
28622024-11-27T20:59:00.858ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58384
28632024-11-27T20:59:00.859ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 596 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58384 req_id = d3eace48-5678-44d8-92f1-d43e74f96d81 response_code = 200 uri = /vmms/4c9047af-d15e-48bd-9684-9b5fcacade51/state
28642024-11-27T20:59:00.859ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2024-11-27T20:59:00.859422748Z } file = sled-agent/src/instance.rs:780 instance_id = 3277d596-ee08-4efd-ad34-e77823f771a2 propolis_id = 4c9047af-d15e-48bd-9684-9b5fcacade51
28652024-11-27T20:59:00.859ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 3277d596-ee08-4efd-ad34-e77823f771a2 new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-11-27T20:59:00.859422748Z } propolis_id = 4c9047af-d15e-48bd-9684-9b5fcacade51
28662024-11-27T20:59:00.859ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 3277d596-ee08-4efd-ad34-e77823f771a2 propolis_id = 4c9047af-d15e-48bd-9684-9b5fcacade51 state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-11-27T20:59:00.859422748Z }, migration_in: None, migration_out: None }
28672024-11-27T20:59:00.872ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2024-11-27T20:59:00.872035586Z } file = sled-agent/src/instance.rs:780 instance_id = 3277d596-ee08-4efd-ad34-e77823f771a2 propolis_id = 4c9047af-d15e-48bd-9684-9b5fcacade51
28682024-11-27T20:59:00.872ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 3277d596-ee08-4efd-ad34-e77823f771a2 new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-11-27T20:59:00.872035586Z } propolis_id = 4c9047af-d15e-48bd-9684-9b5fcacade51
28692024-11-27T20:59:00.872ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:816 instance_id = 3277d596-ee08-4efd-ad34-e77823f771a2 propolis_id = 4c9047af-d15e-48bd-9684-9b5fcacade51
28702024-11-27T20:59:00.872ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
28712024-11-27T20:59:00.872ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
28722024-11-27T20:59:00.872ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/71828714-15a3-4f82-918a-cbabee4531fa/debug/bundle/zone", "/pool/int/f58570a3-13b1-4b0c-ac0c-e8a0652f7ced/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/ff99775c-fb56-419e-aef8-9c8117494384/crypt/debug", "/pool/ext/54375e11-a569-4c64-8c24-c6dfba089c32/crypt/debug", "/pool/ext/a7344162-b09f-4fab-9022-409ee4ca9964/crypt/debug", "/pool/ext/37e32039-a8dd-4947-8c19-c28ef6335cf2/crypt/debug", "/pool/ext/c3225150-4706-46cb-9890-c4e173582acb/crypt/debug", "/pool/ext/4393a6b4-1740-4ce1-b6df-2d78fb8128b9/crypt/debug", "/pool/ext/bd1e9859-f391-4410-ac6a-94d84a761bf8/crypt/debug", "/pool/ext/f94a6d1b-9178-4c13-817f-a77b6a6cd97e/crypt/debug", "/pool/ext/0b66aa68-555b-43d3-99fd-94013fc7fb74/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_4c9047af-d15e-48bd-9684-9b5fcacade51
28732024-11-27T20:59:01.518ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1142 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_4c9047af-d15e-48bd-9684-9b5fcacade51", bundle_id: 865cb696-73a5-44c9-bb27-61b1cd5bd8b4 }, time_created: 2024-11-27T20:59:00.872988676Z, version: 0, cause: TerminatedInstance }
28742024-11-27T20:59:01.518ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_4c9047af-d15e-48bd-9684-9b5fcacade51 file = sled-agent/src/instance.rs:1032 instance_id = 3277d596-ee08-4efd-ad34-e77823f771a2 propolis_id = 4c9047af-d15e-48bd-9684-9b5fcacade51
28752024-11-27T20:59:03.280ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:279 instance_id = 3277d596-ee08-4efd-ad34-e77823f771a2 propolis_id = 4c9047af-d15e-48bd-9684-9b5fcacade51
28762024-11-27T20:59:03.297ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(3847769), kind: System }
28772024-11-27T20:59:03.297ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(3847769), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
28782024-11-27T20:59:03.297ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 3277d596-ee08-4efd-ad34-e77823f771a2 propolis_id = 4c9047af-d15e-48bd-9684-9b5fcacade51 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-27T20:59:03.297805827Z }, migration_in: None, migration_out: None }
28792024-11-27T20:59:03.319ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 3277d596-ee08-4efd-ad34-e77823f771a2 propolis_id = 4c9047af-d15e-48bd-9684-9b5fcacade51 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-27T20:59:03.297805827Z }, migration_in: None, migration_out: None }
28802024-11-27T20:59:03.333ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:969 instance_id = 3277d596-ee08-4efd-ad34-e77823f771a2 propolis_id = 4c9047af-d15e-48bd-9684-9b5fcacade51
28812024-11-27T20:59:03.835ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37821
28822024-11-27T20:59:03.835ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37821 req_id = 3bf80a0d-44aa-4b32-b1c5-7422c45c5c83 response_code = 200 uri = /vpc-routes
28832024-11-27T20:59:03.883ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e values = ExternalIpGatewayMap { mappings: {} }
28842024-11-27T20:59:03.883ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1243 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e
28852024-11-27T20:59:03.883ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 167 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37821 req_id = ab0534b4-e98f-47b6-915f-6b8356a7625c response_code = 204 uri = /eip-gateways
28862024-11-27T20:59:03.892ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 180 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37821 req_id = 0398417d-3059-4b2d-8e5c-2104074e8e88 response_code = 204 uri = /vpc-routes
28872024-11-27T20:59:03.942ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63195
28882024-11-27T20:59:03.943ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63195 req_id = 155ab639-2125-4a8a-80bb-4986f9969aee response_code = 200 uri = /v2p
28892024-11-27T20:59:03.990ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44469
28902024-11-27T20:59:03.990ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44469 req_id = 98d755c2-aa6a-47b6-8450-342b5114fa0f response_code = 200 uri = /v2p
28912024-11-27T20:59:04.228ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45159
28922024-11-27T20:59:04.228ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45159 req_id = e8d8f3a1-9dbc-4547-9043-9f537eeeb1f1 response_code = 200 uri = /vpc-routes
28932024-11-27T20:59:04.241ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e values = ExternalIpGatewayMap { mappings: {} }
28942024-11-27T20:59:04.241ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45159 req_id = 6aa870c2-565a-45fa-8d5b-ec8bbd2edbfd response_code = 204 uri = /eip-gateways
28952024-11-27T20:59:04.250ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45159 req_id = f2a7e5bb-f840-4257-9ee8-55c55a239c5c response_code = 204 uri = /vpc-routes
28962024-11-27T20:59:04.794ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43577
28972024-11-27T20:59:04.794ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43577 req_id = c64cea70-78a6-4aa3-afb3-81e7f0bb252e response_code = 200 uri = /vpc-routes
28982024-11-27T20:59:04.807ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 0f17ab63-f38a-412f-a653-029795d7304e values = ExternalIpGatewayMap { mappings: {} }
28992024-11-27T20:59:04.807ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43577 req_id = c9fa08d1-e1e9-4caf-9ce6-941bcf12c8f4 response_code = 204 uri = /eip-gateways
29002024-11-27T20:59:04.815ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 265 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43577 req_id = 8fb980b6-2f58-436d-8d35-92d44dca1072 response_code = 204 uri = /vpc-routes