Max level shown:
1 [ Dec 18 22:10:54 Enabled. ]
2 [ Dec 18 22:10:54 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Dec 18 22:10:54 Method "start" exited with status 0. ]
4 [ Dec 18 22:10:54 Rereading configuration. ]
5 [ Dec 18 22:10:54 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72024-12-18T22:10:54.583ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:113
82024-12-18T22:10:54.583ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92024-12-18T22:10:54.638ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102024-12-18T22:10:54.638ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112024-12-18T22:10:54.753ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122024-12-18T22:10:54.762ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132024-12-18T22:10:54.770ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142024-12-18T22:10:55.374ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:9fb2::, width: 64 }
152024-12-18T22:10:55.513ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
162024-12-18T22:10:55.513ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
172024-12-18T22:10:55.513ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
182024-12-18T22:10:55.513ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192024-12-18T22:10:55.513ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:520
202024-12-18T22:10:55.513ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:717
212024-12-18T22:10:55.516ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "buskin", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:624
222024-12-18T22:10:55.516ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:766
232024-12-18T22:10:55.516ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
242024-12-18T22:10:55.516ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:825
252024-12-18T22:10:55.516ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
262024-12-18T22:10:55.516ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272024-12-18T22:10:55.516ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:608
282024-12-18T22:10:55.516ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292024-12-18T22:10:55.516ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302024-12-18T22:10:55.528ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:367
312024-12-18T22:10:55.528ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = f4e49932-892e-4e15-afe7-919d71bd3012 (zpool)
322024-12-18T22:10:55.629ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: f4e49932-892e-4e15-afe7-919d71bd3012 (zpool), kind: Internal }
332024-12-18T22:10:55.994ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:608
342024-12-18T22:10:55.994ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
352024-12-18T22:10:55.994ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362024-12-18T22:10:55.994ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372024-12-18T22:10:55.994ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:608
382024-12-18T22:10:55.995ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392024-12-18T22:10:55.995ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402024-12-18T22:10:56.003ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:367
412024-12-18T22:10:56.003ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = de0dd618-e464-453d-9394-6cb21d5dbefa (zpool)
422024-12-18T22:10:56.094ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: de0dd618-e464-453d-9394-6cb21d5dbefa (zpool), kind: Internal }
432024-12-18T22:10:56.456ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
442024-12-18T22:10:56.456ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f4e49932-892e-4e15-afe7-919d71bd3012 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: de0dd618-e464-453d-9394-6cb21d5dbefa (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
452024-12-18T22:10:56.456ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
462024-12-18T22:10:56.456ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
472024-12-18T22:10:56.456ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:608
482024-12-18T22:10:56.456ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
492024-12-18T22:10:56.456ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
502024-12-18T22:10:56.456ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f4e49932-892e-4e15-afe7-919d71bd3012 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: de0dd618-e464-453d-9394-6cb21d5dbefa (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
512024-12-18T22:10:56.456ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:608
522024-12-18T22:10:56.456ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
532024-12-18T22:10:56.456ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
542024-12-18T22:10:56.456ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
552024-12-18T22:10:56.456ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
562024-12-18T22:10:56.456ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f4e49932-892e-4e15-afe7-919d71bd3012 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: de0dd618-e464-453d-9394-6cb21d5dbefa (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
572024-12-18T22:10:56.456ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:608
582024-12-18T22:10:56.456ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
592024-12-18T22:10:56.456ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
602024-12-18T22:10:56.456ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
612024-12-18T22:10:56.456ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
622024-12-18T22:10:56.456ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f4e49932-892e-4e15-afe7-919d71bd3012 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: de0dd618-e464-453d-9394-6cb21d5dbefa (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
632024-12-18T22:10:56.456ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
642024-12-18T22:10:56.456ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
652024-12-18T22:10:56.456ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:608
662024-12-18T22:10:56.456ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
672024-12-18T22:10:56.456ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
682024-12-18T22:10:56.456ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f4e49932-892e-4e15-afe7-919d71bd3012 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: de0dd618-e464-453d-9394-6cb21d5dbefa (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
692024-12-18T22:10:56.456ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
702024-12-18T22:10:56.456ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
712024-12-18T22:10:56.456ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:608
722024-12-18T22:10:56.456ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
732024-12-18T22:10:56.456ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
742024-12-18T22:10:56.456ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:608
752024-12-18T22:10:56.456ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
762024-12-18T22:10:56.456ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f4e49932-892e-4e15-afe7-919d71bd3012 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: de0dd618-e464-453d-9394-6cb21d5dbefa (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
772024-12-18T22:10:56.456ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
782024-12-18T22:10:56.456ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
792024-12-18T22:10:56.456ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
802024-12-18T22:10:56.456ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:608
812024-12-18T22:10:56.456ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
822024-12-18T22:10:56.456ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f4e49932-892e-4e15-afe7-919d71bd3012 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: de0dd618-e464-453d-9394-6cb21d5dbefa (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
832024-12-18T22:10:56.456ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
842024-12-18T22:10:56.456ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
852024-12-18T22:10:56.456ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
862024-12-18T22:10:56.456ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:608
872024-12-18T22:10:56.456ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
882024-12-18T22:10:56.456ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f4e49932-892e-4e15-afe7-919d71bd3012 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: de0dd618-e464-453d-9394-6cb21d5dbefa (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
892024-12-18T22:10:56.456ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
902024-12-18T22:10:56.456ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
912024-12-18T22:10:56.456ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
922024-12-18T22:10:56.456ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:608
932024-12-18T22:10:56.456ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f4e49932-892e-4e15-afe7-919d71bd3012 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: de0dd618-e464-453d-9394-6cb21d5dbefa (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
942024-12-18T22:10:56.456ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
952024-12-18T22:10:56.456ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
962024-12-18T22:10:56.457ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
972024-12-18T22:10:56.457ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
982024-12-18T22:10:56.457ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
992024-12-18T22:10:56.457ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f4e49932-892e-4e15-afe7-919d71bd3012 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: de0dd618-e464-453d-9394-6cb21d5dbefa (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
1002024-12-18T22:10:56.457ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
1012024-12-18T22:10:56.457ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1022024-12-18T22:10:56.457ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:608
1032024-12-18T22:10:56.457ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1042024-12-18T22:10:56.457ZINFOSledAgent (bootstore): No ledger in /pool/int/f4e49932-892e-4e15-afe7-919d71bd3012/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1052024-12-18T22:10:56.457ZINFOSledAgent (bootstore): No ledger in /pool/int/de0dd618-e464-453d-9394-6cb21d5dbefa/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1062024-12-18T22:10:56.457ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-buskin-i86pc
1072024-12-18T22:10:56.457ZINFOSledAgent (bootstore): No ledger in /pool/int/f4e49932-892e-4e15-afe7-919d71bd3012/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1082024-12-18T22:10:56.457ZINFOSledAgent (bootstore): No ledger in /pool/int/de0dd618-e464-453d-9394-6cb21d5dbefa/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1092024-12-18T22:10:56.457ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-buskin-i86pc
1102024-12-18T22:10:56.457ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1112024-12-18T22:10:56.457ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1122024-12-18T22:10:56.468ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:736
1132024-12-18T22:10:56.468ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1346, tv_nsec: 573570623 } time_to_next_cleanup = 599.999946639s
1142024-12-18T22:10:56.468ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3947
1152024-12-18T22:10:56.468ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:608
1162024-12-18T22:10:56.468ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/f4e49932-892e-4e15-afe7-919d71bd3012/config/sled-agent-request.json file = common/src/ledger.rs:188
1172024-12-18T22:10:56.468ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/de0dd618-e464-453d-9394-6cb21d5dbefa/config/sled-agent-request.json file = common/src/ledger.rs:188
1182024-12-18T22:10:56.471ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80
1192024-12-18T22:10:56.473ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:9fb2::1]:12346
1202024-12-18T22:10:56.474ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.1.164, last: 10.151.1.173, }, ), ], external_dns_ips: [ 10.151.1.164, 10.151.1.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1203
1212024-12-18T22:10:56.474ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1222024-12-18T22:10:56.474ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:608
1232024-12-18T22:10:56.474ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:608
1242024-12-18T22:10:56.474ZINFOSledAgent (RSS): No ledger in /pool/int/f4e49932-892e-4e15-afe7-919d71bd3012/config/rss-started.marker file = common/src/ledger.rs:188
1252024-12-18T22:10:56.474ZINFOSledAgent (RSS): No ledger in /pool/int/de0dd618-e464-453d-9394-6cb21d5dbefa/config/rss-started.marker file = common/src/ledger.rs:188
1262024-12-18T22:10:56.474ZINFOSledAgent (RSS): No ledger in /pool/int/f4e49932-892e-4e15-afe7-919d71bd3012/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1272024-12-18T22:10:56.474ZINFOSledAgent (RSS): No ledger in /pool/int/de0dd618-e464-453d-9394-6cb21d5dbefa/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1282024-12-18T22:10:56.474ZINFOSledAgent (RSS): RSS not previously run. Creating plans. file = sled-agent/src/rack_setup/service.rs:1252
1292024-12-18T22:10:56.474ZINFOSledAgent (RSS): Writing ledger to /pool/int/f4e49932-892e-4e15-afe7-919d71bd3012/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1302024-12-18T22:10:56.474ZINFOSledAgent (RSS): Writing ledger to /pool/int/de0dd618-e464-453d-9394-6cb21d5dbefa/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1312024-12-18T22:10:56.474ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1284
1322024-12-18T22:10:56.474ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:66
1332024-12-18T22:10:56.474ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:9fb2::1 file = sled-agent/src/rack_setup/plan/sled.rs:39
1342024-12-18T22:10:56.474ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1316
1352024-12-18T22:10:56.474ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
1362024-12-18T22:10:56.474ZINFOSledAgent (bootstore): Writing ledger to /pool/int/f4e49932-892e-4e15-afe7-919d71bd3012/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
1372024-12-18T22:10:56.474ZINFOSledAgent (bootstore): Writing ledger to /pool/int/de0dd618-e464-453d-9394-6cb21d5dbefa/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
1382024-12-18T22:10:56.475ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
1392024-12-18T22:10:56.475ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 (sled), rack_id: cb51312e-7ab9-47f9-9ff4-bd0991c68cd7, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
1402024-12-18T22:10:56.476ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4244
1412024-12-18T22:10:56.476ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4644
1422024-12-18T22:10:56.480ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/client.rs:50
1432024-12-18T22:10:56.487ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1442024-12-18T22:10:56.487ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1452024-12-18T22:10:56.491ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1462024-12-18T22:10:56.491ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1472024-12-18T22:10:56.491ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:47535
1482024-12-18T22:10:56.491ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 (sled), rack_id: cb51312e-7ab9-47f9-9ff4-bd0991c68cd7, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:362
1492024-12-18T22:10:56.491ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:377
1502024-12-18T22:10:56.491ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1512024-12-18T22:10:56.491ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1522024-12-18T22:10:56.491ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:608
1532024-12-18T22:10:56.491ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:814
1542024-12-18T22:10:56.491ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1552024-12-18T22:10:56.491ZINFOSledAgent (StorageManager): No ledger in /pool/int/f4e49932-892e-4e15-afe7-919d71bd3012/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1562024-12-18T22:10:56.491ZINFOSledAgent (StorageManager): No ledger in /pool/int/de0dd618-e464-453d-9394-6cb21d5dbefa/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1572024-12-18T22:10:56.491ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:803
1582024-12-18T22:10:56.491ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:831
1592024-12-18T22:10:56.491ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:597
1602024-12-18T22:10:56.491ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1612024-12-18T22:10:56.491ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:702 result = DisksManagementResult { status: [] }
1622024-12-18T22:10:56.508ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:608
1632024-12-18T22:10:56.529ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:325
1642024-12-18T22:10:56.546ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:363
1652024-12-18T22:10:56.554ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:412 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
1662024-12-18T22:10:56.554ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:608
1672024-12-18T22:10:56.554ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:424 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
1682024-12-18T22:10:56.554ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1692024-12-18T22:10:56.557ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 118.527024ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "4e484dd2-0512-4af1-8b82-3c91673f00f1", "content-length": "124", "date": "Wed, 18 Dec 2024 22:10:56 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "4e484dd2-0512-4af1-8b82-3c91673f00f1" } file = clients/ddm-admin-client/src/lib.rs:177
1702024-12-18T22:10:56.567ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_f4e49932-892e-4e15-afe7-919d71bd3012/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1712024-12-18T22:10:56.590ZINFOSledAgent: successfully created encrypted zvol: name="oxi_f4e49932-892e-4e15-afe7-919d71bd3012/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1722024-12-18T22:10:56.590ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_f4e49932-892e-4e15-afe7-919d71bd3012/swap" file = sled-agent/src/swap_device.rs:96
1732024-12-18T22:10:56.595ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:439 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
1742024-12-18T22:10:56.595ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:129
1752024-12-18T22:10:56.595ZINFOSledAgent (BackingFs): Ensuring dataset oxi_f4e49932-892e-4e15-afe7-919d71bd3012/backing/fmd file = sled-agent/src/backing_fs.rs:139
1762024-12-18T22:10:56.664ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:174
1772024-12-18T22:10:56.677ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1782024-12-18T22:10:56.677ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 101.334841ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "1c2d1a9f-5fc3-44fe-b939-e1fd204d2cdf", "content-length": "124", "date": "Wed, 18 Dec 2024 22:10:56 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "1c2d1a9f-5fc3-44fe-b939-e1fd204d2cdf" } file = clients/ddm-admin-client/src/lib.rs:177
1792024-12-18T22:10:56.779ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1802024-12-18T22:10:56.780ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 133.311207ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "7e27234d-fbef-4a0c-bf89-bd7ea8238535", "content-length": "124", "date": "Wed, 18 Dec 2024 22:10:56 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "7e27234d-fbef-4a0c-bf89-bd7ea8238535" } file = clients/ddm-admin-client/src/lib.rs:177
1812024-12-18T22:10:56.882ZINFOSledAgent (BackingFs): Mounting oxi_f4e49932-892e-4e15-afe7-919d71bd3012/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:182
1822024-12-18T22:10:56.895ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:190
1832024-12-18T22:10:56.896ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:190
1842024-12-18T22:10:56.896ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:190
1852024-12-18T22:10:56.896ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:196
1862024-12-18T22:10:56.915ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1872024-12-18T22:10:56.915ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 175.14583ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "d1552174-53e0-4271-8bfd-79ecc1453f45", "content-length": "124", "date": "Wed, 18 Dec 2024 22:10:56 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "d1552174-53e0-4271-8bfd-79ecc1453f45" } file = clients/ddm-admin-client/src/lib.rs:177
1882024-12-18T22:10:57.092ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1892024-12-18T22:10:57.093ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 214.693247ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "fde0a8a2-059e-42be-87fd-c3d9674855cc", "content-length": "124", "date": "Wed, 18 Dec 2024 22:10:56 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "fde0a8a2-059e-42be-87fd-c3d9674855cc" } file = clients/ddm-admin-client/src/lib.rs:177
1902024-12-18T22:10:57.309ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1912024-12-18T22:10:57.310ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 288.495558ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "9746b3aa-8218-4457-b410-88d60c3020ba", "content-length": "124", "date": "Wed, 18 Dec 2024 22:10:56 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "9746b3aa-8218-4457-b410-88d60c3020ba" } file = clients/ddm-admin-client/src/lib.rs:177
1922024-12-18T22:10:57.599ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1932024-12-18T22:10:57.621ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:93 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
1942024-12-18T22:10:57.626ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:43671 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
1952024-12-18T22:10:57.626ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
1962024-12-18T22:10:57.626ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:43671 file = oximeter/producer/src/lib.rs:279 interval = 30s producer_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
1972024-12-18T22:10:57.627ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 312.618605ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
1982024-12-18T22:10:57.628ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
1992024-12-18T22:10:57.628ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
2002024-12-18T22:10:57.628ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:920 underlay_address = fd00:1122:3344:101::1
2012024-12-18T22:10:57.628ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
2022024-12-18T22:10:57.942ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 273.243866ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
2032024-12-18T22:10:58.217ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 568.273661ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
2042024-12-18T22:10:58.787ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.221944022s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
2052024-12-18T22:11:00.011ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 3.03935904s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
2062024-12-18T22:11:00.206ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2668
2072024-12-18T22:11:00.206ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2913
2082024-12-18T22:11:00.206ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2538
2092024-12-18T22:11:00.206ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2585
2102024-12-18T22:11:00.206ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:2994
2112024-12-18T22:11:00.206ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3039
2122024-12-18T22:11:00.208ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2838
2132024-12-18T22:11:00.209ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2579
2142024-12-18T22:11:00.209ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='81d30d64-dfa4-4312-885b-9a99e787d04e'/> <propval type="astring" name="rack_id" value='cb51312e-7ab9-47f9-9ff4-bd0991c68cd7'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:9fb2::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:fef2:bc5a'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:9fb2::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"buskin","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="rack_id" value='cb51312e-7ab9-47f9-9ff4-bd0991c68cd7'/> <propval type="astring" name="sled_id" value='44b7e384-368a-4bb9-a5b4-e1c12506ebd3'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='buskin'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="host" value='[::1]'/> <propval type="astring" name="port" value='12224'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='buskin'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='44b7e384-368a-4bb9-a5b4-e1c12506ebd3'/> <propval type="astring" name="rack_uuid" value='cb51312e-7ab9-47f9-9ff4-bd0991c68cd7'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='44b7e384-368a-4bb9-a5b4-e1c12506ebd3'/> <propval type="astring" name="rack_uuid" value='cb51312e-7ab9-47f9-9ff4-bd0991c68cd7'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2152024-12-18T22:11:00.209ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_switch
2162024-12-18T22:11:00.431ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 44.78946ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2172024-12-18T22:11:00.638ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 118.316364ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2182024-12-18T22:11:00.815ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 161.271068ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2192024-12-18T22:11:00.990ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 544.841782ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2202024-12-18T22:11:01.569ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 534.90883ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2212024-12-18T22:11:02.146ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.231977956s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2222024-12-18T22:11:03.053ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 11.723602252s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
2232024-12-18T22:11:03.402ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.180422099s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2242024-12-18T22:11:04.720ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.194997887s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2252024-12-18T22:11:06.224ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/44b7e384-368a-4bb9-a5b4-e1c12506ebd3) file = sled-agent/src/nexus.rs:527 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
2262024-12-18T22:11:06.255ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:608
2272024-12-18T22:11:06.256ZINFOSledAgent (dropshot (Repo Depot)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12348 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
2282024-12-18T22:11:06.257ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12345
2292024-12-18T22:11:06.257ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:432
2302024-12-18T22:11:06.257ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:608
2312024-12-18T22:11:06.257ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/f4e49932-892e-4e15-afe7-919d71bd3012/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2322024-12-18T22:11:06.257ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/de0dd618-e464-453d-9394-6cb21d5dbefa/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2332024-12-18T22:11:06.258ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2342024-12-18T22:11:06.258ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some(None), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None }], bgp: [], bfd: [] })))
2352024-12-18T22:11:06.258ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3947
2362024-12-18T22:11:06.258ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:47535
2372024-12-18T22:11:06.444ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:9fb2::1]:12346
2382024-12-18T22:11:06.444ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
2392024-12-18T22:11:06.450ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4268 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2402024-12-18T22:11:06.450ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:4284
2412024-12-18T22:11:06.450ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:534 zone = oxz_switch
2422024-12-18T22:11:06.725ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64984
2432024-12-18T22:11:06.726ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:608
2442024-12-18T22:11:06.726ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:608
2452024-12-18T22:11:06.726ZINFOSledAgent (ServiceManager): No ledger in /pool/int/f4e49932-892e-4e15-afe7-919d71bd3012/config/omicron-zones.json file = common/src/ledger.rs:188
2462024-12-18T22:11:06.726ZINFOSledAgent (ServiceManager): No ledger in /pool/int/de0dd618-e464-453d-9394-6cb21d5dbefa/config/omicron-zones.json file = common/src/ledger.rs:188
2472024-12-18T22:11:06.726ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 451 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:64984 req_id = d5a029fd-9f19-43a7-a7f0-ca41d9c160a1 response_code = 200 uri = /inventory
2482024-12-18T22:11:06.757ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63903
2492024-12-18T22:11:06.758ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:63903 req_id = 69b019ad-3811-4cee-b5eb-389d78e28a2a response_code = 200 uri = /sled-role
2502024-12-18T22:11:06.789ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: b7989e0a-2ae8-4aff-b271-511168b1f75c (physical_disk), pool_id: 7527a580-440a-4d33-b9e5-9f4ac1126696 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 1a500248-699a-464a-9070-422857446668 (physical_disk), pool_id: 8d122e51-f03c-4659-8af4-3a5baca809c5 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: b5276d21-5d7f-48b9-842b-25e1f1c9e94c (physical_disk), pool_id: ebfff57f-9cb4-47bd-acd3-b83eb13e21b5 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: cfc8cbce-2c34-43c3-b6da-eb39c3fd4961 (physical_disk), pool_id: d7b58ec6-9f7e-464f-b0dc-a0d484ac88ac (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: d629de8c-5440-4e20-b481-3812fcb939cf (physical_disk), pool_id: ad207096-a29a-4bc7-b04f-7cf8a526e7ae (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 8614058e-49f1-4715-8d5f-c86c140d8444 (physical_disk), pool_id: a952a3c4-f4b2-4c9a-a310-fb464cba0cce (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 1ce94b56-bc9a-4be2-acfd-3456058f8dd7 (physical_disk), pool_id: 45dbe21c-5eaa-4707-b822-d1348b4d8afc (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 200c00ee-6dfe-491f-89fd-cb5d01f4bd20 (physical_disk), pool_id: 378b1d3c-0145-41bf-ab1f-16bc3c7930e7 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 5d1ecad7-737c-4261-b6e3-16338262a86a (physical_disk), pool_id: 4bf1df73-f4b5-4c23-85b8-9b365d6ea8ae (zpool) }] } file = sled-agent/src/rack_setup/service.rs:385 sled_address = [fd00:1122:3344:101::1]:12345
2512024-12-18T22:11:06.789ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35600
2522024-12-18T22:11:06.790ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:893 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
2532024-12-18T22:11:06.790ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: b7989e0a-2ae8-4aff-b271-511168b1f75c (physical_disk), pool_id: 7527a580-440a-4d33-b9e5-9f4ac1126696 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 1a500248-699a-464a-9070-422857446668 (physical_disk), pool_id: 8d122e51-f03c-4659-8af4-3a5baca809c5 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: b5276d21-5d7f-48b9-842b-25e1f1c9e94c (physical_disk), pool_id: ebfff57f-9cb4-47bd-acd3-b83eb13e21b5 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: cfc8cbce-2c34-43c3-b6da-eb39c3fd4961 (physical_disk), pool_id: d7b58ec6-9f7e-464f-b0dc-a0d484ac88ac (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: d629de8c-5440-4e20-b481-3812fcb939cf (physical_disk), pool_id: ad207096-a29a-4bc7-b04f-7cf8a526e7ae (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 8614058e-49f1-4715-8d5f-c86c140d8444 (physical_disk), pool_id: a952a3c4-f4b2-4c9a-a310-fb464cba0cce (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 1ce94b56-bc9a-4be2-acfd-3456058f8dd7 (physical_disk), pool_id: 45dbe21c-5eaa-4707-b822-d1348b4d8afc (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 200c00ee-6dfe-491f-89fd-cb5d01f4bd20 (physical_disk), pool_id: 378b1d3c-0145-41bf-ab1f-16bc3c7930e7 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 5d1ecad7-737c-4261-b6e3-16338262a86a (physical_disk), pool_id: 4bf1df73-f4b5-4c23-85b8-9b365d6ea8ae (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:608
2542024-12-18T22:11:06.790ZINFOSledAgent (StorageManager): No ledger in /pool/int/f4e49932-892e-4e15-afe7-919d71bd3012/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2552024-12-18T22:11:06.790ZINFOSledAgent (StorageManager): No ledger in /pool/int/de0dd618-e464-453d-9394-6cb21d5dbefa/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2562024-12-18T22:11:06.790ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:1299 request = omicron_physical_disks_ensure
2572024-12-18T22:11:06.790ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2582024-12-18T22:11:06.790ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2592024-12-18T22:11:06.790ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2602024-12-18T22:11:06.790ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2612024-12-18T22:11:06.941ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:367
2622024-12-18T22:11:06.941ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 7527a580-440a-4d33-b9e5-9f4ac1126696 (zpool)
2632024-12-18T22:11:07.393ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3) file = sled-agent/src/probe_manager.rs:231 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
2642024-12-18T22:11:07.604ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
2652024-12-18T22:11:07.631ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12980140317292927811 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
2662024-12-18T22:11:07.631ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12508168010874619151 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
2672024-12-18T22:11:07.654ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 7527a580-440a-4d33-b9e5-9f4ac1126696 (zpool), kind: External }
2682024-12-18T22:11:07.663ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:239
2692024-12-18T22:11:07.663ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:241
2702024-12-18T22:11:07.663ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:245
2712024-12-18T22:11:07.663ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:247
2722024-12-18T22:11:07.663ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2732024-12-18T22:11:07.663ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2742024-12-18T22:11:07.663ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
2752024-12-18T22:11:07.700ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2762024-12-18T22:11:07.709ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_7527a580-440a-4d33-b9e5-9f4ac1126696/crypt/zone file = sled-storage/src/dataset.rs:302
2772024-12-18T22:11:07.846ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_7527a580-440a-4d33-b9e5-9f4ac1126696 file = sled-storage/src/dataset.rs:388
2782024-12-18T22:11:07.854ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
2792024-12-18T22:11:07.854ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
2802024-12-18T22:11:07.854ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
2812024-12-18T22:11:07.854ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2822024-12-18T22:11:07.854ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2832024-12-18T22:11:07.866ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:367
2842024-12-18T22:11:07.866ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 8d122e51-f03c-4659-8af4-3a5baca809c5 (zpool)
2852024-12-18T22:11:07.965ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 8d122e51-f03c-4659-8af4-3a5baca809c5 (zpool), kind: External }
2862024-12-18T22:11:07.972ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:239
2872024-12-18T22:11:07.972ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:241
2882024-12-18T22:11:07.972ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:245
2892024-12-18T22:11:07.972ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:247
2902024-12-18T22:11:07.972ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2912024-12-18T22:11:07.973ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2922024-12-18T22:11:07.973ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
2932024-12-18T22:11:08.006ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2942024-12-18T22:11:08.014ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_8d122e51-f03c-4659-8af4-3a5baca809c5/crypt/zone file = sled-storage/src/dataset.rs:302
2952024-12-18T22:11:08.154ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_8d122e51-f03c-4659-8af4-3a5baca809c5 file = sled-storage/src/dataset.rs:388
2962024-12-18T22:11:08.162ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
2972024-12-18T22:11:08.162ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
2982024-12-18T22:11:08.162ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
2992024-12-18T22:11:08.162ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3002024-12-18T22:11:08.162ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3012024-12-18T22:11:08.171ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:367
3022024-12-18T22:11:08.171ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = ebfff57f-9cb4-47bd-acd3-b83eb13e21b5 (zpool)
3032024-12-18T22:11:08.264ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: ebfff57f-9cb4-47bd-acd3-b83eb13e21b5 (zpool), kind: External }
3042024-12-18T22:11:08.271ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:239
3052024-12-18T22:11:08.271ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:241
3062024-12-18T22:11:08.271ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:245
3072024-12-18T22:11:08.271ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:247
3082024-12-18T22:11:08.271ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3092024-12-18T22:11:08.271ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3102024-12-18T22:11:08.271ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3112024-12-18T22:11:08.303ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3122024-12-18T22:11:08.310ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_ebfff57f-9cb4-47bd-acd3-b83eb13e21b5/crypt/zone file = sled-storage/src/dataset.rs:302
3132024-12-18T22:11:08.395ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3) file = sled-agent/src/probe_manager.rs:231 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
3142024-12-18T22:11:08.446ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_ebfff57f-9cb4-47bd-acd3-b83eb13e21b5 file = sled-storage/src/dataset.rs:388
3152024-12-18T22:11:08.454ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3162024-12-18T22:11:08.454ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3172024-12-18T22:11:08.454ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3182024-12-18T22:11:08.454ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3192024-12-18T22:11:08.454ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3202024-12-18T22:11:08.464ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:367
3212024-12-18T22:11:08.464ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = d7b58ec6-9f7e-464f-b0dc-a0d484ac88ac (zpool)
3222024-12-18T22:11:08.563ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: d7b58ec6-9f7e-464f-b0dc-a0d484ac88ac (zpool), kind: External }
3232024-12-18T22:11:08.571ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:239
3242024-12-18T22:11:08.571ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:241
3252024-12-18T22:11:08.571ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:245
3262024-12-18T22:11:08.571ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:247
3272024-12-18T22:11:08.571ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3282024-12-18T22:11:08.571ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3292024-12-18T22:11:08.571ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3302024-12-18T22:11:08.606ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3312024-12-18T22:11:08.614ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_d7b58ec6-9f7e-464f-b0dc-a0d484ac88ac/crypt/zone file = sled-storage/src/dataset.rs:302
3322024-12-18T22:11:08.754ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_d7b58ec6-9f7e-464f-b0dc-a0d484ac88ac file = sled-storage/src/dataset.rs:388
3332024-12-18T22:11:08.762ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3342024-12-18T22:11:08.762ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3352024-12-18T22:11:08.762ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3362024-12-18T22:11:08.762ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3372024-12-18T22:11:08.762ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3382024-12-18T22:11:08.772ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:367
3392024-12-18T22:11:08.772ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = ad207096-a29a-4bc7-b04f-7cf8a526e7ae (zpool)
3402024-12-18T22:11:08.865ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: ad207096-a29a-4bc7-b04f-7cf8a526e7ae (zpool), kind: External }
3412024-12-18T22:11:08.873ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:239
3422024-12-18T22:11:08.873ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:241
3432024-12-18T22:11:08.873ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:245
3442024-12-18T22:11:08.873ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:247
3452024-12-18T22:11:08.873ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3462024-12-18T22:11:08.873ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3472024-12-18T22:11:08.873ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3482024-12-18T22:11:08.909ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3492024-12-18T22:11:08.918ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_ad207096-a29a-4bc7-b04f-7cf8a526e7ae/crypt/zone file = sled-storage/src/dataset.rs:302
3502024-12-18T22:11:09.058ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_ad207096-a29a-4bc7-b04f-7cf8a526e7ae file = sled-storage/src/dataset.rs:388
3512024-12-18T22:11:09.067ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3522024-12-18T22:11:09.067ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3532024-12-18T22:11:09.067ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3542024-12-18T22:11:09.067ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3552024-12-18T22:11:09.067ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3562024-12-18T22:11:09.077ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:367
3572024-12-18T22:11:09.077ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = a952a3c4-f4b2-4c9a-a310-fb464cba0cce (zpool)
3582024-12-18T22:11:09.172ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: a952a3c4-f4b2-4c9a-a310-fb464cba0cce (zpool), kind: External }
3592024-12-18T22:11:09.180ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:239
3602024-12-18T22:11:09.180ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:241
3612024-12-18T22:11:09.180ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:245
3622024-12-18T22:11:09.180ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:247
3632024-12-18T22:11:09.180ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3642024-12-18T22:11:09.180ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3652024-12-18T22:11:09.180ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3662024-12-18T22:11:09.215ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3672024-12-18T22:11:09.224ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_a952a3c4-f4b2-4c9a-a310-fb464cba0cce/crypt/zone file = sled-storage/src/dataset.rs:302
3682024-12-18T22:11:09.363ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_a952a3c4-f4b2-4c9a-a310-fb464cba0cce file = sled-storage/src/dataset.rs:388
3692024-12-18T22:11:09.371ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3702024-12-18T22:11:09.371ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3712024-12-18T22:11:09.371ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3722024-12-18T22:11:09.371ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3732024-12-18T22:11:09.371ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3742024-12-18T22:11:09.381ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:367
3752024-12-18T22:11:09.381ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 45dbe21c-5eaa-4707-b822-d1348b4d8afc (zpool)
3762024-12-18T22:11:09.475ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 45dbe21c-5eaa-4707-b822-d1348b4d8afc (zpool), kind: External }
3772024-12-18T22:11:09.482ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:239
3782024-12-18T22:11:09.483ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:241
3792024-12-18T22:11:09.483ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:245
3802024-12-18T22:11:09.483ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:247
3812024-12-18T22:11:09.483ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3822024-12-18T22:11:09.483ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3832024-12-18T22:11:09.483ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3842024-12-18T22:11:09.486ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3) file = sled-agent/src/probe_manager.rs:231 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
3852024-12-18T22:11:09.518ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3862024-12-18T22:11:09.527ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_45dbe21c-5eaa-4707-b822-d1348b4d8afc/crypt/zone file = sled-storage/src/dataset.rs:302
3872024-12-18T22:11:09.669ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_45dbe21c-5eaa-4707-b822-d1348b4d8afc file = sled-storage/src/dataset.rs:388
3882024-12-18T22:11:09.678ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
3892024-12-18T22:11:09.678ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
3902024-12-18T22:11:09.678ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
3912024-12-18T22:11:09.678ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3922024-12-18T22:11:09.678ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
3932024-12-18T22:11:09.688ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:367
3942024-12-18T22:11:09.688ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 378b1d3c-0145-41bf-ab1f-16bc3c7930e7 (zpool)
3952024-12-18T22:11:09.783ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 378b1d3c-0145-41bf-ab1f-16bc3c7930e7 (zpool), kind: External }
3962024-12-18T22:11:09.791ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:239
3972024-12-18T22:11:09.791ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:241
3982024-12-18T22:11:09.791ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:245
3992024-12-18T22:11:09.791ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:247
4002024-12-18T22:11:09.791ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4012024-12-18T22:11:09.792ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4022024-12-18T22:11:09.792ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
4032024-12-18T22:11:09.829ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4042024-12-18T22:11:09.837ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_378b1d3c-0145-41bf-ab1f-16bc3c7930e7/crypt/zone file = sled-storage/src/dataset.rs:302
4052024-12-18T22:11:09.983ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_378b1d3c-0145-41bf-ab1f-16bc3c7930e7 file = sled-storage/src/dataset.rs:388
4062024-12-18T22:11:09.991ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
4072024-12-18T22:11:09.991ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4082024-12-18T22:11:09.991ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4092024-12-18T22:11:09.991ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4102024-12-18T22:11:09.991ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4112024-12-18T22:11:10.001ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:367
4122024-12-18T22:11:10.001ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 4bf1df73-f4b5-4c23-85b8-9b365d6ea8ae (zpool)
4132024-12-18T22:11:10.099ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 4bf1df73-f4b5-4c23-85b8-9b365d6ea8ae (zpool), kind: External }
4142024-12-18T22:11:10.108ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:239
4152024-12-18T22:11:10.108ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:241
4162024-12-18T22:11:10.108ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:245
4172024-12-18T22:11:10.108ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:247
4182024-12-18T22:11:10.108ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4192024-12-18T22:11:10.109ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4202024-12-18T22:11:10.109ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
4212024-12-18T22:11:10.146ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4222024-12-18T22:11:10.154ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_4bf1df73-f4b5-4c23-85b8-9b365d6ea8ae/crypt/zone file = sled-storage/src/dataset.rs:302
4232024-12-18T22:11:10.294ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_4bf1df73-f4b5-4c23-85b8-9b365d6ea8ae file = sled-storage/src/dataset.rs:388
4242024-12-18T22:11:10.301ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4252024-12-18T22:11:10.302ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4262024-12-18T22:11:10.302ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/f4e49932-892e-4e15-afe7-919d71bd3012/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4272024-12-18T22:11:10.302ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(2), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f4e49932-892e-4e15-afe7-919d71bd3012 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: de0dd618-e464-453d-9394-6cb21d5dbefa (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7527a580-440a-4d33-b9e5-9f4ac1126696 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8d122e51-f03c-4659-8af4-3a5baca809c5 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: ebfff57f-9cb4-47bd-acd3-b83eb13e21b5 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d7b58ec6-9f7e-464f-b0dc-a0d484ac88ac (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: ad207096-a29a-4bc7-b04f-7cf8a526e7ae (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a952a3c4-f4b2-4c9a-a310-fb464cba0cce (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 45dbe21c-5eaa-4707-b822-d1348b4d8afc (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 378b1d3c-0145-41bf-ab1f-16bc3c7930e7 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 4bf1df73-f4b5-4c23-85b8-9b365d6ea8ae (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4282024-12-18T22:11:10.302ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
4292024-12-18T22:11:10.302ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
4302024-12-18T22:11:10.302ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/de0dd618-e464-453d-9394-6cb21d5dbefa/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4312024-12-18T22:11:10.302ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:897 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
4322024-12-18T22:11:10.302ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:608
4332024-12-18T22:11:10.302ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:923 generation = Generation(2) sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
4342024-12-18T22:11:10.302ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:928 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
4352024-12-18T22:11:10.302ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:933 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
4362024-12-18T22:11:10.302ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:122 gen = Generation(2) sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
4372024-12-18T22:11:10.302ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:939 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
4382024-12-18T22:11:10.302ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(2)
4392024-12-18T22:11:10.302ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:944 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
4402024-12-18T22:11:10.302ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3512642 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:35600 req_id = dad1ebcf-85b8-476f-a917-e0f1d7ddf3a1 response_code = 200 uri = /omicron-physical-disks
4412024-12-18T22:11:10.334ZINFOSledAgent (RSS): attempting to set up sled's datasets: DatasetsConfig { generation: Generation(1), datasets: {0d3479a4-9441-4082-a884-1b1198aa421d (dataset): DatasetConfig { id: 0d3479a4-9441-4082-a884-1b1198aa421d (dataset), name: DatasetName { pool_name: ZpoolName { id: 7527a580-440a-4d33-b9e5-9f4ac1126696 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 0d5fb5ba-9cf2-478f-b0cc-d4b6d2e5eda7 (dataset): DatasetConfig { id: 0d5fb5ba-9cf2-478f-b0cc-d4b6d2e5eda7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 378b1d3c-0145-41bf-ab1f-16bc3c7930e7 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_fbb8f81a-e6a1-4d5a-980c-08bb005aae11" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 13a4307d-4c96-4f97-9c5c-1c2b56ddc3d9 (dataset): DatasetConfig { id: 13a4307d-4c96-4f97-9c5c-1c2b56ddc3d9 (dataset), name: DatasetName { pool_name: ZpoolName { id: ad207096-a29a-4bc7-b04f-7cf8a526e7ae (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2183496f-0a0b-4c80-9543-37ca0ee8db4e (dataset): DatasetConfig { id: 2183496f-0a0b-4c80-9543-37ca0ee8db4e (dataset), name: DatasetName { pool_name: ZpoolName { id: 378b1d3c-0145-41bf-ab1f-16bc3c7930e7 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 26902a7c-a49d-448a-9f3e-633f0aa1f5b6 (dataset): DatasetConfig { id: 26902a7c-a49d-448a-9f3e-633f0aa1f5b6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7527a580-440a-4d33-b9e5-9f4ac1126696 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_98356a8d-08b0-46fd-8961-c8be5019dba9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 32fe432e-180d-4599-a021-8bb8fa658260 (dataset): DatasetConfig { id: 32fe432e-180d-4599-a021-8bb8fa658260 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8d122e51-f03c-4659-8af4-3a5baca809c5 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_30c41a31-69b8-4e44-8478-4a6de914f099" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3330a496-30d5-483f-af31-8a07f386e668 (dataset): DatasetConfig { id: 3330a496-30d5-483f-af31-8a07f386e668 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8d122e51-f03c-4659-8af4-3a5baca809c5 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3568ed23-b191-4958-bbfe-63dca433e78a (dataset): DatasetConfig { id: 3568ed23-b191-4958-bbfe-63dca433e78a (dataset), name: DatasetName { pool_name: ZpoolName { id: d7b58ec6-9f7e-464f-b0dc-a0d484ac88ac (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3889eb4e-65fc-4b89-a8aa-0bf1426e407a (dataset): DatasetConfig { id: 3889eb4e-65fc-4b89-a8aa-0bf1426e407a (dataset), name: DatasetName { pool_name: ZpoolName { id: 8d122e51-f03c-4659-8af4-3a5baca809c5 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3a9221ae-f6d2-4b14-827b-8f75da1bb970 (dataset): DatasetConfig { id: 3a9221ae-f6d2-4b14-827b-8f75da1bb970 (dataset), name: DatasetName { pool_name: ZpoolName { id: ad207096-a29a-4bc7-b04f-7cf8a526e7ae (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3bb337c5-bfc2-48e9-89fe-56ef7b3159e6 (dataset): DatasetConfig { id: 3bb337c5-bfc2-48e9-89fe-56ef7b3159e6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8d122e51-f03c-4659-8af4-3a5baca809c5 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_2d63e98c-3e65-4bbc-9711-e4064e79b88e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 41680c5a-b4d1-452a-a0af-ac5c9254a347 (dataset): DatasetConfig { id: 41680c5a-b4d1-452a-a0af-ac5c9254a347 (dataset), name: DatasetName { pool_name: ZpoolName { id: 45dbe21c-5eaa-4707-b822-d1348b4d8afc (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 44f5ce11-7e28-45ee-be72-2b6b045cc628 (dataset): DatasetConfig { id: 44f5ce11-7e28-45ee-be72-2b6b045cc628 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7527a580-440a-4d33-b9e5-9f4ac1126696 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4633742e-91b7-4dcb-9a3f-857c8a20a70d (dataset): DatasetConfig { id: 4633742e-91b7-4dcb-9a3f-857c8a20a70d (dataset), name: DatasetName { pool_name: ZpoolName { id: ad207096-a29a-4bc7-b04f-7cf8a526e7ae (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_bb3be4a7-c724-4d22-bc17-549855e0c8cd" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 576149f8-9aca-4430-a531-30ceda8bcf96 (dataset): DatasetConfig { id: 576149f8-9aca-4430-a531-30ceda8bcf96 (dataset), name: DatasetName { pool_name: ZpoolName { id: 378b1d3c-0145-41bf-ab1f-16bc3c7930e7 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 57f87ea7-decb-4109-a71f-f2dc0838fe5c (dataset): DatasetConfig { id: 57f87ea7-decb-4109-a71f-f2dc0838fe5c (dataset), name: DatasetName { pool_name: ZpoolName { id: ad207096-a29a-4bc7-b04f-7cf8a526e7ae (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 58604c69-3230-415d-b634-8ef559cdef3d (dataset): DatasetConfig { id: 58604c69-3230-415d-b634-8ef559cdef3d (dataset), name: DatasetName { pool_name: ZpoolName { id: 4bf1df73-f4b5-4c23-85b8-9b365d6ea8ae (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5fd43297-0edf-4cb0-bc7a-259b923326fa (dataset): DatasetConfig { id: 5fd43297-0edf-4cb0-bc7a-259b923326fa (dataset), name: DatasetName { pool_name: ZpoolName { id: 7527a580-440a-4d33-b9e5-9f4ac1126696 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 61f617ff-5dad-46e3-9954-f90fa07c1048 (dataset): DatasetConfig { id: 61f617ff-5dad-46e3-9954-f90fa07c1048 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8d122e51-f03c-4659-8af4-3a5baca809c5 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 644cab43-c6dc-4606-83d8-6e1b8ef3d6ed (dataset): DatasetConfig { id: 644cab43-c6dc-4606-83d8-6e1b8ef3d6ed (dataset), name: DatasetName { pool_name: ZpoolName { id: 4bf1df73-f4b5-4c23-85b8-9b365d6ea8ae (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_892dfd48-eedc-487a-9abc-a386c4d5781d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 690a013e-5ccc-4914-8758-e170f2c2a826 (dataset): DatasetConfig { id: 690a013e-5ccc-4914-8758-e170f2c2a826 (dataset), name: DatasetName { pool_name: ZpoolName { id: a952a3c4-f4b2-4c9a-a310-fb464cba0cce (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 709a6fab-7209-4457-8521-9d561099e822 (dataset): DatasetConfig { id: 709a6fab-7209-4457-8521-9d561099e822 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7527a580-440a-4d33-b9e5-9f4ac1126696 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 70e5b8b9-3262-4fbb-913a-b496baf1457e (dataset): DatasetConfig { id: 70e5b8b9-3262-4fbb-913a-b496baf1457e (dataset), name: DatasetName { pool_name: ZpoolName { id: ebfff57f-9cb4-47bd-acd3-b83eb13e21b5 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_c0e3d114-075e-41a4-a4df-fa8131bbea97" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 74076b68-245f-4aab-a55d-a21b724b7530 (dataset): DatasetConfig { id: 74076b68-245f-4aab-a55d-a21b724b7530 (dataset), name: DatasetName { pool_name: ZpoolName { id: d7b58ec6-9f7e-464f-b0dc-a0d484ac88ac (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_05d26e4d-8692-47ee-871b-e645e0477c82" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 74c3eb17-a10e-4c3d-8122-64f3af9cd1b5 (dataset): DatasetConfig { id: 74c3eb17-a10e-4c3d-8122-64f3af9cd1b5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7527a580-440a-4d33-b9e5-9f4ac1126696 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 757f908a-3696-495e-9db9-b8fc5319d65b (dataset): DatasetConfig { id: 757f908a-3696-495e-9db9-b8fc5319d65b (dataset), name: DatasetName { pool_name: ZpoolName { id: d7b58ec6-9f7e-464f-b0dc-a0d484ac88ac (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 762c825d-1ff6-4508-9435-03cf052cc48e (dataset): DatasetConfig { id: 762c825d-1ff6-4508-9435-03cf052cc48e (dataset), name: DatasetName { pool_name: ZpoolName { id: 45dbe21c-5eaa-4707-b822-d1348b4d8afc (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_864a9415-8555-4a87-a07b-905db0054ab1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 774028b3-5ccf-4f86-81db-8f77e92e25b8 (dataset): DatasetConfig { id: 774028b3-5ccf-4f86-81db-8f77e92e25b8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 378b1d3c-0145-41bf-ab1f-16bc3c7930e7 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 81f85193-d142-4843-84f4-ecd672bfff72 (dataset): DatasetConfig { id: 81f85193-d142-4843-84f4-ecd672bfff72 (dataset), name: DatasetName { pool_name: ZpoolName { id: ebfff57f-9cb4-47bd-acd3-b83eb13e21b5 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 83315af5-5cdc-4d15-8581-75e7b3e08e32 (dataset): DatasetConfig { id: 83315af5-5cdc-4d15-8581-75e7b3e08e32 (dataset), name: DatasetName { pool_name: ZpoolName { id: a952a3c4-f4b2-4c9a-a310-fb464cba0cce (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_6fd466f3-f0b4-4d40-b657-fd8a20eb0188" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8440bf59-220d-42a7-b124-f0af26477553 (dataset): DatasetConfig { id: 8440bf59-220d-42a7-b124-f0af26477553 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4bf1df73-f4b5-4c23-85b8-9b365d6ea8ae (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8633264c-377e-4f20-8be5-84d7327f84e2 (dataset): DatasetConfig { id: 8633264c-377e-4f20-8be5-84d7327f84e2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 45dbe21c-5eaa-4707-b822-d1348b4d8afc (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_b68ca1fd-18e3-41fd-b283-bf3eeea1bccc" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8b340fb1-d14b-4165-b330-2b2aea5868d9 (dataset): DatasetConfig { id: 8b340fb1-d14b-4165-b330-2b2aea5868d9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8d122e51-f03c-4659-8af4-3a5baca809c5 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_387d3af0-07c5-480d-840e-4805c74ee7db" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8da47f83-8ab1-4704-bf0b-be66875b5de1 (dataset): DatasetConfig { id: 8da47f83-8ab1-4704-bf0b-be66875b5de1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8d122e51-f03c-4659-8af4-3a5baca809c5 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9156baa8-20e9-4656-b50a-a2b3f55215dc (dataset): DatasetConfig { id: 9156baa8-20e9-4656-b50a-a2b3f55215dc (dataset), name: DatasetName { pool_name: ZpoolName { id: 7527a580-440a-4d33-b9e5-9f4ac1126696 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 916156cd-5475-4aeb-b2ff-25ded922657c (dataset): DatasetConfig { id: 916156cd-5475-4aeb-b2ff-25ded922657c (dataset), name: DatasetName { pool_name: ZpoolName { id: 4bf1df73-f4b5-4c23-85b8-9b365d6ea8ae (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_175d3cc8-9a02-4cf3-970c-8ec76a875436" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 95690918-d9ed-4249-8b0c-9d954a59c788 (dataset): DatasetConfig { id: 95690918-d9ed-4249-8b0c-9d954a59c788 (dataset), name: DatasetName { pool_name: ZpoolName { id: a952a3c4-f4b2-4c9a-a310-fb464cba0cce (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9a80b5a2-5cbe-4132-a08c-6903301bc78f (dataset): DatasetConfig { id: 9a80b5a2-5cbe-4132-a08c-6903301bc78f (dataset), name: DatasetName { pool_name: ZpoolName { id: 8d122e51-f03c-4659-8af4-3a5baca809c5 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_160de9b3-61fd-47fd-9883-78dcc7b014f0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9be28575-6cf6-442c-b826-81f0a1275c73 (dataset): DatasetConfig { id: 9be28575-6cf6-442c-b826-81f0a1275c73 (dataset), name: DatasetName { pool_name: ZpoolName { id: d7b58ec6-9f7e-464f-b0dc-a0d484ac88ac (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_bd8a0397-a96b-4af7-bb62-cac596d73425" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a99824b1-0db2-40a6-9b51-2565147bde53 (dataset): DatasetConfig { id: a99824b1-0db2-40a6-9b51-2565147bde53 (dataset), name: DatasetName { pool_name: ZpoolName { id: ebfff57f-9cb4-47bd-acd3-b83eb13e21b5 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, b1f4996d-8376-4166-8681-a742e4760ab5 (dataset): DatasetConfig { id: b1f4996d-8376-4166-8681-a742e4760ab5 (dataset), name: DatasetName { pool_name: ZpoolName { id: a952a3c4-f4b2-4c9a-a310-fb464cba0cce (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_ed9cf056-3789-49ba-a138-0933a1135c28" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b6cf4aec-4d47-4f99-9558-cb988300fc17 (dataset): DatasetConfig { id: b6cf4aec-4d47-4f99-9558-cb988300fc17 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7527a580-440a-4d33-b9e5-9f4ac1126696 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b9c421c2-5ff5-495a-ae46-feac3854f5d4 (dataset): DatasetConfig { id: b9c421c2-5ff5-495a-ae46-feac3854f5d4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8d122e51-f03c-4659-8af4-3a5baca809c5 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, bacf79f2-2447-4131-b9fb-be20520445aa (dataset): DatasetConfig { id: bacf79f2-2447-4131-b9fb-be20520445aa (dataset), name: DatasetName { pool_name: ZpoolName { id: d7b58ec6-9f7e-464f-b0dc-a0d484ac88ac (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bc72f5ac-d39e-416a-be5b-7e75cf36d4dc (dataset): DatasetConfig { id: bc72f5ac-d39e-416a-be5b-7e75cf36d4dc (dataset), name: DatasetName { pool_name: ZpoolName { id: 45dbe21c-5eaa-4707-b822-d1348b4d8afc (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, be3a9381-8f16-47b3-b955-e6c90cb55c5f (dataset): DatasetConfig { id: be3a9381-8f16-47b3-b955-e6c90cb55c5f (dataset), name: DatasetName { pool_name: ZpoolName { id: ebfff57f-9cb4-47bd-acd3-b83eb13e21b5 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_ed99c029-5334-47b0-b85e-f2f87bb694f8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c0621e2f-78e1-4915-be6b-97f1af1def0a (dataset): DatasetConfig { id: c0621e2f-78e1-4915-be6b-97f1af1def0a (dataset), name: DatasetName { pool_name: ZpoolName { id: 8d122e51-f03c-4659-8af4-3a5baca809c5 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c5f1c718-f015-4fbc-aad9-775ac99eb6f5 (dataset): DatasetConfig { id: c5f1c718-f015-4fbc-aad9-775ac99eb6f5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 45dbe21c-5eaa-4707-b822-d1348b4d8afc (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c6be7ee2-4b6b-4268-9dae-c15901e5fc8b (dataset): DatasetConfig { id: c6be7ee2-4b6b-4268-9dae-c15901e5fc8b (dataset), name: DatasetName { pool_name: ZpoolName { id: ebfff57f-9cb4-47bd-acd3-b83eb13e21b5 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c80b751f-ff35-42f8-9b34-907a0f5baa53 (dataset): DatasetConfig { id: c80b751f-ff35-42f8-9b34-907a0f5baa53 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7527a580-440a-4d33-b9e5-9f4ac1126696 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_d0ef80fe-5a3c-4585-be47-819c465c7a37" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c8983644-bac7-4f27-a408-55f151834df8 (dataset): DatasetConfig { id: c8983644-bac7-4f27-a408-55f151834df8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7527a580-440a-4d33-b9e5-9f4ac1126696 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c9b7dfa0-b08a-45f6-929c-2424be981b51 (dataset): DatasetConfig { id: c9b7dfa0-b08a-45f6-929c-2424be981b51 (dataset), name: DatasetName { pool_name: ZpoolName { id: a952a3c4-f4b2-4c9a-a310-fb464cba0cce (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c9efeaad-633d-44ae-9f23-1d9343dc035c (dataset): DatasetConfig { id: c9efeaad-633d-44ae-9f23-1d9343dc035c (dataset), name: DatasetName { pool_name: ZpoolName { id: d7b58ec6-9f7e-464f-b0dc-a0d484ac88ac (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, caeae65b-0a97-4fad-9ea3-b5ef7f058c74 (dataset): DatasetConfig { id: caeae65b-0a97-4fad-9ea3-b5ef7f058c74 (dataset), name: DatasetName { pool_name: ZpoolName { id: 45dbe21c-5eaa-4707-b822-d1348b4d8afc (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_509b5c7f-9ddc-4e7c-956e-5984acfd38a7" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cf252d54-ca8d-4060-9a09-bc3a51b3f378 (dataset): DatasetConfig { id: cf252d54-ca8d-4060-9a09-bc3a51b3f378 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7527a580-440a-4d33-b9e5-9f4ac1126696 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_218e3da3-c056-4f46-bedf-ff540f2a1d48" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d9de305c-c8f3-4bab-982f-2d6c277b423c (dataset): DatasetConfig { id: d9de305c-c8f3-4bab-982f-2d6c277b423c (dataset), name: DatasetName { pool_name: ZpoolName { id: ad207096-a29a-4bc7-b04f-7cf8a526e7ae (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_5da3c4e3-d2c7-460e-a404-49d040b513a7" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e03dd384-86a7-41e6-bd05-0ac7533384b1 (dataset): DatasetConfig { id: e03dd384-86a7-41e6-bd05-0ac7533384b1 (dataset), name: DatasetName { pool_name: ZpoolName { id: a952a3c4-f4b2-4c9a-a310-fb464cba0cce (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_2e4f87f5-8c7c-45a2-b576-510817bf70ba" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e089f5f2-00cc-4d3b-98ef-2673f4734d8b (dataset): DatasetConfig { id: e089f5f2-00cc-4d3b-98ef-2673f4734d8b (dataset), name: DatasetName { pool_name: ZpoolName { id: 7527a580-440a-4d33-b9e5-9f4ac1126696 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_1f6d9f8b-59f5-43ba-891a-42b4a2ccfe72" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e368b99b-bc2d-4d7e-880f-fc6ac06bf7ea (dataset): DatasetConfig { id: e368b99b-bc2d-4d7e-880f-fc6ac06bf7ea (dataset), name: DatasetName { pool_name: ZpoolName { id: ad207096-a29a-4bc7-b04f-7cf8a526e7ae (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, eba42824-2039-4f3c-b2b0-430dd2ea478a (dataset): DatasetConfig { id: eba42824-2039-4f3c-b2b0-430dd2ea478a (dataset), name: DatasetName { pool_name: ZpoolName { id: 4bf1df73-f4b5-4c23-85b8-9b365d6ea8ae (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, ed022cd9-8bfc-45ee-bf25-c5f9ae616a91 (dataset): DatasetConfig { id: ed022cd9-8bfc-45ee-bf25-c5f9ae616a91 (dataset), name: DatasetName { pool_name: ZpoolName { id: d7b58ec6-9f7e-464f-b0dc-a0d484ac88ac (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_d36679c6-4e35-4fe0-96fb-11b744574e18" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ede70d96-a469-4d11-8f76-fe6c618f9a7c (dataset): DatasetConfig { id: ede70d96-a469-4d11-8f76-fe6c618f9a7c (dataset), name: DatasetName { pool_name: ZpoolName { id: ebfff57f-9cb4-47bd-acd3-b83eb13e21b5 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, efc85142-5cb9-49c0-af21-37cd4eeb833a (dataset): DatasetConfig { id: efc85142-5cb9-49c0-af21-37cd4eeb833a (dataset), name: DatasetName { pool_name: ZpoolName { id: 7527a580-440a-4d33-b9e5-9f4ac1126696 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_bc74bb1a-84d7-44c0-adcf-bd86a0a3155f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f3d0dcbe-6690-47a2-88ba-6d246895bc88 (dataset): DatasetConfig { id: f3d0dcbe-6690-47a2-88ba-6d246895bc88 (dataset), name: DatasetName { pool_name: ZpoolName { id: ebfff57f-9cb4-47bd-acd3-b83eb13e21b5 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_ce02eff6-97d3-45a9-b8cb-2574fd7d1376" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f4249c32-7b35-460f-b659-c46fca4e1e0a (dataset): DatasetConfig { id: f4249c32-7b35-460f-b659-c46fca4e1e0a (dataset), name: DatasetName { pool_name: ZpoolName { id: ebfff57f-9cb4-47bd-acd3-b83eb13e21b5 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_682b12ed-34b9-4e65-b536-774bb5cb2035" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f9dcb640-306f-4218-a42e-c002edabe99d (dataset): DatasetConfig { id: f9dcb640-306f-4218-a42e-c002edabe99d (dataset), name: DatasetName { pool_name: ZpoolName { id: ebfff57f-9cb4-47bd-acd3-b83eb13e21b5 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} } file = sled-agent/src/rack_setup/service.rs:460 sled_address = [fd00:1122:3344:101::1]:12345
4422024-12-18T22:11:10.334ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62046
4432024-12-18T22:11:10.335ZINFOSledAgent: datasets ensure file = sled-agent/src/sled_agent.rs:859 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
4442024-12-18T22:11:10.335ZINFOSledAgent (StorageManager): Received DatasetsEnsure { config: DatasetsConfig { generation: Generation(1), datasets: {0d3479a4-9441-4082-a884-1b1198aa421d (dataset): DatasetConfig { id: 0d3479a4-9441-4082-a884-1b1198aa421d (dataset), name: DatasetName { pool_name: ZpoolName { id: 7527a580-440a-4d33-b9e5-9f4ac1126696 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 0d5fb5ba-9cf2-478f-b0cc-d4b6d2e5eda7 (dataset): DatasetConfig { id: 0d5fb5ba-9cf2-478f-b0cc-d4b6d2e5eda7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 378b1d3c-0145-41bf-ab1f-16bc3c7930e7 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_fbb8f81a-e6a1-4d5a-980c-08bb005aae11" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 13a4307d-4c96-4f97-9c5c-1c2b56ddc3d9 (dataset): DatasetConfig { id: 13a4307d-4c96-4f97-9c5c-1c2b56ddc3d9 (dataset), name: DatasetName { pool_name: ZpoolName { id: ad207096-a29a-4bc7-b04f-7cf8a526e7ae (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2183496f-0a0b-4c80-9543-37ca0ee8db4e (dataset): DatasetConfig { id: 2183496f-0a0b-4c80-9543-37ca0ee8db4e (dataset), name: DatasetName { pool_name: ZpoolName { id: 378b1d3c-0145-41bf-ab1f-16bc3c7930e7 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 26902a7c-a49d-448a-9f3e-633f0aa1f5b6 (dataset): DatasetConfig { id: 26902a7c-a49d-448a-9f3e-633f0aa1f5b6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7527a580-440a-4d33-b9e5-9f4ac1126696 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_98356a8d-08b0-46fd-8961-c8be5019dba9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 32fe432e-180d-4599-a021-8bb8fa658260 (dataset): DatasetConfig { id: 32fe432e-180d-4599-a021-8bb8fa658260 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8d122e51-f03c-4659-8af4-3a5baca809c5 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_30c41a31-69b8-4e44-8478-4a6de914f099" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3330a496-30d5-483f-af31-8a07f386e668 (dataset): DatasetConfig { id: 3330a496-30d5-483f-af31-8a07f386e668 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8d122e51-f03c-4659-8af4-3a5baca809c5 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3568ed23-b191-4958-bbfe-63dca433e78a (dataset): DatasetConfig { id: 3568ed23-b191-4958-bbfe-63dca433e78a (dataset), name: DatasetName { pool_name: ZpoolName { id: d7b58ec6-9f7e-464f-b0dc-a0d484ac88ac (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3889eb4e-65fc-4b89-a8aa-0bf1426e407a (dataset): DatasetConfig { id: 3889eb4e-65fc-4b89-a8aa-0bf1426e407a (dataset), name: DatasetName { pool_name: ZpoolName { id: 8d122e51-f03c-4659-8af4-3a5baca809c5 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3a9221ae-f6d2-4b14-827b-8f75da1bb970 (dataset): DatasetConfig { id: 3a9221ae-f6d2-4b14-827b-8f75da1bb970 (dataset), name: DatasetName { pool_name: ZpoolName { id: ad207096-a29a-4bc7-b04f-7cf8a526e7ae (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3bb337c5-bfc2-48e9-89fe-56ef7b3159e6 (dataset): DatasetConfig { id: 3bb337c5-bfc2-48e9-89fe-56ef7b3159e6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8d122e51-f03c-4659-8af4-3a5baca809c5 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_2d63e98c-3e65-4bbc-9711-e4064e79b88e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 41680c5a-b4d1-452a-a0af-ac5c9254a347 (dataset): DatasetConfig { id: 41680c5a-b4d1-452a-a0af-ac5c9254a347 (dataset), name: DatasetName { pool_name: ZpoolName { id: 45dbe21c-5eaa-4707-b822-d1348b4d8afc (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 44f5ce11-7e28-45ee-be72-2b6b045cc628 (dataset): DatasetConfig { id: 44f5ce11-7e28-45ee-be72-2b6b045cc628 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7527a580-440a-4d33-b9e5-9f4ac1126696 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4633742e-91b7-4dcb-9a3f-857c8a20a70d (dataset): DatasetConfig { id: 4633742e-91b7-4dcb-9a3f-857c8a20a70d (dataset), name: DatasetName { pool_name: ZpoolName { id: ad207096-a29a-4bc7-b04f-7cf8a526e7ae (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_bb3be4a7-c724-4d22-bc17-549855e0c8cd" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 576149f8-9aca-4430-a531-30ceda8bcf96 (dataset): DatasetConfig { id: 576149f8-9aca-4430-a531-30ceda8bcf96 (dataset), name: DatasetName { pool_name: ZpoolName { id: 378b1d3c-0145-41bf-ab1f-16bc3c7930e7 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 57f87ea7-decb-4109-a71f-f2dc0838fe5c (dataset): DatasetConfig { id: 57f87ea7-decb-4109-a71f-f2dc0838fe5c (dataset), name: DatasetName { pool_name: ZpoolName { id: ad207096-a29a-4bc7-b04f-7cf8a526e7ae (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 58604c69-3230-415d-b634-8ef559cdef3d (dataset): DatasetConfig { id: 58604c69-3230-415d-b634-8ef559cdef3d (dataset), name: DatasetName { pool_name: ZpoolName { id: 4bf1df73-f4b5-4c23-85b8-9b365d6ea8ae (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5fd43297-0edf-4cb0-bc7a-259b923326fa (dataset): DatasetConfig { id: 5fd43297-0edf-4cb0-bc7a-259b923326fa (dataset), name: DatasetName { pool_name: ZpoolName { id: 7527a580-440a-4d33-b9e5-9f4ac1126696 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 61f617ff-5dad-46e3-9954-f90fa07c1048 (dataset): DatasetConfig { id: 61f617ff-5dad-46e3-9954-f90fa07c1048 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8d122e51-f03c-4659-8af4-3a5baca809c5 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 644cab43-c6dc-4606-83d8-6e1b8ef3d6ed (dataset): DatasetConfig { id: 644cab43-c6dc-4606-83d8-6e1b8ef3d6ed (dataset), name: DatasetName { pool_name: ZpoolName { id: 4bf1df73-f4b5-4c23-85b8-9b365d6ea8ae (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_892dfd48-eedc-487a-9abc-a386c4d5781d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 690a013e-5ccc-4914-8758-e170f2c2a826 (dataset): DatasetConfig { id: 690a013e-5ccc-4914-8758-e170f2c2a826 (dataset), name: DatasetName { pool_name: ZpoolName { id: a952a3c4-f4b2-4c9a-a310-fb464cba0cce (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 709a6fab-7209-4457-8521-9d561099e822 (dataset): DatasetConfig { id: 709a6fab-7209-4457-8521-9d561099e822 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7527a580-440a-4d33-b9e5-9f4ac1126696 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 70e5b8b9-3262-4fbb-913a-b496baf1457e (dataset): DatasetConfig { id: 70e5b8b9-3262-4fbb-913a-b496baf1457e (dataset), name: DatasetName { pool_name: ZpoolName { id: ebfff57f-9cb4-47bd-acd3-b83eb13e21b5 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_c0e3d114-075e-41a4-a4df-fa8131bbea97" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 74076b68-245f-4aab-a55d-a21b724b7530 (dataset): DatasetConfig { id: 74076b68-245f-4aab-a55d-a21b724b7530 (dataset), name: DatasetName { pool_name: ZpoolName { id: d7b58ec6-9f7e-464f-b0dc-a0d484ac88ac (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_05d26e4d-8692-47ee-871b-e645e0477c82" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 74c3eb17-a10e-4c3d-8122-64f3af9cd1b5 (dataset): DatasetConfig { id: 74c3eb17-a10e-4c3d-8122-64f3af9cd1b5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7527a580-440a-4d33-b9e5-9f4ac1126696 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 757f908a-3696-495e-9db9-b8fc5319d65b (dataset): DatasetConfig { id: 757f908a-3696-495e-9db9-b8fc5319d65b (dataset), name: DatasetName { pool_name: ZpoolName { id: d7b58ec6-9f7e-464f-b0dc-a0d484ac88ac (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 762c825d-1ff6-4508-9435-03cf052cc48e (dataset): DatasetConfig { id: 762c825d-1ff6-4508-9435-03cf052cc48e (dataset), name: DatasetName { pool_name: ZpoolName { id: 45dbe21c-5eaa-4707-b822-d1348b4d8afc (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_864a9415-8555-4a87-a07b-905db0054ab1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 774028b3-5ccf-4f86-81db-8f77e92e25b8 (dataset): DatasetConfig { id: 774028b3-5ccf-4f86-81db-8f77e92e25b8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 378b1d3c-0145-41bf-ab1f-16bc3c7930e7 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 81f85193-d142-4843-84f4-ecd672bfff72 (dataset): DatasetConfig { id: 81f85193-d142-4843-84f4-ecd672bfff72 (dataset), name: DatasetName { pool_name: ZpoolName { id: ebfff57f-9cb4-47bd-acd3-b83eb13e21b5 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 83315af5-5cdc-4d15-8581-75e7b3e08e32 (dataset): DatasetConfig { id: 83315af5-5cdc-4d15-8581-75e7b3e08e32 (dataset), name: DatasetName { pool_name: ZpoolName { id: a952a3c4-f4b2-4c9a-a310-fb464cba0cce (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_6fd466f3-f0b4-4d40-b657-fd8a20eb0188" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8440bf59-220d-42a7-b124-f0af26477553 (dataset): DatasetConfig { id: 8440bf59-220d-42a7-b124-f0af26477553 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4bf1df73-f4b5-4c23-85b8-9b365d6ea8ae (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8633264c-377e-4f20-8be5-84d7327f84e2 (dataset): DatasetConfig { id: 8633264c-377e-4f20-8be5-84d7327f84e2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 45dbe21c-5eaa-4707-b822-d1348b4d8afc (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_b68ca1fd-18e3-41fd-b283-bf3eeea1bccc" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8b340fb1-d14b-4165-b330-2b2aea5868d9 (dataset): DatasetConfig { id: 8b340fb1-d14b-4165-b330-2b2aea5868d9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8d122e51-f03c-4659-8af4-3a5baca809c5 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_387d3af0-07c5-480d-840e-4805c74ee7db" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8da47f83-8ab1-4704-bf0b-be66875b5de1 (dataset): DatasetConfig { id: 8da47f83-8ab1-4704-bf0b-be66875b5de1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8d122e51-f03c-4659-8af4-3a5baca809c5 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9156baa8-20e9-4656-b50a-a2b3f55215dc (dataset): DatasetConfig { id: 9156baa8-20e9-4656-b50a-a2b3f55215dc (dataset), name: DatasetName { pool_name: ZpoolName { id: 7527a580-440a-4d33-b9e5-9f4ac1126696 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 916156cd-5475-4aeb-b2ff-25ded922657c (dataset): DatasetConfig { id: 916156cd-5475-4aeb-b2ff-25ded922657c (dataset), name: DatasetName { pool_name: ZpoolName { id: 4bf1df73-f4b5-4c23-85b8-9b365d6ea8ae (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_175d3cc8-9a02-4cf3-970c-8ec76a875436" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 95690918-d9ed-4249-8b0c-9d954a59c788 (dataset): DatasetConfig { id: 95690918-d9ed-4249-8b0c-9d954a59c788 (dataset), name: DatasetName { pool_name: ZpoolName { id: a952a3c4-f4b2-4c9a-a310-fb464cba0cce (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9a80b5a2-5cbe-4132-a08c-6903301bc78f (dataset): DatasetConfig { id: 9a80b5a2-5cbe-4132-a08c-6903301bc78f (dataset), name: DatasetName { pool_name: ZpoolName { id: 8d122e51-f03c-4659-8af4-3a5baca809c5 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_160de9b3-61fd-47fd-9883-78dcc7b014f0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9be28575-6cf6-442c-b826-81f0a1275c73 (dataset): DatasetConfig { id: 9be28575-6cf6-442c-b826-81f0a1275c73 (dataset), name: DatasetName { pool_name: ZpoolName { id: d7b58ec6-9f7e-464f-b0dc-a0d484ac88ac (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_bd8a0397-a96b-4af7-bb62-cac596d73425" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a99824b1-0db2-40a6-9b51-2565147bde53 (dataset): DatasetConfig { id: a99824b1-0db2-40a6-9b51-2565147bde53 (dataset), name: DatasetName { pool_name: ZpoolName { id: ebfff57f-9cb4-47bd-acd3-b83eb13e21b5 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, b1f4996d-8376-4166-8681-a742e4760ab5 (dataset): DatasetConfig { id: b1f4996d-8376-4166-8681-a742e4760ab5 (dataset), name: DatasetName { pool_name: ZpoolName { id: a952a3c4-f4b2-4c9a-a310-fb464cba0cce (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_ed9cf056-3789-49ba-a138-0933a1135c28" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b6cf4aec-4d47-4f99-9558-cb988300fc17 (dataset): DatasetConfig { id: b6cf4aec-4d47-4f99-9558-cb988300fc17 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7527a580-440a-4d33-b9e5-9f4ac1126696 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b9c421c2-5ff5-495a-ae46-feac3854f5d4 (dataset): DatasetConfig { id: b9c421c2-5ff5-495a-ae46-feac3854f5d4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8d122e51-f03c-4659-8af4-3a5baca809c5 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, bacf79f2-2447-4131-b9fb-be20520445aa (dataset): DatasetConfig { id: bacf79f2-2447-4131-b9fb-be20520445aa (dataset), name: DatasetName { pool_name: ZpoolName { id: d7b58ec6-9f7e-464f-b0dc-a0d484ac88ac (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bc72f5ac-d39e-416a-be5b-7e75cf36d4dc (dataset): DatasetConfig { id: bc72f5ac-d39e-416a-be5b-7e75cf36d4dc (dataset), name: DatasetName { pool_name: ZpoolName { id: 45dbe21c-5eaa-4707-b822-d1348b4d8afc (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, be3a9381-8f16-47b3-b955-e6c90cb55c5f (dataset): DatasetConfig { id: be3a9381-8f16-47b3-b955-e6c90cb55c5f (dataset), name: DatasetName { pool_name: ZpoolName { id: ebfff57f-9cb4-47bd-acd3-b83eb13e21b5 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_ed99c029-5334-47b0-b85e-f2f87bb694f8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c0621e2f-78e1-4915-be6b-97f1af1def0a (dataset): DatasetConfig { id: c0621e2f-78e1-4915-be6b-97f1af1def0a (dataset), name: DatasetName { pool_name: ZpoolName { id: 8d122e51-f03c-4659-8af4-3a5baca809c5 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c5f1c718-f015-4fbc-aad9-775ac99eb6f5 (dataset): DatasetConfig { id: c5f1c718-f015-4fbc-aad9-775ac99eb6f5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 45dbe21c-5eaa-4707-b822-d1348b4d8afc (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c6be7ee2-4b6b-4268-9dae-c15901e5fc8b (dataset): DatasetConfig { id: c6be7ee2-4b6b-4268-9dae-c15901e5fc8b (dataset), name: DatasetName { pool_name: ZpoolName { id: ebfff57f-9cb4-47bd-acd3-b83eb13e21b5 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c80b751f-ff35-42f8-9b34-907a0f5baa53 (dataset): DatasetConfig { id: c80b751f-ff35-42f8-9b34-907a0f5baa53 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7527a580-440a-4d33-b9e5-9f4ac1126696 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_d0ef80fe-5a3c-4585-be47-819c465c7a37" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c8983644-bac7-4f27-a408-55f151834df8 (dataset): DatasetConfig { id: c8983644-bac7-4f27-a408-55f151834df8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7527a580-440a-4d33-b9e5-9f4ac1126696 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c9b7dfa0-b08a-45f6-929c-2424be981b51 (dataset): DatasetConfig { id: c9b7dfa0-b08a-45f6-929c-2424be981b51 (dataset), name: DatasetName { pool_name: ZpoolName { id: a952a3c4-f4b2-4c9a-a310-fb464cba0cce (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c9efeaad-633d-44ae-9f23-1d9343dc035c (dataset): DatasetConfig { id: c9efeaad-633d-44ae-9f23-1d9343dc035c (dataset), name: DatasetName { pool_name: ZpoolName { id: d7b58ec6-9f7e-464f-b0dc-a0d484ac88ac (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, caeae65b-0a97-4fad-9ea3-b5ef7f058c74 (dataset): DatasetConfig { id: caeae65b-0a97-4fad-9ea3-b5ef7f058c74 (dataset), name: DatasetName { pool_name: ZpoolName { id: 45dbe21c-5eaa-4707-b822-d1348b4d8afc (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_509b5c7f-9ddc-4e7c-956e-5984acfd38a7" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cf252d54-ca8d-4060-9a09-bc3a51b3f378 (dataset): DatasetConfig { id: cf252d54-ca8d-4060-9a09-bc3a51b3f378 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7527a580-440a-4d33-b9e5-9f4ac1126696 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_218e3da3-c056-4f46-bedf-ff540f2a1d48" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d9de305c-c8f3-4bab-982f-2d6c277b423c (dataset): DatasetConfig { id: d9de305c-c8f3-4bab-982f-2d6c277b423c (dataset), name: DatasetName { pool_name: ZpoolName { id: ad207096-a29a-4bc7-b04f-7cf8a526e7ae (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_5da3c4e3-d2c7-460e-a404-49d040b513a7" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e03dd384-86a7-41e6-bd05-0ac7533384b1 (dataset): DatasetConfig { id: e03dd384-86a7-41e6-bd05-0ac7533384b1 (dataset), name: DatasetName { pool_name: ZpoolName { id: a952a3c4-f4b2-4c9a-a310-fb464cba0cce (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_2e4f87f5-8c7c-45a2-b576-510817bf70ba" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e089f5f2-00cc-4d3b-98ef-2673f4734d8b (dataset): DatasetConfig { id: e089f5f2-00cc-4d3b-98ef-2673f4734d8b (dataset), name: DatasetName { pool_name: ZpoolName { id: 7527a580-440a-4d33-b9e5-9f4ac1126696 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_1f6d9f8b-59f5-43ba-891a-42b4a2ccfe72" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e368b99b-bc2d-4d7e-880f-fc6ac06bf7ea (dataset): DatasetConfig { id: e368b99b-bc2d-4d7e-880f-fc6ac06bf7ea (dataset), name: DatasetName { pool_name: ZpoolName { id: ad207096-a29a-4bc7-b04f-7cf8a526e7ae (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, eba42824-2039-4f3c-b2b0-430dd2ea478a (dataset): DatasetConfig { id: eba42824-2039-4f3c-b2b0-430dd2ea478a (dataset), name: DatasetName { pool_name: ZpoolName { id: 4bf1df73-f4b5-4c23-85b8-9b365d6ea8ae (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, ed022cd9-8bfc-45ee-bf25-c5f9ae616a91 (dataset): DatasetConfig { id: ed022cd9-8bfc-45ee-bf25-c5f9ae616a91 (dataset), name: DatasetName { pool_name: ZpoolName { id: d7b58ec6-9f7e-464f-b0dc-a0d484ac88ac (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_d36679c6-4e35-4fe0-96fb-11b744574e18" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ede70d96-a469-4d11-8f76-fe6c618f9a7c (dataset): DatasetConfig { id: ede70d96-a469-4d11-8f76-fe6c618f9a7c (dataset), name: DatasetName { pool_name: ZpoolName { id: ebfff57f-9cb4-47bd-acd3-b83eb13e21b5 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, efc85142-5cb9-49c0-af21-37cd4eeb833a (dataset): DatasetConfig { id: efc85142-5cb9-49c0-af21-37cd4eeb833a (dataset), name: DatasetName { pool_name: ZpoolName { id: 7527a580-440a-4d33-b9e5-9f4ac1126696 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_bc74bb1a-84d7-44c0-adcf-bd86a0a3155f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f3d0dcbe-6690-47a2-88ba-6d246895bc88 (dataset): DatasetConfig { id: f3d0dcbe-6690-47a2-88ba-6d246895bc88 (dataset), name: DatasetName { pool_name: ZpoolName { id: ebfff57f-9cb4-47bd-acd3-b83eb13e21b5 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_ce02eff6-97d3-45a9-b8cb-2574fd7d1376" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f4249c32-7b35-460f-b659-c46fca4e1e0a (dataset): DatasetConfig { id: f4249c32-7b35-460f-b659-c46fca4e1e0a (dataset), name: DatasetName { pool_name: ZpoolName { id: ebfff57f-9cb4-47bd-acd3-b83eb13e21b5 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_682b12ed-34b9-4e65-b536-774bb5cb2035" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f9dcb640-306f-4218-a42e-c002edabe99d (dataset): DatasetConfig { id: f9dcb640-306f-4218-a42e-c002edabe99d (dataset), name: DatasetName { pool_name: ZpoolName { id: ebfff57f-9cb4-47bd-acd3-b83eb13e21b5 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} }, tx: ... } file = sled-storage/src/manager.rs:608
4452024-12-18T22:11:10.335ZINFOSledAgent (StorageManager): No ledger in /pool/int/f4e49932-892e-4e15-afe7-919d71bd3012/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4462024-12-18T22:11:10.335ZINFOSledAgent (StorageManager): No ledger in /pool/int/de0dd618-e464-453d-9394-6cb21d5dbefa/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4472024-12-18T22:11:10.335ZINFOSledAgent (StorageManager): No previously-stored 'requested datasets', creating new ledger file = sled-storage/src/manager.rs:910 request = datasets_ensure
4482024-12-18T22:11:10.350ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1040 request = datasets_ensure
4492024-12-18T22:11:10.350ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:999 request = datasets_ensure
4502024-12-18T22:11:10.350ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7527a580-440a-4d33-b9e5-9f4ac1126696/crypt/debug"), full_name: "oxp_7527a580-440a-4d33-b9e5-9f4ac1126696/crypt/debug" } file = sled-storage/src/manager.rs:1432
4512024-12-18T22:11:10.380ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1040 request = datasets_ensure
4522024-12-18T22:11:10.380ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:994 request = datasets_ensure
4532024-12-18T22:11:10.380ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/378b1d3c-0145-41bf-ab1f-16bc3c7930e7/crypt/zone/oxz_crucible_fbb8f81a-e6a1-4d5a-980c-08bb005aae11"), full_name: "oxp_378b1d3c-0145-41bf-ab1f-16bc3c7930e7/crypt/zone/oxz_crucible_fbb8f81a-e6a1-4d5a-980c-08bb005aae11" } file = sled-storage/src/manager.rs:1432
4542024-12-18T22:11:10.440ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1040 request = datasets_ensure
4552024-12-18T22:11:10.440ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:994 request = datasets_ensure
4562024-12-18T22:11:10.440ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_ad207096-a29a-4bc7-b04f-7cf8a526e7ae/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1432
4572024-12-18T22:11:10.488ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3) file = sled-agent/src/probe_manager.rs:231 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
4582024-12-18T22:11:10.489ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1040 request = datasets_ensure
4592024-12-18T22:11:10.489ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:999 request = datasets_ensure
4602024-12-18T22:11:10.489ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/378b1d3c-0145-41bf-ab1f-16bc3c7930e7/crypt/zone"), full_name: "oxp_378b1d3c-0145-41bf-ab1f-16bc3c7930e7/crypt/zone" } file = sled-storage/src/manager.rs:1432
4612024-12-18T22:11:10.517ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1040 request = datasets_ensure
4622024-12-18T22:11:10.517ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:994 request = datasets_ensure
4632024-12-18T22:11:10.517ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7527a580-440a-4d33-b9e5-9f4ac1126696/crypt/zone/oxz_clickhouse_98356a8d-08b0-46fd-8961-c8be5019dba9"), full_name: "oxp_7527a580-440a-4d33-b9e5-9f4ac1126696/crypt/zone/oxz_clickhouse_98356a8d-08b0-46fd-8961-c8be5019dba9" } file = sled-storage/src/manager.rs:1432
4642024-12-18T22:11:10.586ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1040 request = datasets_ensure
4652024-12-18T22:11:10.586ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:994 request = datasets_ensure
4662024-12-18T22:11:10.586ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8d122e51-f03c-4659-8af4-3a5baca809c5/crypt/zone/oxz_internal_dns_30c41a31-69b8-4e44-8478-4a6de914f099"), full_name: "oxp_8d122e51-f03c-4659-8af4-3a5baca809c5/crypt/zone/oxz_internal_dns_30c41a31-69b8-4e44-8478-4a6de914f099" } file = sled-storage/src/manager.rs:1432
4672024-12-18T22:11:10.644ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1040 request = datasets_ensure
4682024-12-18T22:11:10.644ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:994 request = datasets_ensure
4692024-12-18T22:11:10.644ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_8d122e51-f03c-4659-8af4-3a5baca809c5/crypt/internal_dns" } file = sled-storage/src/manager.rs:1432
4702024-12-18T22:11:10.694ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1040 request = datasets_ensure
4712024-12-18T22:11:10.694ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:999 request = datasets_ensure
4722024-12-18T22:11:10.694ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d7b58ec6-9f7e-464f-b0dc-a0d484ac88ac/crypt/zone"), full_name: "oxp_d7b58ec6-9f7e-464f-b0dc-a0d484ac88ac/crypt/zone" } file = sled-storage/src/manager.rs:1432
4732024-12-18T22:11:10.723ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1040 request = datasets_ensure
4742024-12-18T22:11:10.723ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:994 request = datasets_ensure
4752024-12-18T22:11:10.723ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_8d122e51-f03c-4659-8af4-3a5baca809c5/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1432
4762024-12-18T22:11:10.770ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1040 request = datasets_ensure
4772024-12-18T22:11:10.770ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:999 request = datasets_ensure
4782024-12-18T22:11:10.770ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ad207096-a29a-4bc7-b04f-7cf8a526e7ae/crypt/zone"), full_name: "oxp_ad207096-a29a-4bc7-b04f-7cf8a526e7ae/crypt/zone" } file = sled-storage/src/manager.rs:1432
4792024-12-18T22:11:10.799ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1040 request = datasets_ensure
4802024-12-18T22:11:10.799ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:994 request = datasets_ensure
4812024-12-18T22:11:10.799ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8d122e51-f03c-4659-8af4-3a5baca809c5/crypt/zone/oxz_cockroachdb_2d63e98c-3e65-4bbc-9711-e4064e79b88e"), full_name: "oxp_8d122e51-f03c-4659-8af4-3a5baca809c5/crypt/zone/oxz_cockroachdb_2d63e98c-3e65-4bbc-9711-e4064e79b88e" } file = sled-storage/src/manager.rs:1432
4822024-12-18T22:11:10.856ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1040 request = datasets_ensure
4832024-12-18T22:11:10.856ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:994 request = datasets_ensure
4842024-12-18T22:11:10.856ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_45dbe21c-5eaa-4707-b822-d1348b4d8afc/crucible" } file = sled-storage/src/manager.rs:1432
4852024-12-18T22:11:10.904ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1040 request = datasets_ensure
4862024-12-18T22:11:10.904ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:994 request = datasets_ensure
4872024-12-18T22:11:10.904ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_7527a580-440a-4d33-b9e5-9f4ac1126696/crucible" } file = sled-storage/src/manager.rs:1432
4882024-12-18T22:11:10.952ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1040 request = datasets_ensure
4892024-12-18T22:11:10.952ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:994 request = datasets_ensure
4902024-12-18T22:11:10.952ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ad207096-a29a-4bc7-b04f-7cf8a526e7ae/crypt/zone/oxz_crucible_bb3be4a7-c724-4d22-bc17-549855e0c8cd"), full_name: "oxp_ad207096-a29a-4bc7-b04f-7cf8a526e7ae/crypt/zone/oxz_crucible_bb3be4a7-c724-4d22-bc17-549855e0c8cd" } file = sled-storage/src/manager.rs:1432
4912024-12-18T22:11:11.013ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1040 request = datasets_ensure
4922024-12-18T22:11:11.013ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:994 request = datasets_ensure
4932024-12-18T22:11:11.013ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_378b1d3c-0145-41bf-ab1f-16bc3c7930e7/crucible" } file = sled-storage/src/manager.rs:1432
4942024-12-18T22:11:11.061ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1040 request = datasets_ensure
4952024-12-18T22:11:11.061ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:994 request = datasets_ensure
4962024-12-18T22:11:11.061ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_ad207096-a29a-4bc7-b04f-7cf8a526e7ae/crucible" } file = sled-storage/src/manager.rs:1432
4972024-12-18T22:11:11.110ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1040 request = datasets_ensure
4982024-12-18T22:11:11.110ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:999 request = datasets_ensure
4992024-12-18T22:11:11.110ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4bf1df73-f4b5-4c23-85b8-9b365d6ea8ae/crypt/zone"), full_name: "oxp_4bf1df73-f4b5-4c23-85b8-9b365d6ea8ae/crypt/zone" } file = sled-storage/src/manager.rs:1432
5002024-12-18T22:11:11.138ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1040 request = datasets_ensure
5012024-12-18T22:11:11.138ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:994 request = datasets_ensure
5022024-12-18T22:11:11.138ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_7527a580-440a-4d33-b9e5-9f4ac1126696/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1432
5032024-12-18T22:11:11.189ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1040 request = datasets_ensure
5042024-12-18T22:11:11.189ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:994 request = datasets_ensure
5052024-12-18T22:11:11.189ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_8d122e51-f03c-4659-8af4-3a5baca809c5/crucible" } file = sled-storage/src/manager.rs:1432
5062024-12-18T22:11:11.238ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1040 request = datasets_ensure
5072024-12-18T22:11:11.238ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:994 request = datasets_ensure
5082024-12-18T22:11:11.238ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4bf1df73-f4b5-4c23-85b8-9b365d6ea8ae/crypt/zone/oxz_crucible_892dfd48-eedc-487a-9abc-a386c4d5781d"), full_name: "oxp_4bf1df73-f4b5-4c23-85b8-9b365d6ea8ae/crypt/zone/oxz_crucible_892dfd48-eedc-487a-9abc-a386c4d5781d" } file = sled-storage/src/manager.rs:1432
5092024-12-18T22:11:11.297ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1040 request = datasets_ensure
5102024-12-18T22:11:11.297ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:999 request = datasets_ensure
5112024-12-18T22:11:11.297ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a952a3c4-f4b2-4c9a-a310-fb464cba0cce/crypt/debug"), full_name: "oxp_a952a3c4-f4b2-4c9a-a310-fb464cba0cce/crypt/debug" } file = sled-storage/src/manager.rs:1432
5122024-12-18T22:11:11.327ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1040 request = datasets_ensure
5132024-12-18T22:11:11.327ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:999 request = datasets_ensure
5142024-12-18T22:11:11.327ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7527a580-440a-4d33-b9e5-9f4ac1126696/crypt/zone"), full_name: "oxp_7527a580-440a-4d33-b9e5-9f4ac1126696/crypt/zone" } file = sled-storage/src/manager.rs:1432
5152024-12-18T22:11:11.356ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1040 request = datasets_ensure
5162024-12-18T22:11:11.356ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:994 request = datasets_ensure
5172024-12-18T22:11:11.356ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ebfff57f-9cb4-47bd-acd3-b83eb13e21b5/crypt/zone/oxz_nexus_c0e3d114-075e-41a4-a4df-fa8131bbea97"), full_name: "oxp_ebfff57f-9cb4-47bd-acd3-b83eb13e21b5/crypt/zone/oxz_nexus_c0e3d114-075e-41a4-a4df-fa8131bbea97" } file = sled-storage/src/manager.rs:1432
5182024-12-18T22:11:11.416ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1040 request = datasets_ensure
5192024-12-18T22:11:11.416ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:994 request = datasets_ensure
5202024-12-18T22:11:11.416ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d7b58ec6-9f7e-464f-b0dc-a0d484ac88ac/crypt/zone/oxz_crucible_pantry_05d26e4d-8692-47ee-871b-e645e0477c82"), full_name: "oxp_d7b58ec6-9f7e-464f-b0dc-a0d484ac88ac/crypt/zone/oxz_crucible_pantry_05d26e4d-8692-47ee-871b-e645e0477c82" } file = sled-storage/src/manager.rs:1432
5212024-12-18T22:11:11.475ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1040 request = datasets_ensure
5222024-12-18T22:11:11.475ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:994 request = datasets_ensure
5232024-12-18T22:11:11.475ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_7527a580-440a-4d33-b9e5-9f4ac1126696/crypt/internal_dns" } file = sled-storage/src/manager.rs:1432
5242024-12-18T22:11:11.491ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3) file = sled-agent/src/probe_manager.rs:231 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
5252024-12-18T22:11:11.523ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1040 request = datasets_ensure
5262024-12-18T22:11:11.523ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:994 request = datasets_ensure
5272024-12-18T22:11:11.523ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_d7b58ec6-9f7e-464f-b0dc-a0d484ac88ac/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1432
5282024-12-18T22:11:11.573ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1040 request = datasets_ensure
5292024-12-18T22:11:11.573ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:994 request = datasets_ensure
5302024-12-18T22:11:11.573ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/45dbe21c-5eaa-4707-b822-d1348b4d8afc/crypt/zone/oxz_crucible_864a9415-8555-4a87-a07b-905db0054ab1"), full_name: "oxp_45dbe21c-5eaa-4707-b822-d1348b4d8afc/crypt/zone/oxz_crucible_864a9415-8555-4a87-a07b-905db0054ab1" } file = sled-storage/src/manager.rs:1432
5312024-12-18T22:11:11.632ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1040 request = datasets_ensure
5322024-12-18T22:11:11.632ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:999 request = datasets_ensure
5332024-12-18T22:11:11.632ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/378b1d3c-0145-41bf-ab1f-16bc3c7930e7/crypt/debug"), full_name: "oxp_378b1d3c-0145-41bf-ab1f-16bc3c7930e7/crypt/debug" } file = sled-storage/src/manager.rs:1432
5342024-12-18T22:11:11.661ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1040 request = datasets_ensure
5352024-12-18T22:11:11.661ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:994 request = datasets_ensure
5362024-12-18T22:11:11.661ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_ebfff57f-9cb4-47bd-acd3-b83eb13e21b5/crypt/internal_dns" } file = sled-storage/src/manager.rs:1432
5372024-12-18T22:11:11.709ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1040 request = datasets_ensure
5382024-12-18T22:11:11.709ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:994 request = datasets_ensure
5392024-12-18T22:11:11.709ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a952a3c4-f4b2-4c9a-a310-fb464cba0cce/crypt/zone/oxz_oximeter_6fd466f3-f0b4-4d40-b657-fd8a20eb0188"), full_name: "oxp_a952a3c4-f4b2-4c9a-a310-fb464cba0cce/crypt/zone/oxz_oximeter_6fd466f3-f0b4-4d40-b657-fd8a20eb0188" } file = sled-storage/src/manager.rs:1432
5402024-12-18T22:11:11.767ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1040 request = datasets_ensure
5412024-12-18T22:11:11.767ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:994 request = datasets_ensure
5422024-12-18T22:11:11.767ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_4bf1df73-f4b5-4c23-85b8-9b365d6ea8ae/crucible" } file = sled-storage/src/manager.rs:1432
5432024-12-18T22:11:11.813ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1040 request = datasets_ensure
5442024-12-18T22:11:11.813ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:994 request = datasets_ensure
5452024-12-18T22:11:11.813ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/45dbe21c-5eaa-4707-b822-d1348b4d8afc/crypt/zone/oxz_ntp_b68ca1fd-18e3-41fd-b283-bf3eeea1bccc"), full_name: "oxp_45dbe21c-5eaa-4707-b822-d1348b4d8afc/crypt/zone/oxz_ntp_b68ca1fd-18e3-41fd-b283-bf3eeea1bccc" } file = sled-storage/src/manager.rs:1432
5462024-12-18T22:11:11.872ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1040 request = datasets_ensure
5472024-12-18T22:11:11.872ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:994 request = datasets_ensure
5482024-12-18T22:11:11.872ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8d122e51-f03c-4659-8af4-3a5baca809c5/crypt/zone/oxz_crucible_387d3af0-07c5-480d-840e-4805c74ee7db"), full_name: "oxp_8d122e51-f03c-4659-8af4-3a5baca809c5/crypt/zone/oxz_crucible_387d3af0-07c5-480d-840e-4805c74ee7db" } file = sled-storage/src/manager.rs:1432
5492024-12-18T22:11:11.932ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1040 request = datasets_ensure
5502024-12-18T22:11:11.932ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:994 request = datasets_ensure
5512024-12-18T22:11:11.932ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_8d122e51-f03c-4659-8af4-3a5baca809c5/crypt/external_dns" } file = sled-storage/src/manager.rs:1432
5522024-12-18T22:11:11.983ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1040 request = datasets_ensure
5532024-12-18T22:11:11.983ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:994 request = datasets_ensure
5542024-12-18T22:11:11.983ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_7527a580-440a-4d33-b9e5-9f4ac1126696/crypt/clickhouse" } file = sled-storage/src/manager.rs:1432
5552024-12-18T22:11:12.031ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1040 request = datasets_ensure
5562024-12-18T22:11:12.031ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:994 request = datasets_ensure
5572024-12-18T22:11:12.031ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4bf1df73-f4b5-4c23-85b8-9b365d6ea8ae/crypt/zone/oxz_nexus_175d3cc8-9a02-4cf3-970c-8ec76a875436"), full_name: "oxp_4bf1df73-f4b5-4c23-85b8-9b365d6ea8ae/crypt/zone/oxz_nexus_175d3cc8-9a02-4cf3-970c-8ec76a875436" } file = sled-storage/src/manager.rs:1432
5582024-12-18T22:11:12.090ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1040 request = datasets_ensure
5592024-12-18T22:11:12.090ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:999 request = datasets_ensure
5602024-12-18T22:11:12.090ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a952a3c4-f4b2-4c9a-a310-fb464cba0cce/crypt/zone"), full_name: "oxp_a952a3c4-f4b2-4c9a-a310-fb464cba0cce/crypt/zone" } file = sled-storage/src/manager.rs:1432
5612024-12-18T22:11:12.119ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1040 request = datasets_ensure
5622024-12-18T22:11:12.119ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:994 request = datasets_ensure
5632024-12-18T22:11:12.119ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8d122e51-f03c-4659-8af4-3a5baca809c5/crypt/zone/oxz_external_dns_160de9b3-61fd-47fd-9883-78dcc7b014f0"), full_name: "oxp_8d122e51-f03c-4659-8af4-3a5baca809c5/crypt/zone/oxz_external_dns_160de9b3-61fd-47fd-9883-78dcc7b014f0" } file = sled-storage/src/manager.rs:1432
5642024-12-18T22:11:12.180ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1040 request = datasets_ensure
5652024-12-18T22:11:12.180ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:994 request = datasets_ensure
5662024-12-18T22:11:12.180ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d7b58ec6-9f7e-464f-b0dc-a0d484ac88ac/crypt/zone/oxz_crucible_bd8a0397-a96b-4af7-bb62-cac596d73425"), full_name: "oxp_d7b58ec6-9f7e-464f-b0dc-a0d484ac88ac/crypt/zone/oxz_crucible_bd8a0397-a96b-4af7-bb62-cac596d73425" } file = sled-storage/src/manager.rs:1432
5672024-12-18T22:11:12.239ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1040 request = datasets_ensure
5682024-12-18T22:11:12.239ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:999 request = datasets_ensure
5692024-12-18T22:11:12.239ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ebfff57f-9cb4-47bd-acd3-b83eb13e21b5/crypt/debug"), full_name: "oxp_ebfff57f-9cb4-47bd-acd3-b83eb13e21b5/crypt/debug" } file = sled-storage/src/manager.rs:1432
5702024-12-18T22:11:12.269ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1040 request = datasets_ensure
5712024-12-18T22:11:12.269ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:994 request = datasets_ensure
5722024-12-18T22:11:12.269ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a952a3c4-f4b2-4c9a-a310-fb464cba0cce/crypt/zone/oxz_crucible_pantry_ed9cf056-3789-49ba-a138-0933a1135c28"), full_name: "oxp_a952a3c4-f4b2-4c9a-a310-fb464cba0cce/crypt/zone/oxz_crucible_pantry_ed9cf056-3789-49ba-a138-0933a1135c28" } file = sled-storage/src/manager.rs:1432
5732024-12-18T22:11:12.330ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1040 request = datasets_ensure
5742024-12-18T22:11:12.330ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:994 request = datasets_ensure
5752024-12-18T22:11:12.330ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7527a580-440a-4d33-b9e5-9f4ac1126696/crypt/zone/oxz_nexus_9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395"), full_name: "oxp_7527a580-440a-4d33-b9e5-9f4ac1126696/crypt/zone/oxz_nexus_9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395" } file = sled-storage/src/manager.rs:1432
5762024-12-18T22:11:12.389ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1040 request = datasets_ensure
5772024-12-18T22:11:12.389ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:999 request = datasets_ensure
5782024-12-18T22:11:12.389ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8d122e51-f03c-4659-8af4-3a5baca809c5/crypt/debug"), full_name: "oxp_8d122e51-f03c-4659-8af4-3a5baca809c5/crypt/debug" } file = sled-storage/src/manager.rs:1432
5792024-12-18T22:11:12.417ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1040 request = datasets_ensure
5802024-12-18T22:11:12.417ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:994 request = datasets_ensure
5812024-12-18T22:11:12.417ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_d7b58ec6-9f7e-464f-b0dc-a0d484ac88ac/crucible" } file = sled-storage/src/manager.rs:1432
5822024-12-18T22:11:12.467ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1040 request = datasets_ensure
5832024-12-18T22:11:12.467ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:999 request = datasets_ensure
5842024-12-18T22:11:12.467ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/45dbe21c-5eaa-4707-b822-d1348b4d8afc/crypt/debug"), full_name: "oxp_45dbe21c-5eaa-4707-b822-d1348b4d8afc/crypt/debug" } file = sled-storage/src/manager.rs:1432
5852024-12-18T22:11:12.492ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3) file = sled-agent/src/probe_manager.rs:231 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
5862024-12-18T22:11:12.496ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1040 request = datasets_ensure
5872024-12-18T22:11:12.496ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:994 request = datasets_ensure
5882024-12-18T22:11:12.496ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ebfff57f-9cb4-47bd-acd3-b83eb13e21b5/crypt/zone/oxz_crucible_ed99c029-5334-47b0-b85e-f2f87bb694f8"), full_name: "oxp_ebfff57f-9cb4-47bd-acd3-b83eb13e21b5/crypt/zone/oxz_crucible_ed99c029-5334-47b0-b85e-f2f87bb694f8" } file = sled-storage/src/manager.rs:1432
5892024-12-18T22:11:12.555ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1040 request = datasets_ensure
5902024-12-18T22:11:12.555ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:999 request = datasets_ensure
5912024-12-18T22:11:12.555ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8d122e51-f03c-4659-8af4-3a5baca809c5/crypt/zone"), full_name: "oxp_8d122e51-f03c-4659-8af4-3a5baca809c5/crypt/zone" } file = sled-storage/src/manager.rs:1432
5922024-12-18T22:11:12.584ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1040 request = datasets_ensure
5932024-12-18T22:11:12.584ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:999 request = datasets_ensure
5942024-12-18T22:11:12.584ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/45dbe21c-5eaa-4707-b822-d1348b4d8afc/crypt/zone"), full_name: "oxp_45dbe21c-5eaa-4707-b822-d1348b4d8afc/crypt/zone" } file = sled-storage/src/manager.rs:1432
5952024-12-18T22:11:12.615ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1040 request = datasets_ensure
5962024-12-18T22:11:12.615ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:994 request = datasets_ensure
5972024-12-18T22:11:12.615ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_ebfff57f-9cb4-47bd-acd3-b83eb13e21b5/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1432
5982024-12-18T22:11:12.663ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1040 request = datasets_ensure
5992024-12-18T22:11:12.663ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:994 request = datasets_ensure
6002024-12-18T22:11:12.663ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7527a580-440a-4d33-b9e5-9f4ac1126696/crypt/zone/oxz_external_dns_d0ef80fe-5a3c-4585-be47-819c465c7a37"), full_name: "oxp_7527a580-440a-4d33-b9e5-9f4ac1126696/crypt/zone/oxz_external_dns_d0ef80fe-5a3c-4585-be47-819c465c7a37" } file = sled-storage/src/manager.rs:1432
6012024-12-18T22:11:12.722ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1040 request = datasets_ensure
6022024-12-18T22:11:12.722ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:994 request = datasets_ensure
6032024-12-18T22:11:12.722ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_7527a580-440a-4d33-b9e5-9f4ac1126696/crypt/external_dns" } file = sled-storage/src/manager.rs:1432
6042024-12-18T22:11:12.771ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1040 request = datasets_ensure
6052024-12-18T22:11:12.771ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:994 request = datasets_ensure
6062024-12-18T22:11:12.771ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_a952a3c4-f4b2-4c9a-a310-fb464cba0cce/crucible" } file = sled-storage/src/manager.rs:1432
6072024-12-18T22:11:12.818ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1040 request = datasets_ensure
6082024-12-18T22:11:12.818ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:999 request = datasets_ensure
6092024-12-18T22:11:12.818ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d7b58ec6-9f7e-464f-b0dc-a0d484ac88ac/crypt/debug"), full_name: "oxp_d7b58ec6-9f7e-464f-b0dc-a0d484ac88ac/crypt/debug" } file = sled-storage/src/manager.rs:1432
6102024-12-18T22:11:12.847ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1040 request = datasets_ensure
6112024-12-18T22:11:12.847ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:994 request = datasets_ensure
6122024-12-18T22:11:12.847ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/45dbe21c-5eaa-4707-b822-d1348b4d8afc/crypt/zone/oxz_crucible_pantry_509b5c7f-9ddc-4e7c-956e-5984acfd38a7"), full_name: "oxp_45dbe21c-5eaa-4707-b822-d1348b4d8afc/crypt/zone/oxz_crucible_pantry_509b5c7f-9ddc-4e7c-956e-5984acfd38a7" } file = sled-storage/src/manager.rs:1432
6132024-12-18T22:11:12.906ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1040 request = datasets_ensure
6142024-12-18T22:11:12.906ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:994 request = datasets_ensure
6152024-12-18T22:11:12.906ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7527a580-440a-4d33-b9e5-9f4ac1126696/crypt/zone/oxz_crucible_218e3da3-c056-4f46-bedf-ff540f2a1d48"), full_name: "oxp_7527a580-440a-4d33-b9e5-9f4ac1126696/crypt/zone/oxz_crucible_218e3da3-c056-4f46-bedf-ff540f2a1d48" } file = sled-storage/src/manager.rs:1432
6162024-12-18T22:11:12.966ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1040 request = datasets_ensure
6172024-12-18T22:11:12.966ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:994 request = datasets_ensure
6182024-12-18T22:11:12.966ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ad207096-a29a-4bc7-b04f-7cf8a526e7ae/crypt/zone/oxz_cockroachdb_5da3c4e3-d2c7-460e-a404-49d040b513a7"), full_name: "oxp_ad207096-a29a-4bc7-b04f-7cf8a526e7ae/crypt/zone/oxz_cockroachdb_5da3c4e3-d2c7-460e-a404-49d040b513a7" } file = sled-storage/src/manager.rs:1432
6192024-12-18T22:11:13.025ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1040 request = datasets_ensure
6202024-12-18T22:11:13.025ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:994 request = datasets_ensure
6212024-12-18T22:11:13.025ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a952a3c4-f4b2-4c9a-a310-fb464cba0cce/crypt/zone/oxz_crucible_2e4f87f5-8c7c-45a2-b576-510817bf70ba"), full_name: "oxp_a952a3c4-f4b2-4c9a-a310-fb464cba0cce/crypt/zone/oxz_crucible_2e4f87f5-8c7c-45a2-b576-510817bf70ba" } file = sled-storage/src/manager.rs:1432
6222024-12-18T22:11:13.087ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1040 request = datasets_ensure
6232024-12-18T22:11:13.087ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:994 request = datasets_ensure
6242024-12-18T22:11:13.087ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7527a580-440a-4d33-b9e5-9f4ac1126696/crypt/zone/oxz_cockroachdb_1f6d9f8b-59f5-43ba-891a-42b4a2ccfe72"), full_name: "oxp_7527a580-440a-4d33-b9e5-9f4ac1126696/crypt/zone/oxz_cockroachdb_1f6d9f8b-59f5-43ba-891a-42b4a2ccfe72" } file = sled-storage/src/manager.rs:1432
6252024-12-18T22:11:13.148ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1040 request = datasets_ensure
6262024-12-18T22:11:13.148ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:999 request = datasets_ensure
6272024-12-18T22:11:13.148ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ad207096-a29a-4bc7-b04f-7cf8a526e7ae/crypt/debug"), full_name: "oxp_ad207096-a29a-4bc7-b04f-7cf8a526e7ae/crypt/debug" } file = sled-storage/src/manager.rs:1432
6282024-12-18T22:11:13.177ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1040 request = datasets_ensure
6292024-12-18T22:11:13.177ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:999 request = datasets_ensure
6302024-12-18T22:11:13.177ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4bf1df73-f4b5-4c23-85b8-9b365d6ea8ae/crypt/debug"), full_name: "oxp_4bf1df73-f4b5-4c23-85b8-9b365d6ea8ae/crypt/debug" } file = sled-storage/src/manager.rs:1432
6312024-12-18T22:11:13.205ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1040 request = datasets_ensure
6322024-12-18T22:11:13.205ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:994 request = datasets_ensure
6332024-12-18T22:11:13.205ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d7b58ec6-9f7e-464f-b0dc-a0d484ac88ac/crypt/zone/oxz_cockroachdb_d36679c6-4e35-4fe0-96fb-11b744574e18"), full_name: "oxp_d7b58ec6-9f7e-464f-b0dc-a0d484ac88ac/crypt/zone/oxz_cockroachdb_d36679c6-4e35-4fe0-96fb-11b744574e18" } file = sled-storage/src/manager.rs:1432
6342024-12-18T22:11:13.265ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1040 request = datasets_ensure
6352024-12-18T22:11:13.265ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:999 request = datasets_ensure
6362024-12-18T22:11:13.265ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ebfff57f-9cb4-47bd-acd3-b83eb13e21b5/crypt/zone"), full_name: "oxp_ebfff57f-9cb4-47bd-acd3-b83eb13e21b5/crypt/zone" } file = sled-storage/src/manager.rs:1432
6372024-12-18T22:11:13.295ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1040 request = datasets_ensure
6382024-12-18T22:11:13.295ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:994 request = datasets_ensure
6392024-12-18T22:11:13.295ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7527a580-440a-4d33-b9e5-9f4ac1126696/crypt/zone/oxz_internal_dns_bc74bb1a-84d7-44c0-adcf-bd86a0a3155f"), full_name: "oxp_7527a580-440a-4d33-b9e5-9f4ac1126696/crypt/zone/oxz_internal_dns_bc74bb1a-84d7-44c0-adcf-bd86a0a3155f" } file = sled-storage/src/manager.rs:1432
6402024-12-18T22:11:13.354ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1040 request = datasets_ensure
6412024-12-18T22:11:13.354ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:994 request = datasets_ensure
6422024-12-18T22:11:13.354ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ebfff57f-9cb4-47bd-acd3-b83eb13e21b5/crypt/zone/oxz_cockroachdb_ce02eff6-97d3-45a9-b8cb-2574fd7d1376"), full_name: "oxp_ebfff57f-9cb4-47bd-acd3-b83eb13e21b5/crypt/zone/oxz_cockroachdb_ce02eff6-97d3-45a9-b8cb-2574fd7d1376" } file = sled-storage/src/manager.rs:1432
6432024-12-18T22:11:13.413ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1040 request = datasets_ensure
6442024-12-18T22:11:13.413ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:994 request = datasets_ensure
6452024-12-18T22:11:13.413ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ebfff57f-9cb4-47bd-acd3-b83eb13e21b5/crypt/zone/oxz_internal_dns_682b12ed-34b9-4e65-b536-774bb5cb2035"), full_name: "oxp_ebfff57f-9cb4-47bd-acd3-b83eb13e21b5/crypt/zone/oxz_internal_dns_682b12ed-34b9-4e65-b536-774bb5cb2035" } file = sled-storage/src/manager.rs:1432
6462024-12-18T22:11:13.474ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1040 request = datasets_ensure
6472024-12-18T22:11:13.474ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:994 request = datasets_ensure
6482024-12-18T22:11:13.474ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_ebfff57f-9cb4-47bd-acd3-b83eb13e21b5/crucible" } file = sled-storage/src/manager.rs:1432
6492024-12-18T22:11:13.494ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3) file = sled-agent/src/probe_manager.rs:231 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
6502024-12-18T22:11:13.523ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/f4e49932-892e-4e15-afe7-919d71bd3012/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6512024-12-18T22:11:13.523ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/de0dd618-e464-453d-9394-6cb21d5dbefa/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6522024-12-18T22:11:13.524ZINFOSledAgent: datasets ensure: Updated storage file = sled-agent/src/sled_agent.rs:861 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
6532024-12-18T22:11:13.524ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3189753 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:62046 req_id = ed74a3f4-46a1-4180-ac9b-d24ed07c046f response_code = 200 uri = /datasets
6542024-12-18T22:11:13.556ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: bc74bb1a-84d7-44c0-adcf-bd86a0a3155f (service), filesystem_pool: Some(ZpoolName { id: 7527a580-440a-4d33-b9e5-9f4ac1126696 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7527a580-440a-4d33-b9e5-9f4ac1126696 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 30c41a31-69b8-4e44-8478-4a6de914f099 (service), filesystem_pool: Some(ZpoolName { id: 8d122e51-f03c-4659-8af4-3a5baca809c5 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8d122e51-f03c-4659-8af4-3a5baca809c5 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 682b12ed-34b9-4e65-b536-774bb5cb2035 (service), filesystem_pool: Some(ZpoolName { id: ebfff57f-9cb4-47bd-acd3-b83eb13e21b5 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ebfff57f-9cb4-47bd-acd3-b83eb13e21b5 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
6552024-12-18T22:11:13.556ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42411
6562024-12-18T22:11:13.556ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: bc74bb1a-84d7-44c0-adcf-bd86a0a3155f, dataset_name: DatasetName { pool_name: ZpoolName { id: 7527a580-440a-4d33-b9e5-9f4ac1126696 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:608
6572024-12-18T22:11:13.556ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1479 request = NewFilesystemRequest { dataset_id: bc74bb1a-84d7-44c0-adcf-bd86a0a3155f, dataset_name: DatasetName { pool_name: ZpoolName { id: 7527a580-440a-4d33-b9e5-9f4ac1126696 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6582024-12-18T22:11:13.602ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 30c41a31-69b8-4e44-8478-4a6de914f099, dataset_name: DatasetName { pool_name: ZpoolName { id: 8d122e51-f03c-4659-8af4-3a5baca809c5 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:608
6592024-12-18T22:11:13.602ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1479 request = NewFilesystemRequest { dataset_id: 30c41a31-69b8-4e44-8478-4a6de914f099, dataset_name: DatasetName { pool_name: ZpoolName { id: 8d122e51-f03c-4659-8af4-3a5baca809c5 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6602024-12-18T22:11:13.647ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 682b12ed-34b9-4e65-b536-774bb5cb2035, dataset_name: DatasetName { pool_name: ZpoolName { id: ebfff57f-9cb4-47bd-acd3-b83eb13e21b5 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:608
6612024-12-18T22:11:13.647ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1479 request = NewFilesystemRequest { dataset_id: 682b12ed-34b9-4e65-b536-774bb5cb2035, dataset_name: DatasetName { pool_name: ZpoolName { id: ebfff57f-9cb4-47bd-acd3-b83eb13e21b5 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6622024-12-18T22:11:13.692ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:608
6632024-12-18T22:11:13.692ZINFOSledAgent (ServiceManager): No ledger in /pool/int/f4e49932-892e-4e15-afe7-919d71bd3012/config/omicron-zones.json file = common/src/ledger.rs:188
6642024-12-18T22:11:13.692ZINFOSledAgent (ServiceManager): No ledger in /pool/int/de0dd618-e464-453d-9394-6cb21d5dbefa/config/omicron-zones.json file = common/src/ledger.rs:188
6652024-12-18T22:11:13.692ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:608
6662024-12-18T22:11:13.735ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:608
6672024-12-18T22:11:13.735ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:608
6682024-12-18T22:11:13.735ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:608
6692024-12-18T22:11:13.790ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_bc74bb1a-84d7-44c0-adcf-bd86a0a3155f file = illumos-utils/src/zone.rs:325
6702024-12-18T22:11:13.793ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_682b12ed-34b9-4e65-b536-774bb5cb2035 file = illumos-utils/src/zone.rs:325
6712024-12-18T22:11:13.797ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_30c41a31-69b8-4e44-8478-4a6de914f099 file = illumos-utils/src/zone.rs:325
6722024-12-18T22:11:13.810ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_bc74bb1a-84d7-44c0-adcf-bd86a0a3155f file = illumos-utils/src/zone.rs:363
6732024-12-18T22:11:13.814ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_682b12ed-34b9-4e65-b536-774bb5cb2035 file = illumos-utils/src/zone.rs:363
6742024-12-18T22:11:13.818ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_30c41a31-69b8-4e44-8478-4a6de914f099 file = illumos-utils/src/zone.rs:363
6752024-12-18T22:11:14.497ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3) file = sled-agent/src/probe_manager.rs:231 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
6762024-12-18T22:11:14.778ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 18.652033539s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
6772024-12-18T22:11:15.441ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_682b12ed-34b9-4e65-b536-774bb5cb2035: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6782024-12-18T22:11:15.441ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
6792024-12-18T22:11:15.921ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_bc74bb1a-84d7-44c0-adcf-bd86a0a3155f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6802024-12-18T22:11:15.921ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_682b12ed-34b9-4e65-b536-774bb5cb2035 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_682b12ed-34b9-4e65-b536-774bb5cb2035
6812024-12-18T22:11:16.227ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14692163074548176341 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
6822024-12-18T22:11:16.227ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10562486859642589600 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
6832024-12-18T22:11:16.409ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
6842024-12-18T22:11:16.410ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_30c41a31-69b8-4e44-8478-4a6de914f099: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6852024-12-18T22:11:16.410ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
6862024-12-18T22:11:16.410ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_bc74bb1a-84d7-44c0-adcf-bd86a0a3155f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_bc74bb1a-84d7-44c0-adcf-bd86a0a3155f
6872024-12-18T22:11:16.418ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:4292
6882024-12-18T22:11:16.418ZINFOSledAgent (ServiceManager): Ensuring there is a default route file = sled-agent/src/services.rs:4302 gateway = fd00:1122:3344:101::1
6892024-12-18T22:11:16.427ZINFOSledAgent (ServiceManager): Default route already exists file = sled-agent/src/services.rs:4316 gateway = fd00:1122:3344:101::1
6902024-12-18T22:11:16.427ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4381
6912024-12-18T22:11:16.427ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_682b12ed-34b9-4e65-b536-774bb5cb2035") failed: Property not found. retry in 57.31887ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_682b12ed-34b9-4e65-b536-774bb5cb2035
6922024-12-18T22:11:16.430ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_30c41a31-69b8-4e44-8478-4a6de914f099 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_30c41a31-69b8-4e44-8478-4a6de914f099
6932024-12-18T22:11:16.494ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_682b12ed-34b9-4e65-b536-774bb5cb2035") failed: Property not found. retry in 83.730718ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_682b12ed-34b9-4e65-b536-774bb5cb2035
6942024-12-18T22:11:16.563ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_bc74bb1a-84d7-44c0-adcf-bd86a0a3155f") failed: Property not found. retry in 44.146495ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_bc74bb1a-84d7-44c0-adcf-bd86a0a3155f
6952024-12-18T22:11:16.572ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_30c41a31-69b8-4e44-8478-4a6de914f099") failed: Property not found. retry in 51.02735ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_30c41a31-69b8-4e44-8478-4a6de914f099
6962024-12-18T22:11:16.586ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_682b12ed-34b9-4e65-b536-774bb5cb2035") failed: Property not found. retry in 217.107763ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_682b12ed-34b9-4e65-b536-774bb5cb2035
6972024-12-18T22:11:16.595ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4447
6982024-12-18T22:11:16.595ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4474
6992024-12-18T22:11:16.616ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_bc74bb1a-84d7-44c0-adcf-bd86a0a3155f") failed: Property not found. retry in 79.894224ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_bc74bb1a-84d7-44c0-adcf-bd86a0a3155f
7002024-12-18T22:11:16.640ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_30c41a31-69b8-4e44-8478-4a6de914f099") failed: Property not found. retry in 89.094635ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_30c41a31-69b8-4e44-8478-4a6de914f099
7012024-12-18T22:11:16.918ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4487
7022024-12-18T22:11:16.918ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4333
7032024-12-18T22:11:16.934ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_bc74bb1a-84d7-44c0-adcf-bd86a0a3155f") failed: Property not found. retry in 140.428523ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_bc74bb1a-84d7-44c0-adcf-bd86a0a3155f
7042024-12-18T22:11:16.956ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_682b12ed-34b9-4e65-b536-774bb5cb2035") failed: Property not found. retry in 580.431148ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_682b12ed-34b9-4e65-b536-774bb5cb2035
7052024-12-18T22:11:16.970ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_30c41a31-69b8-4e44-8478-4a6de914f099") failed: Property not found. retry in 268.205709ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_30c41a31-69b8-4e44-8478-4a6de914f099
7062024-12-18T22:11:17.057ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4375
7072024-12-18T22:11:17.057ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4454 rack_subnet = fd00:1122:3344::
7082024-12-18T22:11:17.083ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4465
7092024-12-18T22:11:17.083ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4507
7102024-12-18T22:11:17.085ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_bc74bb1a-84d7-44c0-adcf-bd86a0a3155f") failed: Property not found. retry in 351.009148ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_bc74bb1a-84d7-44c0-adcf-bd86a0a3155f
7112024-12-18T22:11:17.162ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4539
7122024-12-18T22:11:17.162ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4545
7132024-12-18T22:11:17.251ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_30c41a31-69b8-4e44-8478-4a6de914f099") failed: Property not found. retry in 295.842214ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_30c41a31-69b8-4e44-8478-4a6de914f099
7142024-12-18T22:11:17.270ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4586
7152024-12-18T22:11:17.270ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:370
7162024-12-18T22:11:17.303ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:420
7172024-12-18T22:11:17.334ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:717
7182024-12-18T22:11:17.334ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:762
7192024-12-18T22:11:17.335ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:765 uptime = 1
7202024-12-18T22:11:17.335ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.1.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: Some(\n None,\n ),\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n tx_eq: None,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:444
7212024-12-18T22:11:17.370ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
7222024-12-18T22:11:17.423ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:608
7232024-12-18T22:11:17.423ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7242024-12-18T22:11:17.423ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7252024-12-18T22:11:17.423ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7262024-12-18T22:11:17.423ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7272024-12-18T22:11:17.423ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7282024-12-18T22:11:17.423ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7292024-12-18T22:11:17.423ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7302024-12-18T22:11:17.423ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7312024-12-18T22:11:17.423ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7322024-12-18T22:11:17.423ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7332024-12-18T22:11:17.423ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7342024-12-18T22:11:17.423ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7352024-12-18T22:11:17.423ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7362024-12-18T22:11:17.423ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7372024-12-18T22:11:17.423ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7382024-12-18T22:11:17.423ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7392024-12-18T22:11:17.423ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7402024-12-18T22:11:17.423ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7412024-12-18T22:11:17.423ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7422024-12-18T22:11:17.423ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7432024-12-18T22:11:17.423ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7442024-12-18T22:11:17.423ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7452024-12-18T22:11:17.446ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_bc74bb1a-84d7-44c0-adcf-bd86a0a3155f") failed: Property not found. retry in 1.001966971s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_bc74bb1a-84d7-44c0-adcf-bd86a0a3155f
7462024-12-18T22:11:17.546ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_682b12ed-34b9-4e65-b536-774bb5cb2035") failed: Property not found. retry in 497.175927ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_682b12ed-34b9-4e65-b536-774bb5cb2035
7472024-12-18T22:11:17.555ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_30c41a31-69b8-4e44-8478-4a6de914f099") failed: Property not found. retry in 1.02507268s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_30c41a31-69b8-4e44-8478-4a6de914f099
7482024-12-18T22:11:17.633ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12980140317292927811 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
7492024-12-18T22:11:17.633ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12508168010874619151 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
7502024-12-18T22:11:18.056ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_682b12ed-34b9-4e65-b536-774bb5cb2035") failed: Property not found. retry in 694.569597ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_682b12ed-34b9-4e65-b536-774bb5cb2035
7512024-12-18T22:11:18.458ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_bc74bb1a-84d7-44c0-adcf-bd86a0a3155f") failed: Property not found. retry in 631.577594ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_bc74bb1a-84d7-44c0-adcf-bd86a0a3155f
7522024-12-18T22:11:18.591ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_30c41a31-69b8-4e44-8478-4a6de914f099") failed: Property not found. retry in 1.118960317s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_30c41a31-69b8-4e44-8478-4a6de914f099
7532024-12-18T22:11:18.761ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_682b12ed-34b9-4e65-b536-774bb5cb2035") failed: Property not found. retry in 1.020000264s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_682b12ed-34b9-4e65-b536-774bb5cb2035
7542024-12-18T22:11:19.099ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_bc74bb1a-84d7-44c0-adcf-bd86a0a3155f") failed: Property not found. retry in 1.030969079s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_bc74bb1a-84d7-44c0-adcf-bd86a0a3155f
7552024-12-18T22:11:19.717ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_30c41a31-69b8-4e44-8478-4a6de914f099") failed: Property not found. retry in 1.022334058s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_30c41a31-69b8-4e44-8478-4a6de914f099
7562024-12-18T22:11:19.790ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_682b12ed-34b9-4e65-b536-774bb5cb2035") failed: Property not found. retry in 1.032648822s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_682b12ed-34b9-4e65-b536-774bb5cb2035
7572024-12-18T22:11:20.137ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_bc74bb1a-84d7-44c0-adcf-bd86a0a3155f") failed: Property not found. retry in 1.233897381s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_bc74bb1a-84d7-44c0-adcf-bd86a0a3155f
7582024-12-18T22:11:20.749ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_30c41a31-69b8-4e44-8478-4a6de914f099") failed: Property not found. retry in 586.232794ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_30c41a31-69b8-4e44-8478-4a6de914f099
7592024-12-18T22:11:20.831ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_682b12ed-34b9-4e65-b536-774bb5cb2035") failed: Property not found. retry in 713.885092ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_682b12ed-34b9-4e65-b536-774bb5cb2035
7602024-12-18T22:11:21.344ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_30c41a31-69b8-4e44-8478-4a6de914f099") failed: Property not found. retry in 893.735661ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_30c41a31-69b8-4e44-8478-4a6de914f099
7612024-12-18T22:11:21.381ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_bc74bb1a-84d7-44c0-adcf-bd86a0a3155f") failed: Property not found. retry in 870.126761ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_bc74bb1a-84d7-44c0-adcf-bd86a0a3155f
7622024-12-18T22:11:22.268ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_internal_dns_bc74bb1a-84d7-44c0-adcf-bd86a0a3155f
7632024-12-18T22:11:22.268ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_internal_dns_682b12ed-34b9-4e65-b536-774bb5cb2035
7642024-12-18T22:11:22.268ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_internal_dns_30c41a31-69b8-4e44-8478-4a6de914f099
7652024-12-18T22:11:22.268ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/f4e49932-892e-4e15-afe7-919d71bd3012/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7662024-12-18T22:11:22.269ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/de0dd618-e464-453d-9394-6cb21d5dbefa/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7672024-12-18T22:11:22.269ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8712747 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:42411 req_id = 7ad34317-6a10-42bb-a5b5-dbe8482919af response_code = 204 uri = /omicron-zones
7682024-12-18T22:11:22.271ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7692024-12-18T22:11:22.489ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 137.847481ms) dns_config_addr = [fd00:1122:3344:1::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:1::1]:5353/config) file = sled-agent/src/rack_setup/service.rs:678
7702024-12-18T22:11:22.648ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7712024-12-18T22:11:22.696ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7722024-12-18T22:11:22.745ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:694
7732024-12-18T22:11:22.745ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7742024-12-18T22:11:22.775ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7752024-12-18T22:11:22.776ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7762024-12-18T22:11:22.776ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7772024-12-18T22:11:22.805ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: bc74bb1a-84d7-44c0-adcf-bd86a0a3155f (service), filesystem_pool: Some(ZpoolName { id: 7527a580-440a-4d33-b9e5-9f4ac1126696 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7527a580-440a-4d33-b9e5-9f4ac1126696 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 30c41a31-69b8-4e44-8478-4a6de914f099 (service), filesystem_pool: Some(ZpoolName { id: 8d122e51-f03c-4659-8af4-3a5baca809c5 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8d122e51-f03c-4659-8af4-3a5baca809c5 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 682b12ed-34b9-4e65-b536-774bb5cb2035 (service), filesystem_pool: Some(ZpoolName { id: ebfff57f-9cb4-47bd-acd3-b83eb13e21b5 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ebfff57f-9cb4-47bd-acd3-b83eb13e21b5 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: b68ca1fd-18e3-41fd-b283-bf3eeea1bccc (service), filesystem_pool: Some(ZpoolName { id: 45dbe21c-5eaa-4707-b822-d1348b4d8afc (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 30b96b41-ab9f-4ae7-a152-2da2e1688233, kind: Service { id: b68ca1fd-18e3-41fd-b283-bf3eeea1bccc }, name: Name("ntp-b68ca1fd-18e3-41fd-b283-bf3eeea1bccc"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 139, 101])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
7782024-12-18T22:11:22.806ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:65021
7792024-12-18T22:11:22.806ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: bc74bb1a-84d7-44c0-adcf-bd86a0a3155f, dataset_name: DatasetName { pool_name: ZpoolName { id: 7527a580-440a-4d33-b9e5-9f4ac1126696 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:608
7802024-12-18T22:11:22.806ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1479 request = NewFilesystemRequest { dataset_id: bc74bb1a-84d7-44c0-adcf-bd86a0a3155f, dataset_name: DatasetName { pool_name: ZpoolName { id: 7527a580-440a-4d33-b9e5-9f4ac1126696 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7812024-12-18T22:11:22.859ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 30c41a31-69b8-4e44-8478-4a6de914f099, dataset_name: DatasetName { pool_name: ZpoolName { id: 8d122e51-f03c-4659-8af4-3a5baca809c5 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:608
7822024-12-18T22:11:22.859ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1479 request = NewFilesystemRequest { dataset_id: 30c41a31-69b8-4e44-8478-4a6de914f099, dataset_name: DatasetName { pool_name: ZpoolName { id: 8d122e51-f03c-4659-8af4-3a5baca809c5 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7832024-12-18T22:11:22.908ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 682b12ed-34b9-4e65-b536-774bb5cb2035, dataset_name: DatasetName { pool_name: ZpoolName { id: ebfff57f-9cb4-47bd-acd3-b83eb13e21b5 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:608
7842024-12-18T22:11:22.908ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1479 request = NewFilesystemRequest { dataset_id: 682b12ed-34b9-4e65-b536-774bb5cb2035, dataset_name: DatasetName { pool_name: ZpoolName { id: ebfff57f-9cb4-47bd-acd3-b83eb13e21b5 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7852024-12-18T22:11:22.957ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:608
7862024-12-18T22:11:22.957ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/f4e49932-892e-4e15-afe7-919d71bd3012/config/omicron-zones.json file = common/src/ledger.rs:177
7872024-12-18T22:11:22.957ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/de0dd618-e464-453d-9394-6cb21d5dbefa/config/omicron-zones.json file = common/src/ledger.rs:177
7882024-12-18T22:11:22.957ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:608
7892024-12-18T22:11:22.968ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7902024-12-18T22:11:23.001ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7912024-12-18T22:11:23.001ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7922024-12-18T22:11:23.001ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7932024-12-18T22:11:23.031ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 139, 101]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
7942024-12-18T22:11:23.031ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1263 zone_type = boundary_ntp
7952024-12-18T22:11:23.031ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:83
7962024-12-18T22:11:23.031ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:90
7972024-12-18T22:11:23.032ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:118
7982024-12-18T22:11:23.032ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:608
7992024-12-18T22:11:23.057ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_b68ca1fd-18e3-41fd-b283-bf3eeea1bccc file = illumos-utils/src/zone.rs:325
8002024-12-18T22:11:23.075ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_b68ca1fd-18e3-41fd-b283-bf3eeea1bccc file = illumos-utils/src/zone.rs:363
8012024-12-18T22:11:23.669ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_b68ca1fd-18e3-41fd-b283-bf3eeea1bccc: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8022024-12-18T22:11:23.669ZINFOSledAgent (ServiceManager): Booting oxz_ntp_b68ca1fd-18e3-41fd-b283-bf3eeea1bccc zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_ntp_b68ca1fd-18e3-41fd-b283-bf3eeea1bccc
8032024-12-18T22:11:23.805ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_b68ca1fd-18e3-41fd-b283-bf3eeea1bccc") failed: Property not found. retry in 67.158204ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_b68ca1fd-18e3-41fd-b283-bf3eeea1bccc
8042024-12-18T22:11:23.889ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_b68ca1fd-18e3-41fd-b283-bf3eeea1bccc") failed: Property not found. retry in 117.650375ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_b68ca1fd-18e3-41fd-b283-bf3eeea1bccc
8052024-12-18T22:11:24.019ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_b68ca1fd-18e3-41fd-b283-bf3eeea1bccc") failed: Property not found. retry in 297.909198ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_b68ca1fd-18e3-41fd-b283-bf3eeea1bccc
8062024-12-18T22:11:24.326ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_b68ca1fd-18e3-41fd-b283-bf3eeea1bccc") failed: Property not found. retry in 514.793172ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_b68ca1fd-18e3-41fd-b283-bf3eeea1bccc
8072024-12-18T22:11:24.851ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_b68ca1fd-18e3-41fd-b283-bf3eeea1bccc") failed: Property not found. retry in 944.185452ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_b68ca1fd-18e3-41fd-b283-bf3eeea1bccc
8082024-12-18T22:11:25.805ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_b68ca1fd-18e3-41fd-b283-bf3eeea1bccc") failed: Property not found. retry in 663.380542ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_b68ca1fd-18e3-41fd-b283-bf3eeea1bccc
8092024-12-18T22:11:26.229ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14692163074548176341 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
8102024-12-18T22:11:26.229ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10562486859642589600 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
8112024-12-18T22:11:26.477ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_b68ca1fd-18e3-41fd-b283-bf3eeea1bccc") failed: Property not found. retry in 1.193322507s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_b68ca1fd-18e3-41fd-b283-bf3eeea1bccc
8122024-12-18T22:11:27.304ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/44b7e384-368a-4bb9-a5b4-e1c12506ebd3) file = sled-agent/src/nexus.rs:527 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
8132024-12-18T22:11:27.635ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12980140317292927811 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
8142024-12-18T22:11:27.635ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12508168010874619151 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
8152024-12-18T22:11:27.679ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_b68ca1fd-18e3-41fd-b283-bf3eeea1bccc") failed: Property not found. retry in 1.164358312s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_b68ca1fd-18e3-41fd-b283-bf3eeea1bccc
8162024-12-18T22:11:28.863ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_ntp_b68ca1fd-18e3-41fd-b283-bf3eeea1bccc
8172024-12-18T22:11:28.863ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/f4e49932-892e-4e15-afe7-919d71bd3012/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8182024-12-18T22:11:28.864ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/de0dd618-e464-453d-9394-6cb21d5dbefa/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8192024-12-18T22:11:28.864ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6058463 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:65021 req_id = e14eea69-f744-424b-b3e0-94e5aa3c9db4 response_code = 204 uri = /omicron-zones
8202024-12-18T22:11:28.867ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:735
8212024-12-18T22:11:28.899ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8222024-12-18T22:11:28.900ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42182
8232024-12-18T22:11:28.909ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_b68ca1fd-18e3-41fd-b283-bf3eeea1bccc': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
8242024-12-18T22:11:28.909ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 9525 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42182 req_id = bc6979d2-5f09-4f30-8f45-a9fb6bc171b2 response_code = 500 uri = /timesync
8252024-12-18T22:11:28.912ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8262024-12-18T22:11:29.066ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8272024-12-18T22:11:29.066ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62625
8282024-12-18T22:11:31.573ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15126702027370067556 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
8292024-12-18T22:11:32.266ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 362646098280801017 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
8302024-12-18T22:11:32.269ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4590312115495821410 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
8312024-12-18T22:11:33.075ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_b68ca1fd-18e3-41fd-b283-bf3eeea1bccc': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
8322024-12-18T22:11:33.075ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 4009102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:62625 req_id = ebc9ca4b-c619-4b75-b850-19c737028d2d response_code = 500 uri = /timesync
8332024-12-18T22:11:33.077ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8342024-12-18T22:11:33.273ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8352024-12-18T22:11:33.273ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45658
8362024-12-18T22:11:33.282ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_b68ca1fd-18e3-41fd-b283-bf3eeea1bccc': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
8372024-12-18T22:11:33.282ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 8802 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:45658 req_id = 02241057-06e2-446c-88f3-0d63d3539865 response_code = 500 uri = /timesync
8382024-12-18T22:11:33.284ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8392024-12-18T22:11:33.410ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8402024-12-18T22:11:33.410ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48395
8412024-12-18T22:11:36.022ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14692163074548176341 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
8422024-12-18T22:11:36.022ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10562486859642589600 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
8432024-12-18T22:11:37.135ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_b68ca1fd-18e3-41fd-b283-bf3eeea1bccc': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
8442024-12-18T22:11:37.135ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 4008516 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:48395 req_id = 4ab84e74-96b5-4434-a526-493f44199b31 response_code = 500 uri = /timesync
8452024-12-18T22:11:37.137ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8462024-12-18T22:11:37.255ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8472024-12-18T22:11:37.255ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57636
8482024-12-18T22:11:37.264ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8979 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:57636 req_id = 13153522-f435-44b8-8a0f-49494024e7ef response_code = 200 uri = /timesync
8492024-12-18T22:11:37.267ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.2376495 } file = sled-agent/src/rack_setup/service.rs:743
8502024-12-18T22:11:37.267ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8512024-12-18T22:11:37.352ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12980140317292927811 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
8522024-12-18T22:11:37.352ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12508168010874619151 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
8532024-12-18T22:11:37.439ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8542024-12-18T22:11:37.439ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52762
8552024-12-18T22:11:37.448ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8509 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:52762 req_id = d4023c81-34d1-47b9-8338-708ddbd04cb7 response_code = 200 uri = /timesync
8562024-12-18T22:11:37.451ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.235268369 } file = sled-agent/src/rack_setup/service.rs:743
8572024-12-18T22:11:37.451ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8582024-12-18T22:11:37.647ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8592024-12-18T22:11:37.648ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33740
8602024-12-18T22:11:37.656ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8341 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:33740 req_id = 228b043d-6228-48c8-9b88-f3e1359e1e00 response_code = 200 uri = /timesync
8612024-12-18T22:11:37.658ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.234702617 } file = sled-agent/src/rack_setup/service.rs:743
8622024-12-18T22:11:37.658ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8632024-12-18T22:11:37.915ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8642024-12-18T22:11:37.915ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39790
8652024-12-18T22:11:37.924ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8889 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39790 req_id = bdf44084-6320-4c84-84bd-6c17f0d68ac6 response_code = 200 uri = /timesync
8662024-12-18T22:11:37.926ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.233974785 } file = sled-agent/src/rack_setup/service.rs:743
8672024-12-18T22:11:37.926ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8682024-12-18T22:11:38.228ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8692024-12-18T22:11:38.228ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40399
8702024-12-18T22:11:38.236ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8645 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:40399 req_id = 9503d59a-510e-48de-853f-259bee3cdb34 response_code = 200 uri = /timesync
8712024-12-18T22:11:38.238ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.233126119 } file = sled-agent/src/rack_setup/service.rs:743
8722024-12-18T22:11:38.238ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8732024-12-18T22:11:38.502ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8742024-12-18T22:11:38.502ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39867
8752024-12-18T22:11:38.510ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8336 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39867 req_id = 03a8e42e-452a-4a31-9932-c88a177537ab response_code = 200 uri = /timesync
8762024-12-18T22:11:38.512ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.240615606 } file = sled-agent/src/rack_setup/service.rs:743
8772024-12-18T22:11:38.512ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8782024-12-18T22:11:38.579ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6409424678647254293 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
8792024-12-18T22:11:38.580ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2307208435499756027 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
8802024-12-18T22:11:39.172ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8812024-12-18T22:11:39.172ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:36142
8822024-12-18T22:11:39.181ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8464 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:36142 req_id = 923145cd-e95a-475a-87f1-a4dc46803e9e response_code = 200 uri = /timesync
8832024-12-18T22:11:39.183ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.238794208 } file = sled-agent/src/rack_setup/service.rs:743
8842024-12-18T22:11:39.183ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8852024-12-18T22:11:39.856ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8862024-12-18T22:11:39.856ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59731
8872024-12-18T22:11:39.864ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8265 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:59731 req_id = c754da8b-369b-42a5-8c8d-578ad6abbd32 response_code = 200 uri = /timesync
8882024-12-18T22:11:39.866ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.234309793 } file = sled-agent/src/rack_setup/service.rs:743
8892024-12-18T22:11:39.866ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8902024-12-18T22:11:40.658ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8912024-12-18T22:11:40.658ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39789
8922024-12-18T22:11:40.666ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8174 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39789 req_id = d8803a03-062b-4a3b-b404-7102c8839599 response_code = 200 uri = /timesync
8932024-12-18T22:11:40.668ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.231905073 } file = sled-agent/src/rack_setup/service.rs:743
8942024-12-18T22:11:40.668ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8952024-12-18T22:11:41.280ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15126702027370067556 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
8962024-12-18T22:11:41.965ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8972024-12-18T22:11:41.965ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:36821
8982024-12-18T22:11:41.972ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 362646098280801017 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
8992024-12-18T22:11:41.973ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8247 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:36821 req_id = 2c507c17-f81c-4306-8507-43436171aee1 response_code = 200 uri = /timesync
9002024-12-18T22:11:41.975ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4590312115495821410 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
9012024-12-18T22:11:41.976ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2395651603, ip_addr: 142.202.190.19, stratum: 3, ref_time: 1734559900.614231, correction: -0.224174142 } file = sled-agent/src/rack_setup/service.rs:743
9022024-12-18T22:11:41.976ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9032024-12-18T22:11:43.458ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9042024-12-18T22:11:43.458ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42092
9052024-12-18T22:11:43.467ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8834 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42092 req_id = 170d760a-62e0-4523-b8d5-144a5c13f72c response_code = 200 uri = /timesync
9062024-12-18T22:11:43.469ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2395651603, ip_addr: 142.202.190.19, stratum: 3, ref_time: 1734559901.4588957, correction: -0.220172748 } file = sled-agent/src/rack_setup/service.rs:743
9072024-12-18T22:11:43.469ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9082024-12-18T22:11:44.962ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9092024-12-18T22:11:44.962ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41753
9102024-12-18T22:11:44.971ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8546 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:41753 req_id = 6fe4652a-f3f4-4086-9361-2c9c6b7367d5 response_code = 200 uri = /timesync
9112024-12-18T22:11:44.973ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2395651603, ip_addr: 142.202.190.19, stratum: 3, ref_time: 1734559901.4588957, correction: -0.216088951 } file = sled-agent/src/rack_setup/service.rs:743
9122024-12-18T22:11:44.973ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9132024-12-18T22:11:45.926ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14692163074548176341 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
9142024-12-18T22:11:45.927ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10562486859642589600 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
9152024-12-18T22:11:46.031ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9162024-12-18T22:11:46.031ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46998
9172024-12-18T22:11:46.039ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8643 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:46998 req_id = fa273c31-d6a6-4802-b248-a00a6fd9524c response_code = 200 uri = /timesync
9182024-12-18T22:11:46.041ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2395651603, ip_addr: 142.202.190.19, stratum: 3, ref_time: 1734559904.5772817, correction: -0.212169215 } file = sled-agent/src/rack_setup/service.rs:743
9192024-12-18T22:11:46.041ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9202024-12-18T22:11:46.329ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:42912
9212024-12-18T22:11:46.329ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:42912 req_id = ba342f16-8e43-4f68-8377-f56ec884ee1b response_code = 200 uri = /baseboard
9222024-12-18T22:11:47.327ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12980140317292927811 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
9232024-12-18T22:11:47.328ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12508168010874619151 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
9242024-12-18T22:11:48.152ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 324.081334ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
9252024-12-18T22:11:48.504ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9262024-12-18T22:11:48.504ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62802
9272024-12-18T22:11:48.514ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:62802 req_id = cf892563-98e3-44d1-bc32-53f084f8c5f7 response_code = 200 uri = /timesync
9282024-12-18T22:11:48.517ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2395651603, ip_addr: 142.202.190.19, stratum: 3, ref_time: 1734559904.5772817, correction: -0.205449924 } file = sled-agent/src/rack_setup/service.rs:743
9292024-12-18T22:11:48.517ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9302024-12-18T22:11:48.554ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6409424678647254293 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
9312024-12-18T22:11:48.555ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2307208435499756027 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
9322024-12-18T22:11:49.917ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9332024-12-18T22:11:49.917ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60436
9342024-12-18T22:11:49.926ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9167 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:60436 req_id = bd698a0b-8d51-4316-a12e-df63283a3e31 response_code = 200 uri = /timesync
9352024-12-18T22:11:49.929ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2395651603, ip_addr: 142.202.190.19, stratum: 3, ref_time: 1734559904.5772817, correction: -0.201614559 } file = sled-agent/src/rack_setup/service.rs:743
9362024-12-18T22:11:49.929ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9372024-12-18T22:11:51.255ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15126702027370067556 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
9382024-12-18T22:11:51.947ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 362646098280801017 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
9392024-12-18T22:11:51.949ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4590312115495821410 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
9402024-12-18T22:11:52.507ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9412024-12-18T22:11:52.507ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47784
9422024-12-18T22:11:52.516ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8980 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:47784 req_id = 0686226a-f3b5-4baf-b1d6-af91fccfc0e5 response_code = 200 uri = /timesync
9432024-12-18T22:11:52.518ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2395651603, ip_addr: 142.202.190.19, stratum: 3, ref_time: 1734559911.3141952, correction: -0.19472006 } file = sled-agent/src/rack_setup/service.rs:743
9442024-12-18T22:11:52.518ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9452024-12-18T22:11:55.903ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14692163074548176341 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
9462024-12-18T22:11:55.903ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10562486859642589600 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
9472024-12-18T22:11:56.326ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9482024-12-18T22:11:56.327ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54340
9492024-12-18T22:11:56.335ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8543 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:54340 req_id = d78d0678-d1bf-4274-9be7-140cfa3b4840 response_code = 200 uri = /timesync
9502024-12-18T22:11:56.337ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2395651603, ip_addr: 142.202.190.19, stratum: 3, ref_time: 1734559914.894419, correction: -0.183791339 } file = sled-agent/src/rack_setup/service.rs:743
9512024-12-18T22:11:56.337ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9522024-12-18T22:11:57.302ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12980140317292927811 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
9532024-12-18T22:11:57.303ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12508168010874619151 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
9542024-12-18T22:11:58.529ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6409424678647254293 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
9552024-12-18T22:11:58.529ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2307208435499756027 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
9562024-12-18T22:11:59.755ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9572024-12-18T22:11:59.755ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56358
9582024-12-18T22:11:59.764ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9063 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:56358 req_id = 655170c2-11b0-489b-add7-550232a37575 response_code = 200 uri = /timesync
9592024-12-18T22:11:59.767ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2395651603, ip_addr: 142.202.190.19, stratum: 3, ref_time: 1734559914.894419, correction: -0.174478978 } file = sled-agent/src/rack_setup/service.rs:743
9602024-12-18T22:11:59.767ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9612024-12-18T22:12:01.231ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15126702027370067556 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
9622024-12-18T22:12:01.921ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 362646098280801017 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
9632024-12-18T22:12:01.924ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4590312115495821410 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
9642024-12-18T22:12:02.908ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9652024-12-18T22:12:02.908ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51506
9662024-12-18T22:12:02.917ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9608 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:51506 req_id = 1fb76db9-5145-4411-aed0-e5d408424563 response_code = 200 uri = /timesync
9672024-12-18T22:12:02.920ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2395651603, ip_addr: 142.202.190.19, stratum: 3, ref_time: 1734559921.5428813, correction: -0.165946767 } file = sled-agent/src/rack_setup/service.rs:743
9682024-12-18T22:12:02.920ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9692024-12-18T22:12:03.505ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 686.38296ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
9702024-12-18T22:12:05.878ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14692163074548176341 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
9712024-12-18T22:12:05.878ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10562486859642589600 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
9722024-12-18T22:12:06.198ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9732024-12-18T22:12:06.198ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60078
9742024-12-18T22:12:06.207ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8875 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:60078 req_id = 790c1ab4-3fc1-44fb-843b-3b34019f2f2a response_code = 200 uri = /timesync
9752024-12-18T22:12:06.211ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2395651603, ip_addr: 142.202.190.19, stratum: 3, ref_time: 1734559921.5428813, correction: -0.15701203 } file = sled-agent/src/rack_setup/service.rs:743
9762024-12-18T22:12:06.211ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9772024-12-18T22:12:07.278ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12980140317292927811 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
9782024-12-18T22:12:07.278ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12508168010874619151 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
9792024-12-18T22:12:08.504ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6409424678647254293 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
9802024-12-18T22:12:08.504ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2307208435499756027 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
9812024-12-18T22:12:11.205ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15126702027370067556 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
9822024-12-18T22:12:11.897ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 362646098280801017 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
9832024-12-18T22:12:11.898ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4590312115495821410 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
9842024-12-18T22:12:15.432ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9852024-12-18T22:12:15.432ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43914
9862024-12-18T22:12:15.441ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8596 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:43914 req_id = 836bd6fe-505f-44b9-82a3-771d04cfca93 response_code = 200 uri = /timesync
9872024-12-18T22:12:15.442ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2395651603, ip_addr: 142.202.190.19, stratum: 3, ref_time: 1734559931.2308342, correction: -0.131929249 } file = sled-agent/src/rack_setup/service.rs:743
9882024-12-18T22:12:15.442ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9892024-12-18T22:12:15.853ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 14692163074548176341 reason = Duration(60s) sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
9902024-12-18T22:12:15.854ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 10562486859642589600 reason = Duration(60s) sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
9912024-12-18T22:12:16.283ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:58302
9922024-12-18T22:12:16.283ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 26 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:58302 req_id = 048032e4-fd11-4a20-82d0-e548c8423ba9 response_code = 200 uri = /baseboard
9932024-12-18T22:12:17.252ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12980140317292927811 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
9942024-12-18T22:12:17.252ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12508168010874619151 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
9952024-12-18T22:12:18.480ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6409424678647254293 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
9962024-12-18T22:12:18.480ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2307208435499756027 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
9972024-12-18T22:12:19.185ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 503.818495ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
9982024-12-18T22:12:21.180ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15126702027370067556 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
9992024-12-18T22:12:21.871ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 362646098280801017 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
10002024-12-18T22:12:21.872ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4590312115495821410 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
10012024-12-18T22:12:27.227ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12980140317292927811 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
10022024-12-18T22:12:27.228ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12508168010874619151 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
10032024-12-18T22:12:27.354ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
10042024-12-18T22:12:27.354ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58285
10052024-12-18T22:12:27.363ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8890 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:58285 req_id = f1f172a1-a069-4b0a-93af-b4cdc1e9b9d8 response_code = 200 uri = /timesync
10062024-12-18T22:12:27.366ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2395651603, ip_addr: 142.202.190.19, stratum: 3, ref_time: 1734559945.3927252, correction: -0.099559627 } file = sled-agent/src/rack_setup/service.rs:743
10072024-12-18T22:12:27.366ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
10082024-12-18T22:12:28.454ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6409424678647254293 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
10092024-12-18T22:12:28.455ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2307208435499756027 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
10102024-12-18T22:12:31.155ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 15126702027370067556 reason = Duration(60s) sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
10112024-12-18T22:12:31.846ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 362646098280801017 reason = Duration(60s) sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
10122024-12-18T22:12:31.846ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 4590312115495821410 reason = Duration(60s) sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
10132024-12-18T22:12:34.683ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 2.676700472s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
10142024-12-18T22:12:35.050ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
10152024-12-18T22:12:35.050ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60681
10162024-12-18T22:12:35.060ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9800 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:60681 req_id = ffdf95c2-3de0-4bcf-b39c-91182b88329d response_code = 200 uri = /timesync
10172024-12-18T22:12:35.062ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2395651603, ip_addr: 142.202.190.19, stratum: 3, ref_time: 1734559952.32003, correction: -0.078648061 } file = sled-agent/src/rack_setup/service.rs:743
10182024-12-18T22:12:35.062ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
10192024-12-18T22:12:37.202ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12980140317292927811 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
10202024-12-18T22:12:37.202ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12508168010874619151 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
10212024-12-18T22:12:38.430ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 6409424678647254293 reason = Duration(60s) sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
10222024-12-18T22:12:38.430ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 2307208435499756027 reason = Duration(60s) sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
10232024-12-18T22:12:41.560ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
10242024-12-18T22:12:41.560ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:50920
10252024-12-18T22:12:41.569ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8907 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:50920 req_id = 6a2affb9-26dd-44b1-86ab-3bd4b6724822 response_code = 200 uri = /timesync
10262024-12-18T22:12:41.572ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2395651603, ip_addr: 142.202.190.19, stratum: 3, ref_time: 1734559961.352907, correction: -0.060981829 } file = sled-agent/src/rack_setup/service.rs:743
10272024-12-18T22:12:41.572ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
10282024-12-18T22:12:46.234ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49778
10292024-12-18T22:12:46.235ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49778 req_id = cf4899f1-b085-449f-9fc5-2d2df39a59d5 response_code = 200 uri = /baseboard
10302024-12-18T22:12:47.178ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12980140317292927811 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
10312024-12-18T22:12:47.178ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12508168010874619151 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
10322024-12-18T22:12:52.347ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 3.54345837s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
10332024-12-18T22:12:55.102ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
10342024-12-18T22:12:55.102ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48401
10352024-12-18T22:12:55.123ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 21136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:48401 req_id = fc897614-b854-49e4-9a1f-4567631852f9 response_code = 200 uri = /timesync
10362024-12-18T22:12:55.123ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-12-18T22:12:15.854381333Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 10562486859642589600 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
10372024-12-18T22:12:55.125ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-12-18T22:12:38.430701749Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 2307208435499756027 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
10382024-12-18T22:12:55.125ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-12-18T22:12:31.846862115Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 4590312115495821410 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
10392024-12-18T22:12:55.126ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-12-18T22:12:31.155766079Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 15126702027370067556 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
10402024-12-18T22:12:55.126ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-12-18T22:12:31.846651731Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 362646098280801017 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
10412024-12-18T22:12:55.126ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-12-18T22:12:15.853734540Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 14692163074548176341 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
10422024-12-18T22:12:55.127ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-12-18T22:12:38.430357793Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 6409424678647254293 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
10432024-12-18T22:12:55.128ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 2395651603, ip_addr: 142.202.190.19, stratum: 3, ref_time: 1734559973.602602, correction: -0.024221865 } file = sled-agent/src/rack_setup/service.rs:743
10442024-12-18T22:12:55.128ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1392
10452024-12-18T22:12:55.157ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: bc74bb1a-84d7-44c0-adcf-bd86a0a3155f (service), filesystem_pool: Some(ZpoolName { id: 7527a580-440a-4d33-b9e5-9f4ac1126696 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7527a580-440a-4d33-b9e5-9f4ac1126696 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 30c41a31-69b8-4e44-8478-4a6de914f099 (service), filesystem_pool: Some(ZpoolName { id: 8d122e51-f03c-4659-8af4-3a5baca809c5 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8d122e51-f03c-4659-8af4-3a5baca809c5 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 682b12ed-34b9-4e65-b536-774bb5cb2035 (service), filesystem_pool: Some(ZpoolName { id: ebfff57f-9cb4-47bd-acd3-b83eb13e21b5 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ebfff57f-9cb4-47bd-acd3-b83eb13e21b5 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: b68ca1fd-18e3-41fd-b283-bf3eeea1bccc (service), filesystem_pool: Some(ZpoolName { id: 45dbe21c-5eaa-4707-b822-d1348b4d8afc (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 30b96b41-ab9f-4ae7-a152-2da2e1688233, kind: Service { id: b68ca1fd-18e3-41fd-b283-bf3eeea1bccc }, name: Name("ntp-b68ca1fd-18e3-41fd-b283-bf3eeea1bccc"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 139, 101])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 1f6d9f8b-59f5-43ba-891a-42b4a2ccfe72 (service), filesystem_pool: Some(ZpoolName { id: 7527a580-440a-4d33-b9e5-9f4ac1126696 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7527a580-440a-4d33-b9e5-9f4ac1126696 (zpool), kind: External } } } }, OmicronZoneConfig { id: 2d63e98c-3e65-4bbc-9711-e4064e79b88e (service), filesystem_pool: Some(ZpoolName { id: 8d122e51-f03c-4659-8af4-3a5baca809c5 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8d122e51-f03c-4659-8af4-3a5baca809c5 (zpool), kind: External } } } }, OmicronZoneConfig { id: ce02eff6-97d3-45a9-b8cb-2574fd7d1376 (service), filesystem_pool: Some(ZpoolName { id: ebfff57f-9cb4-47bd-acd3-b83eb13e21b5 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ebfff57f-9cb4-47bd-acd3-b83eb13e21b5 (zpool), kind: External } } } }, OmicronZoneConfig { id: d36679c6-4e35-4fe0-96fb-11b744574e18 (service), filesystem_pool: Some(ZpoolName { id: d7b58ec6-9f7e-464f-b0dc-a0d484ac88ac (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d7b58ec6-9f7e-464f-b0dc-a0d484ac88ac (zpool), kind: External } } } }, OmicronZoneConfig { id: 5da3c4e3-d2c7-460e-a404-49d040b513a7 (service), filesystem_pool: Some(ZpoolName { id: ad207096-a29a-4bc7-b04f-7cf8a526e7ae (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ad207096-a29a-4bc7-b04f-7cf8a526e7ae (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
10462024-12-18T22:12:55.157ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:38318
10472024-12-18T22:12:55.158ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: bc74bb1a-84d7-44c0-adcf-bd86a0a3155f, dataset_name: DatasetName { pool_name: ZpoolName { id: 7527a580-440a-4d33-b9e5-9f4ac1126696 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:608
10482024-12-18T22:12:55.158ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1479 request = NewFilesystemRequest { dataset_id: bc74bb1a-84d7-44c0-adcf-bd86a0a3155f, dataset_name: DatasetName { pool_name: ZpoolName { id: 7527a580-440a-4d33-b9e5-9f4ac1126696 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10492024-12-18T22:12:55.214ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 30c41a31-69b8-4e44-8478-4a6de914f099, dataset_name: DatasetName { pool_name: ZpoolName { id: 8d122e51-f03c-4659-8af4-3a5baca809c5 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:608
10502024-12-18T22:12:55.214ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1479 request = NewFilesystemRequest { dataset_id: 30c41a31-69b8-4e44-8478-4a6de914f099, dataset_name: DatasetName { pool_name: ZpoolName { id: 8d122e51-f03c-4659-8af4-3a5baca809c5 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10512024-12-18T22:12:55.267ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 682b12ed-34b9-4e65-b536-774bb5cb2035, dataset_name: DatasetName { pool_name: ZpoolName { id: ebfff57f-9cb4-47bd-acd3-b83eb13e21b5 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:608
10522024-12-18T22:12:55.267ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1479 request = NewFilesystemRequest { dataset_id: 682b12ed-34b9-4e65-b536-774bb5cb2035, dataset_name: DatasetName { pool_name: ZpoolName { id: ebfff57f-9cb4-47bd-acd3-b83eb13e21b5 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10532024-12-18T22:12:55.321ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 1f6d9f8b-59f5-43ba-891a-42b4a2ccfe72, dataset_name: DatasetName { pool_name: ZpoolName { id: 7527a580-440a-4d33-b9e5-9f4ac1126696 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:608
10542024-12-18T22:12:55.321ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1479 request = NewFilesystemRequest { dataset_id: 1f6d9f8b-59f5-43ba-891a-42b4a2ccfe72, dataset_name: DatasetName { pool_name: ZpoolName { id: 7527a580-440a-4d33-b9e5-9f4ac1126696 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10552024-12-18T22:12:55.376ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 2d63e98c-3e65-4bbc-9711-e4064e79b88e, dataset_name: DatasetName { pool_name: ZpoolName { id: 8d122e51-f03c-4659-8af4-3a5baca809c5 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:608
10562024-12-18T22:12:55.376ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1479 request = NewFilesystemRequest { dataset_id: 2d63e98c-3e65-4bbc-9711-e4064e79b88e, dataset_name: DatasetName { pool_name: ZpoolName { id: 8d122e51-f03c-4659-8af4-3a5baca809c5 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10572024-12-18T22:12:55.429ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: ce02eff6-97d3-45a9-b8cb-2574fd7d1376, dataset_name: DatasetName { pool_name: ZpoolName { id: ebfff57f-9cb4-47bd-acd3-b83eb13e21b5 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:608
10582024-12-18T22:12:55.429ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1479 request = NewFilesystemRequest { dataset_id: ce02eff6-97d3-45a9-b8cb-2574fd7d1376, dataset_name: DatasetName { pool_name: ZpoolName { id: ebfff57f-9cb4-47bd-acd3-b83eb13e21b5 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10592024-12-18T22:12:55.482ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d36679c6-4e35-4fe0-96fb-11b744574e18, dataset_name: DatasetName { pool_name: ZpoolName { id: d7b58ec6-9f7e-464f-b0dc-a0d484ac88ac (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:608
10602024-12-18T22:12:55.483ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1479 request = NewFilesystemRequest { dataset_id: d36679c6-4e35-4fe0-96fb-11b744574e18, dataset_name: DatasetName { pool_name: ZpoolName { id: d7b58ec6-9f7e-464f-b0dc-a0d484ac88ac (zpool), kind: External }, kind: Cockroach }, responder: ... }
10612024-12-18T22:12:55.536ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 5da3c4e3-d2c7-460e-a404-49d040b513a7, dataset_name: DatasetName { pool_name: ZpoolName { id: ad207096-a29a-4bc7-b04f-7cf8a526e7ae (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:608
10622024-12-18T22:12:55.536ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1479 request = NewFilesystemRequest { dataset_id: 5da3c4e3-d2c7-460e-a404-49d040b513a7, dataset_name: DatasetName { pool_name: ZpoolName { id: ad207096-a29a-4bc7-b04f-7cf8a526e7ae (zpool), kind: External }, kind: Cockroach }, responder: ... }
10632024-12-18T22:12:55.590ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:608
10642024-12-18T22:12:55.590ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/f4e49932-892e-4e15-afe7-919d71bd3012/config/omicron-zones.json file = common/src/ledger.rs:177
10652024-12-18T22:12:55.590ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/de0dd618-e464-453d-9394-6cb21d5dbefa/config/omicron-zones.json file = common/src/ledger.rs:177
10662024-12-18T22:12:55.590ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:608
10672024-12-18T22:12:55.674ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:608
10682024-12-18T22:12:55.674ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:608
10692024-12-18T22:12:55.674ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:608
10702024-12-18T22:12:55.674ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:608
10712024-12-18T22:12:55.674ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:608
10722024-12-18T22:12:55.766ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_1f6d9f8b-59f5-43ba-891a-42b4a2ccfe72 file = illumos-utils/src/zone.rs:325
10732024-12-18T22:12:55.771ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_2d63e98c-3e65-4bbc-9711-e4064e79b88e file = illumos-utils/src/zone.rs:325
10742024-12-18T22:12:55.775ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_5da3c4e3-d2c7-460e-a404-49d040b513a7 file = illumos-utils/src/zone.rs:325
10752024-12-18T22:12:55.779ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_d36679c6-4e35-4fe0-96fb-11b744574e18 file = illumos-utils/src/zone.rs:325
10762024-12-18T22:12:55.784ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_ce02eff6-97d3-45a9-b8cb-2574fd7d1376 file = illumos-utils/src/zone.rs:325
10772024-12-18T22:12:55.788ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_1f6d9f8b-59f5-43ba-891a-42b4a2ccfe72 file = illumos-utils/src/zone.rs:363
10782024-12-18T22:12:55.793ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_2d63e98c-3e65-4bbc-9711-e4064e79b88e file = illumos-utils/src/zone.rs:363
10792024-12-18T22:12:55.797ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_5da3c4e3-d2c7-460e-a404-49d040b513a7 file = illumos-utils/src/zone.rs:363
10802024-12-18T22:12:55.801ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_d36679c6-4e35-4fe0-96fb-11b744574e18 file = illumos-utils/src/zone.rs:363
10812024-12-18T22:12:55.805ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_ce02eff6-97d3-45a9-b8cb-2574fd7d1376 file = illumos-utils/src/zone.rs:363
10822024-12-18T22:12:58.658ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_1f6d9f8b-59f5-43ba-891a-42b4a2ccfe72: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='1f6d9f8b-59f5-43ba-891a-42b4a2ccfe72'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10832024-12-18T22:12:58.658ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_1f6d9f8b-59f5-43ba-891a-42b4a2ccfe72 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_1f6d9f8b-59f5-43ba-891a-42b4a2ccfe72
10842024-12-18T22:12:58.741ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_d36679c6-4e35-4fe0-96fb-11b744574e18: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='d36679c6-4e35-4fe0-96fb-11b744574e18'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10852024-12-18T22:12:58.741ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_d36679c6-4e35-4fe0-96fb-11b744574e18 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_d36679c6-4e35-4fe0-96fb-11b744574e18
10862024-12-18T22:12:58.747ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_5da3c4e3-d2c7-460e-a404-49d040b513a7: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='5da3c4e3-d2c7-460e-a404-49d040b513a7'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10872024-12-18T22:12:58.747ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_5da3c4e3-d2c7-460e-a404-49d040b513a7 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_5da3c4e3-d2c7-460e-a404-49d040b513a7
10882024-12-18T22:12:58.759ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_2d63e98c-3e65-4bbc-9711-e4064e79b88e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='2d63e98c-3e65-4bbc-9711-e4064e79b88e'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10892024-12-18T22:12:58.759ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_2d63e98c-3e65-4bbc-9711-e4064e79b88e zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_2d63e98c-3e65-4bbc-9711-e4064e79b88e
10902024-12-18T22:12:58.803ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_ce02eff6-97d3-45a9-b8cb-2574fd7d1376: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='ce02eff6-97d3-45a9-b8cb-2574fd7d1376'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10912024-12-18T22:12:58.803ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_ce02eff6-97d3-45a9-b8cb-2574fd7d1376 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_ce02eff6-97d3-45a9-b8cb-2574fd7d1376
10922024-12-18T22:12:58.819ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1f6d9f8b-59f5-43ba-891a-42b4a2ccfe72") failed: Property not found. retry in 25.935179ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1f6d9f8b-59f5-43ba-891a-42b4a2ccfe72
10932024-12-18T22:12:58.853ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1f6d9f8b-59f5-43ba-891a-42b4a2ccfe72") failed: Property not found. retry in 141.994747ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1f6d9f8b-59f5-43ba-891a-42b4a2ccfe72
10942024-12-18T22:12:58.898ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5da3c4e3-d2c7-460e-a404-49d040b513a7") failed: Property not found. retry in 62.201661ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5da3c4e3-d2c7-460e-a404-49d040b513a7
10952024-12-18T22:12:58.913ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2d63e98c-3e65-4bbc-9711-e4064e79b88e") failed: Property not found. retry in 63.055457ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2d63e98c-3e65-4bbc-9711-e4064e79b88e
10962024-12-18T22:12:58.934ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d36679c6-4e35-4fe0-96fb-11b744574e18") failed: Property not found. retry in 63.40946ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d36679c6-4e35-4fe0-96fb-11b744574e18
10972024-12-18T22:12:58.973ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5da3c4e3-d2c7-460e-a404-49d040b513a7") failed: Property not found. retry in 68.475663ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5da3c4e3-d2c7-460e-a404-49d040b513a7
10982024-12-18T22:12:59.086ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2d63e98c-3e65-4bbc-9711-e4064e79b88e") failed: Property not found. retry in 125.99608ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2d63e98c-3e65-4bbc-9711-e4064e79b88e
10992024-12-18T22:12:59.109ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1f6d9f8b-59f5-43ba-891a-42b4a2ccfe72") failed: Property not found. retry in 107.028723ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1f6d9f8b-59f5-43ba-891a-42b4a2ccfe72
11002024-12-18T22:12:59.448ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5da3c4e3-d2c7-460e-a404-49d040b513a7") failed: Property not found. retry in 154.139778ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5da3c4e3-d2c7-460e-a404-49d040b513a7
11012024-12-18T22:12:59.737ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d36679c6-4e35-4fe0-96fb-11b744574e18") failed: Property not found. retry in 105.899082ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d36679c6-4e35-4fe0-96fb-11b744574e18
11022024-12-18T22:12:59.844ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1f6d9f8b-59f5-43ba-891a-42b4a2ccfe72") failed: Property not found. retry in 405.295589ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1f6d9f8b-59f5-43ba-891a-42b4a2ccfe72
11032024-12-18T22:13:00.087ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2d63e98c-3e65-4bbc-9711-e4064e79b88e") failed: Property not found. retry in 156.550544ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2d63e98c-3e65-4bbc-9711-e4064e79b88e
11042024-12-18T22:13:00.415ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5da3c4e3-d2c7-460e-a404-49d040b513a7") failed: Property not found. retry in 459.093149ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5da3c4e3-d2c7-460e-a404-49d040b513a7
11052024-12-18T22:13:01.288ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d36679c6-4e35-4fe0-96fb-11b744574e18") failed: Property not found. retry in 164.976783ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d36679c6-4e35-4fe0-96fb-11b744574e18
11062024-12-18T22:13:01.391ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ce02eff6-97d3-45a9-b8cb-2574fd7d1376") failed: Property not found. retry in 25.290505ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ce02eff6-97d3-45a9-b8cb-2574fd7d1376
11072024-12-18T22:13:01.420ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1f6d9f8b-59f5-43ba-891a-42b4a2ccfe72") failed: Property not found. retry in 661.067504ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1f6d9f8b-59f5-43ba-891a-42b4a2ccfe72
11082024-12-18T22:13:01.447ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2d63e98c-3e65-4bbc-9711-e4064e79b88e") failed: Property not found. retry in 275.2401ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2d63e98c-3e65-4bbc-9711-e4064e79b88e
11092024-12-18T22:13:01.461ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5da3c4e3-d2c7-460e-a404-49d040b513a7") failed: Property not found. retry in 865.481985ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5da3c4e3-d2c7-460e-a404-49d040b513a7
11102024-12-18T22:13:01.474ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d36679c6-4e35-4fe0-96fb-11b744574e18") failed: Property not found. retry in 285.45023ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d36679c6-4e35-4fe0-96fb-11b744574e18
11112024-12-18T22:13:01.495ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ce02eff6-97d3-45a9-b8cb-2574fd7d1376") failed: Property not found. retry in 87.388858ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ce02eff6-97d3-45a9-b8cb-2574fd7d1376
11122024-12-18T22:13:01.594ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ce02eff6-97d3-45a9-b8cb-2574fd7d1376") failed: Property not found. retry in 146.288245ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ce02eff6-97d3-45a9-b8cb-2574fd7d1376
11132024-12-18T22:13:01.734ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2d63e98c-3e65-4bbc-9711-e4064e79b88e") failed: Property not found. retry in 1.056129507s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2d63e98c-3e65-4bbc-9711-e4064e79b88e
11142024-12-18T22:13:01.752ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ce02eff6-97d3-45a9-b8cb-2574fd7d1376") failed: Property not found. retry in 265.348738ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ce02eff6-97d3-45a9-b8cb-2574fd7d1376
11152024-12-18T22:13:01.770ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d36679c6-4e35-4fe0-96fb-11b744574e18") failed: Property not found. retry in 609.541081ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d36679c6-4e35-4fe0-96fb-11b744574e18
11162024-12-18T22:13:02.029ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ce02eff6-97d3-45a9-b8cb-2574fd7d1376") failed: Property not found. retry in 1.065059597s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ce02eff6-97d3-45a9-b8cb-2574fd7d1376
11172024-12-18T22:13:02.089ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1f6d9f8b-59f5-43ba-891a-42b4a2ccfe72") failed: Property not found. retry in 749.10685ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1f6d9f8b-59f5-43ba-891a-42b4a2ccfe72
11182024-12-18T22:13:02.333ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5da3c4e3-d2c7-460e-a404-49d040b513a7") failed: Property not found. retry in 1.163581615s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5da3c4e3-d2c7-460e-a404-49d040b513a7
11192024-12-18T22:13:02.388ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d36679c6-4e35-4fe0-96fb-11b744574e18") failed: Property not found. retry in 1.479524613s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d36679c6-4e35-4fe0-96fb-11b744574e18
11202024-12-18T22:13:02.798ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2d63e98c-3e65-4bbc-9711-e4064e79b88e") failed: Property not found. retry in 635.400349ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2d63e98c-3e65-4bbc-9711-e4064e79b88e
11212024-12-18T22:13:02.845ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1f6d9f8b-59f5-43ba-891a-42b4a2ccfe72") failed: Property not found. retry in 630.174465ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1f6d9f8b-59f5-43ba-891a-42b4a2ccfe72
11222024-12-18T22:13:03.100ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ce02eff6-97d3-45a9-b8cb-2574fd7d1376") failed: Property not found. retry in 1.117437833s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ce02eff6-97d3-45a9-b8cb-2574fd7d1376
11232024-12-18T22:13:03.441ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2d63e98c-3e65-4bbc-9711-e4064e79b88e") failed: Property not found. retry in 1.296557627s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2d63e98c-3e65-4bbc-9711-e4064e79b88e
11242024-12-18T22:13:03.483ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1f6d9f8b-59f5-43ba-891a-42b4a2ccfe72") failed: Property not found. retry in 1.475345766s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1f6d9f8b-59f5-43ba-891a-42b4a2ccfe72
11252024-12-18T22:13:03.503ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5da3c4e3-d2c7-460e-a404-49d040b513a7") failed: Property not found. retry in 1.052980811s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5da3c4e3-d2c7-460e-a404-49d040b513a7
11262024-12-18T22:13:03.873ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d36679c6-4e35-4fe0-96fb-11b744574e18") failed: Property not found. retry in 752.468988ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d36679c6-4e35-4fe0-96fb-11b744574e18
11272024-12-18T22:13:04.225ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ce02eff6-97d3-45a9-b8cb-2574fd7d1376") failed: Property not found. retry in 1.276769632s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ce02eff6-97d3-45a9-b8cb-2574fd7d1376
11282024-12-18T22:13:04.567ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5da3c4e3-d2c7-460e-a404-49d040b513a7") failed: Property not found. retry in 1.192361137s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5da3c4e3-d2c7-460e-a404-49d040b513a7
11292024-12-18T22:13:04.637ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d36679c6-4e35-4fe0-96fb-11b744574e18") failed: Property not found. retry in 663.095717ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d36679c6-4e35-4fe0-96fb-11b744574e18
11302024-12-18T22:13:04.749ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2d63e98c-3e65-4bbc-9711-e4064e79b88e") failed: Property not found. retry in 775.64514ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2d63e98c-3e65-4bbc-9711-e4064e79b88e
11312024-12-18T22:13:04.966ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1f6d9f8b-59f5-43ba-891a-42b4a2ccfe72") failed: Property not found. retry in 1.329815369s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1f6d9f8b-59f5-43ba-891a-42b4a2ccfe72
11322024-12-18T22:13:05.309ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d36679c6-4e35-4fe0-96fb-11b744574e18") failed: Property not found. retry in 631.384437ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d36679c6-4e35-4fe0-96fb-11b744574e18
11332024-12-18T22:13:05.508ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ce02eff6-97d3-45a9-b8cb-2574fd7d1376") failed: Property not found. retry in 657.022424ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ce02eff6-97d3-45a9-b8cb-2574fd7d1376
11342024-12-18T22:13:05.532ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2d63e98c-3e65-4bbc-9711-e4064e79b88e") failed: Property not found. retry in 1.265286918s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2d63e98c-3e65-4bbc-9711-e4064e79b88e
11352024-12-18T22:13:05.766ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5da3c4e3-d2c7-460e-a404-49d040b513a7") failed: Property not found. retry in 632.747876ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5da3c4e3-d2c7-460e-a404-49d040b513a7
11362024-12-18T22:13:05.949ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d36679c6-4e35-4fe0-96fb-11b744574e18") failed: Property not found. retry in 992.375373ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d36679c6-4e35-4fe0-96fb-11b744574e18
11372024-12-18T22:13:06.174ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ce02eff6-97d3-45a9-b8cb-2574fd7d1376") failed: Property not found. retry in 1.17255494s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ce02eff6-97d3-45a9-b8cb-2574fd7d1376
11382024-12-18T22:13:06.305ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1f6d9f8b-59f5-43ba-891a-42b4a2ccfe72") failed: Property not found. retry in 692.329021ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1f6d9f8b-59f5-43ba-891a-42b4a2ccfe72
11392024-12-18T22:13:06.408ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5da3c4e3-d2c7-460e-a404-49d040b513a7") failed: Property not found. retry in 897.702549ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5da3c4e3-d2c7-460e-a404-49d040b513a7
11402024-12-18T22:13:06.808ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2d63e98c-3e65-4bbc-9711-e4064e79b88e") failed: Property not found. retry in 1.149679015s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2d63e98c-3e65-4bbc-9711-e4064e79b88e
11412024-12-18T22:13:06.951ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d36679c6-4e35-4fe0-96fb-11b744574e18") failed: Property not found. retry in 674.51772ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d36679c6-4e35-4fe0-96fb-11b744574e18
11422024-12-18T22:13:07.007ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1f6d9f8b-59f5-43ba-891a-42b4a2ccfe72") failed: Property not found. retry in 974.194465ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1f6d9f8b-59f5-43ba-891a-42b4a2ccfe72
11432024-12-18T22:13:07.314ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5da3c4e3-d2c7-460e-a404-49d040b513a7") failed: Property not found. retry in 896.694754ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5da3c4e3-d2c7-460e-a404-49d040b513a7
11442024-12-18T22:13:07.354ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ce02eff6-97d3-45a9-b8cb-2574fd7d1376") failed: Property not found. retry in 1.217031115s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ce02eff6-97d3-45a9-b8cb-2574fd7d1376
11452024-12-18T22:13:07.635ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d36679c6-4e35-4fe0-96fb-11b744574e18") failed: Property not found. retry in 1.103932489s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d36679c6-4e35-4fe0-96fb-11b744574e18
11462024-12-18T22:13:07.968ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2d63e98c-3e65-4bbc-9711-e4064e79b88e") failed: Property not found. retry in 1.288724628s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2d63e98c-3e65-4bbc-9711-e4064e79b88e
11472024-12-18T22:13:07.992ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1f6d9f8b-59f5-43ba-891a-42b4a2ccfe72") failed: Property not found. retry in 1.136595517s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1f6d9f8b-59f5-43ba-891a-42b4a2ccfe72
11482024-12-18T22:13:08.221ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5da3c4e3-d2c7-460e-a404-49d040b513a7") failed: Property not found. retry in 563.228277ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5da3c4e3-d2c7-460e-a404-49d040b513a7
11492024-12-18T22:13:08.794ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5da3c4e3-d2c7-460e-a404-49d040b513a7") failed: Property not found. retry in 698.664491ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5da3c4e3-d2c7-460e-a404-49d040b513a7
11502024-12-18T22:13:09.267ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2d63e98c-3e65-4bbc-9711-e4064e79b88e") failed: Property not found. retry in 698.282187ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2d63e98c-3e65-4bbc-9711-e4064e79b88e
11512024-12-18T22:13:09.502ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5da3c4e3-d2c7-460e-a404-49d040b513a7") failed: Property not found. retry in 946.124874ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5da3c4e3-d2c7-460e-a404-49d040b513a7
11522024-12-18T22:13:09.976ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2d63e98c-3e65-4bbc-9711-e4064e79b88e") failed: Property not found. retry in 1.033924838s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2d63e98c-3e65-4bbc-9711-e4064e79b88e
11532024-12-18T22:13:10.459ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5da3c4e3-d2c7-460e-a404-49d040b513a7") failed: Property not found. retry in 1.282277564s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5da3c4e3-d2c7-460e-a404-49d040b513a7
11542024-12-18T22:13:10.917ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 5.055341867s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
11552024-12-18T22:13:11.020ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2d63e98c-3e65-4bbc-9711-e4064e79b88e") failed: Property not found. retry in 1.462656449s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2d63e98c-3e65-4bbc-9711-e4064e79b88e
11562024-12-18T22:13:12.257ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5da3c4e3-d2c7-460e-a404-49d040b513a7") failed: Property not found. retry in 1.48620109s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5da3c4e3-d2c7-460e-a404-49d040b513a7
11572024-12-18T22:13:12.495ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2d63e98c-3e65-4bbc-9711-e4064e79b88e") failed: Property not found. retry in 1.484422753s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2d63e98c-3e65-4bbc-9711-e4064e79b88e
11582024-12-18T22:13:13.754ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5da3c4e3-d2c7-460e-a404-49d040b513a7") failed: Property not found. retry in 1.483140836s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5da3c4e3-d2c7-460e-a404-49d040b513a7
11592024-12-18T22:13:13.989ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2d63e98c-3e65-4bbc-9711-e4064e79b88e") failed: Property not found. retry in 1.166250453s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2d63e98c-3e65-4bbc-9711-e4064e79b88e
11602024-12-18T22:13:15.165ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2d63e98c-3e65-4bbc-9711-e4064e79b88e") failed: Property not found. retry in 1.270521876s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2d63e98c-3e65-4bbc-9711-e4064e79b88e
11612024-12-18T22:13:15.246ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5da3c4e3-d2c7-460e-a404-49d040b513a7") failed: Property not found. retry in 769.964785ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5da3c4e3-d2c7-460e-a404-49d040b513a7
11622024-12-18T22:13:16.026ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5da3c4e3-d2c7-460e-a404-49d040b513a7") failed: Property not found. retry in 1.2641453s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5da3c4e3-d2c7-460e-a404-49d040b513a7
11632024-12-18T22:13:16.218ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45273
11642024-12-18T22:13:16.218ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45273 req_id = 00cd96a6-03d9-4ba2-9110-29e12f382738 response_code = 200 uri = /baseboard
11652024-12-18T22:13:16.444ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2d63e98c-3e65-4bbc-9711-e4064e79b88e") failed: Property not found. retry in 715.131263ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2d63e98c-3e65-4bbc-9711-e4064e79b88e
11662024-12-18T22:13:17.169ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2d63e98c-3e65-4bbc-9711-e4064e79b88e") failed: Property not found. retry in 782.090241ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2d63e98c-3e65-4bbc-9711-e4064e79b88e
11672024-12-18T22:13:17.299ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5da3c4e3-d2c7-460e-a404-49d040b513a7") failed: Property not found. retry in 720.73714ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5da3c4e3-d2c7-460e-a404-49d040b513a7
11682024-12-18T22:13:17.960ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2d63e98c-3e65-4bbc-9711-e4064e79b88e") failed: Property not found. retry in 1.317868044s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2d63e98c-3e65-4bbc-9711-e4064e79b88e
11692024-12-18T22:13:18.029ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5da3c4e3-d2c7-460e-a404-49d040b513a7") failed: Property not found. retry in 921.657981ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5da3c4e3-d2c7-460e-a404-49d040b513a7
11702024-12-18T22:13:19.301ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_1f6d9f8b-59f5-43ba-891a-42b4a2ccfe72
11712024-12-18T22:13:19.301ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_2d63e98c-3e65-4bbc-9711-e4064e79b88e
11722024-12-18T22:13:19.301ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_5da3c4e3-d2c7-460e-a404-49d040b513a7
11732024-12-18T22:13:19.301ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_d36679c6-4e35-4fe0-96fb-11b744574e18
11742024-12-18T22:13:19.301ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_ce02eff6-97d3-45a9-b8cb-2574fd7d1376
11752024-12-18T22:13:19.301ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/f4e49932-892e-4e15-afe7-919d71bd3012/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
11762024-12-18T22:13:19.302ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/de0dd618-e464-453d-9394-6cb21d5dbefa/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
11772024-12-18T22:13:19.303ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 24171980 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:38318 req_id = 4298c270-f6cb-4482-9845-7af218e2755f response_code = 204 uri = /omicron-zones
11782024-12-18T22:13:19.339ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64120
11792024-12-18T22:13:19.371ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::3]:32221 file = sled-agent/src/services.rs:3743
11802024-12-18T22:13:19.556ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3761
11812024-12-18T22:13:26.548ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3784
11822024-12-18T22:13:26.548ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7209470 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:64120 req_id = e1d72640-9785-42eb-8e1d-79b3e1ec5c3c response_code = 204 uri = /cockroachdb
11832024-12-18T22:13:26.582ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: bc74bb1a-84d7-44c0-adcf-bd86a0a3155f (service), filesystem_pool: Some(ZpoolName { id: 7527a580-440a-4d33-b9e5-9f4ac1126696 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7527a580-440a-4d33-b9e5-9f4ac1126696 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 30c41a31-69b8-4e44-8478-4a6de914f099 (service), filesystem_pool: Some(ZpoolName { id: 8d122e51-f03c-4659-8af4-3a5baca809c5 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8d122e51-f03c-4659-8af4-3a5baca809c5 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 682b12ed-34b9-4e65-b536-774bb5cb2035 (service), filesystem_pool: Some(ZpoolName { id: ebfff57f-9cb4-47bd-acd3-b83eb13e21b5 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ebfff57f-9cb4-47bd-acd3-b83eb13e21b5 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: b68ca1fd-18e3-41fd-b283-bf3eeea1bccc (service), filesystem_pool: Some(ZpoolName { id: 45dbe21c-5eaa-4707-b822-d1348b4d8afc (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 30b96b41-ab9f-4ae7-a152-2da2e1688233, kind: Service { id: b68ca1fd-18e3-41fd-b283-bf3eeea1bccc }, name: Name("ntp-b68ca1fd-18e3-41fd-b283-bf3eeea1bccc"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 139, 101])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 1f6d9f8b-59f5-43ba-891a-42b4a2ccfe72 (service), filesystem_pool: Some(ZpoolName { id: 7527a580-440a-4d33-b9e5-9f4ac1126696 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7527a580-440a-4d33-b9e5-9f4ac1126696 (zpool), kind: External } } } }, OmicronZoneConfig { id: 2d63e98c-3e65-4bbc-9711-e4064e79b88e (service), filesystem_pool: Some(ZpoolName { id: 8d122e51-f03c-4659-8af4-3a5baca809c5 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8d122e51-f03c-4659-8af4-3a5baca809c5 (zpool), kind: External } } } }, OmicronZoneConfig { id: ce02eff6-97d3-45a9-b8cb-2574fd7d1376 (service), filesystem_pool: Some(ZpoolName { id: ebfff57f-9cb4-47bd-acd3-b83eb13e21b5 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ebfff57f-9cb4-47bd-acd3-b83eb13e21b5 (zpool), kind: External } } } }, OmicronZoneConfig { id: d36679c6-4e35-4fe0-96fb-11b744574e18 (service), filesystem_pool: Some(ZpoolName { id: d7b58ec6-9f7e-464f-b0dc-a0d484ac88ac (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d7b58ec6-9f7e-464f-b0dc-a0d484ac88ac (zpool), kind: External } } } }, OmicronZoneConfig { id: 5da3c4e3-d2c7-460e-a404-49d040b513a7 (service), filesystem_pool: Some(ZpoolName { id: ad207096-a29a-4bc7-b04f-7cf8a526e7ae (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ad207096-a29a-4bc7-b04f-7cf8a526e7ae (zpool), kind: External } } } }, OmicronZoneConfig { id: d0ef80fe-5a3c-4585-be47-819c465c7a37 (service), filesystem_pool: Some(ZpoolName { id: 7527a580-440a-4d33-b9e5-9f4ac1126696 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7527a580-440a-4d33-b9e5-9f4ac1126696 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.1.164:53, nic: NetworkInterface { id: 104d2c5b-1a03-416e-83a1-9840a7797640, kind: Service { id: d0ef80fe-5a3c-4585-be47-819c465c7a37 }, name: Name("external-dns-d0ef80fe-5a3c-4585-be47-819c465c7a37"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 188, 248])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 160de9b3-61fd-47fd-9883-78dcc7b014f0 (service), filesystem_pool: Some(ZpoolName { id: 8d122e51-f03c-4659-8af4-3a5baca809c5 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8d122e51-f03c-4659-8af4-3a5baca809c5 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.1.165:53, nic: NetworkInterface { id: 607e1df6-370f-4c69-a01b-1dec075c60ae, kind: Service { id: 160de9b3-61fd-47fd-9883-78dcc7b014f0 }, name: Name("external-dns-160de9b3-61fd-47fd-9883-78dcc7b014f0"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 132, 76])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 175d3cc8-9a02-4cf3-970c-8ec76a875436 (service), filesystem_pool: Some(ZpoolName { id: 4bf1df73-f4b5-4c23-85b8-9b365d6ea8ae (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.1.166, nic: NetworkInterface { id: af14a7c6-4009-42e7-b00a-57c5ae0399bb, kind: Service { id: 175d3cc8-9a02-4cf3-970c-8ec76a875436 }, name: Name("nexus-175d3cc8-9a02-4cf3-970c-8ec76a875436"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 135, 206])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: c0e3d114-075e-41a4-a4df-fa8131bbea97 (service), filesystem_pool: Some(ZpoolName { id: ebfff57f-9cb4-47bd-acd3-b83eb13e21b5 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.1.167, nic: NetworkInterface { id: d048e606-7b77-4cdc-951d-7050040ab8d1, kind: Service { id: c0e3d114-075e-41a4-a4df-fa8131bbea97 }, name: Name("nexus-c0e3d114-075e-41a4-a4df-fa8131bbea97"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 155, 145])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395 (service), filesystem_pool: Some(ZpoolName { id: 7527a580-440a-4d33-b9e5-9f4ac1126696 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.1.168, nic: NetworkInterface { id: 0bab2332-a525-46aa-9d7e-fb4af64f3c88, kind: Service { id: 9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395 }, name: Name("nexus-9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 211, 86])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 6fd466f3-f0b4-4d40-b657-fd8a20eb0188 (service), filesystem_pool: Some(ZpoolName { id: a952a3c4-f4b2-4c9a-a310-fb464cba0cce (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: 98356a8d-08b0-46fd-8961-c8be5019dba9 (service), filesystem_pool: Some(ZpoolName { id: 7527a580-440a-4d33-b9e5-9f4ac1126696 (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7527a580-440a-4d33-b9e5-9f4ac1126696 (zpool), kind: External } } } }, OmicronZoneConfig { id: 509b5c7f-9ddc-4e7c-956e-5984acfd38a7 (service), filesystem_pool: Some(ZpoolName { id: 45dbe21c-5eaa-4707-b822-d1348b4d8afc (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: 05d26e4d-8692-47ee-871b-e645e0477c82 (service), filesystem_pool: Some(ZpoolName { id: d7b58ec6-9f7e-464f-b0dc-a0d484ac88ac (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: ed9cf056-3789-49ba-a138-0933a1135c28 (service), filesystem_pool: Some(ZpoolName { id: a952a3c4-f4b2-4c9a-a310-fb464cba0cce (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: 218e3da3-c056-4f46-bedf-ff540f2a1d48 (service), filesystem_pool: Some(ZpoolName { id: 7527a580-440a-4d33-b9e5-9f4ac1126696 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7527a580-440a-4d33-b9e5-9f4ac1126696 (zpool), kind: External } } } }, OmicronZoneConfig { id: 387d3af0-07c5-480d-840e-4805c74ee7db (service), filesystem_pool: Some(ZpoolName { id: 8d122e51-f03c-4659-8af4-3a5baca809c5 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8d122e51-f03c-4659-8af4-3a5baca809c5 (zpool), kind: External } } } }, OmicronZoneConfig { id: ed99c029-5334-47b0-b85e-f2f87bb694f8 (service), filesystem_pool: Some(ZpoolName { id: ebfff57f-9cb4-47bd-acd3-b83eb13e21b5 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ebfff57f-9cb4-47bd-acd3-b83eb13e21b5 (zpool), kind: External } } } }, OmicronZoneConfig { id: bd8a0397-a96b-4af7-bb62-cac596d73425 (service), filesystem_pool: Some(ZpoolName { id: d7b58ec6-9f7e-464f-b0dc-a0d484ac88ac (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d7b58ec6-9f7e-464f-b0dc-a0d484ac88ac (zpool), kind: External } } } }, OmicronZoneConfig { id: bb3be4a7-c724-4d22-bc17-549855e0c8cd (service), filesystem_pool: Some(ZpoolName { id: ad207096-a29a-4bc7-b04f-7cf8a526e7ae (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ad207096-a29a-4bc7-b04f-7cf8a526e7ae (zpool), kind: External } } } }, OmicronZoneConfig { id: 2e4f87f5-8c7c-45a2-b576-510817bf70ba (service), filesystem_pool: Some(ZpoolName { id: a952a3c4-f4b2-4c9a-a310-fb464cba0cce (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a952a3c4-f4b2-4c9a-a310-fb464cba0cce (zpool), kind: External } } } }, OmicronZoneConfig { id: 864a9415-8555-4a87-a07b-905db0054ab1 (service), filesystem_pool: Some(ZpoolName { id: 45dbe21c-5eaa-4707-b822-d1348b4d8afc (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 45dbe21c-5eaa-4707-b822-d1348b4d8afc (zpool), kind: External } } } }, OmicronZoneConfig { id: fbb8f81a-e6a1-4d5a-980c-08bb005aae11 (service), filesystem_pool: Some(ZpoolName { id: 378b1d3c-0145-41bf-ab1f-16bc3c7930e7 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 378b1d3c-0145-41bf-ab1f-16bc3c7930e7 (zpool), kind: External } } } }, OmicronZoneConfig { id: 892dfd48-eedc-487a-9abc-a386c4d5781d (service), filesystem_pool: Some(ZpoolName { id: 4bf1df73-f4b5-4c23-85b8-9b365d6ea8ae (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 4bf1df73-f4b5-4c23-85b8-9b365d6ea8ae (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
11842024-12-18T22:13:26.583ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:38196
11852024-12-18T22:13:26.583ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: bc74bb1a-84d7-44c0-adcf-bd86a0a3155f, dataset_name: DatasetName { pool_name: ZpoolName { id: 7527a580-440a-4d33-b9e5-9f4ac1126696 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:608
11862024-12-18T22:13:26.583ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1479 request = NewFilesystemRequest { dataset_id: bc74bb1a-84d7-44c0-adcf-bd86a0a3155f, dataset_name: DatasetName { pool_name: ZpoolName { id: 7527a580-440a-4d33-b9e5-9f4ac1126696 (zpool), kind: External }, kind: InternalDns }, responder: ... }
11872024-12-18T22:13:26.648ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 30c41a31-69b8-4e44-8478-4a6de914f099, dataset_name: DatasetName { pool_name: ZpoolName { id: 8d122e51-f03c-4659-8af4-3a5baca809c5 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:608
11882024-12-18T22:13:26.648ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1479 request = NewFilesystemRequest { dataset_id: 30c41a31-69b8-4e44-8478-4a6de914f099, dataset_name: DatasetName { pool_name: ZpoolName { id: 8d122e51-f03c-4659-8af4-3a5baca809c5 (zpool), kind: External }, kind: InternalDns }, responder: ... }
11892024-12-18T22:13:26.714ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 682b12ed-34b9-4e65-b536-774bb5cb2035, dataset_name: DatasetName { pool_name: ZpoolName { id: ebfff57f-9cb4-47bd-acd3-b83eb13e21b5 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:608
11902024-12-18T22:13:26.714ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1479 request = NewFilesystemRequest { dataset_id: 682b12ed-34b9-4e65-b536-774bb5cb2035, dataset_name: DatasetName { pool_name: ZpoolName { id: ebfff57f-9cb4-47bd-acd3-b83eb13e21b5 (zpool), kind: External }, kind: InternalDns }, responder: ... }
11912024-12-18T22:13:26.782ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 1f6d9f8b-59f5-43ba-891a-42b4a2ccfe72, dataset_name: DatasetName { pool_name: ZpoolName { id: 7527a580-440a-4d33-b9e5-9f4ac1126696 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:608
11922024-12-18T22:13:26.783ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1479 request = NewFilesystemRequest { dataset_id: 1f6d9f8b-59f5-43ba-891a-42b4a2ccfe72, dataset_name: DatasetName { pool_name: ZpoolName { id: 7527a580-440a-4d33-b9e5-9f4ac1126696 (zpool), kind: External }, kind: Cockroach }, responder: ... }
11932024-12-18T22:13:26.848ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 2d63e98c-3e65-4bbc-9711-e4064e79b88e, dataset_name: DatasetName { pool_name: ZpoolName { id: 8d122e51-f03c-4659-8af4-3a5baca809c5 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:608
11942024-12-18T22:13:26.848ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1479 request = NewFilesystemRequest { dataset_id: 2d63e98c-3e65-4bbc-9711-e4064e79b88e, dataset_name: DatasetName { pool_name: ZpoolName { id: 8d122e51-f03c-4659-8af4-3a5baca809c5 (zpool), kind: External }, kind: Cockroach }, responder: ... }
11952024-12-18T22:13:26.909ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: ce02eff6-97d3-45a9-b8cb-2574fd7d1376, dataset_name: DatasetName { pool_name: ZpoolName { id: ebfff57f-9cb4-47bd-acd3-b83eb13e21b5 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:608
11962024-12-18T22:13:26.909ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1479 request = NewFilesystemRequest { dataset_id: ce02eff6-97d3-45a9-b8cb-2574fd7d1376, dataset_name: DatasetName { pool_name: ZpoolName { id: ebfff57f-9cb4-47bd-acd3-b83eb13e21b5 (zpool), kind: External }, kind: Cockroach }, responder: ... }
11972024-12-18T22:13:26.976ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d36679c6-4e35-4fe0-96fb-11b744574e18, dataset_name: DatasetName { pool_name: ZpoolName { id: d7b58ec6-9f7e-464f-b0dc-a0d484ac88ac (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:608
11982024-12-18T22:13:26.976ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1479 request = NewFilesystemRequest { dataset_id: d36679c6-4e35-4fe0-96fb-11b744574e18, dataset_name: DatasetName { pool_name: ZpoolName { id: d7b58ec6-9f7e-464f-b0dc-a0d484ac88ac (zpool), kind: External }, kind: Cockroach }, responder: ... }
11992024-12-18T22:13:27.041ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 5da3c4e3-d2c7-460e-a404-49d040b513a7, dataset_name: DatasetName { pool_name: ZpoolName { id: ad207096-a29a-4bc7-b04f-7cf8a526e7ae (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:608
12002024-12-18T22:13:27.041ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1479 request = NewFilesystemRequest { dataset_id: 5da3c4e3-d2c7-460e-a404-49d040b513a7, dataset_name: DatasetName { pool_name: ZpoolName { id: ad207096-a29a-4bc7-b04f-7cf8a526e7ae (zpool), kind: External }, kind: Cockroach }, responder: ... }
12012024-12-18T22:13:27.110ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d0ef80fe-5a3c-4585-be47-819c465c7a37, dataset_name: DatasetName { pool_name: ZpoolName { id: 7527a580-440a-4d33-b9e5-9f4ac1126696 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:608
12022024-12-18T22:13:27.110ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1479 request = NewFilesystemRequest { dataset_id: d0ef80fe-5a3c-4585-be47-819c465c7a37, dataset_name: DatasetName { pool_name: ZpoolName { id: 7527a580-440a-4d33-b9e5-9f4ac1126696 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
12032024-12-18T22:13:27.166ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 160de9b3-61fd-47fd-9883-78dcc7b014f0, dataset_name: DatasetName { pool_name: ZpoolName { id: 8d122e51-f03c-4659-8af4-3a5baca809c5 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:608
12042024-12-18T22:13:27.166ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1479 request = NewFilesystemRequest { dataset_id: 160de9b3-61fd-47fd-9883-78dcc7b014f0, dataset_name: DatasetName { pool_name: ZpoolName { id: 8d122e51-f03c-4659-8af4-3a5baca809c5 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
12052024-12-18T22:13:27.221ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 98356a8d-08b0-46fd-8961-c8be5019dba9, dataset_name: DatasetName { pool_name: ZpoolName { id: 7527a580-440a-4d33-b9e5-9f4ac1126696 (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:608
12062024-12-18T22:13:27.221ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1479 request = NewFilesystemRequest { dataset_id: 98356a8d-08b0-46fd-8961-c8be5019dba9, dataset_name: DatasetName { pool_name: ZpoolName { id: 7527a580-440a-4d33-b9e5-9f4ac1126696 (zpool), kind: External }, kind: Clickhouse }, responder: ... }
12072024-12-18T22:13:27.275ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 218e3da3-c056-4f46-bedf-ff540f2a1d48, dataset_name: DatasetName { pool_name: ZpoolName { id: 7527a580-440a-4d33-b9e5-9f4ac1126696 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:608
12082024-12-18T22:13:27.275ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1479 request = NewFilesystemRequest { dataset_id: 218e3da3-c056-4f46-bedf-ff540f2a1d48, dataset_name: DatasetName { pool_name: ZpoolName { id: 7527a580-440a-4d33-b9e5-9f4ac1126696 (zpool), kind: External }, kind: Crucible }, responder: ... }
12092024-12-18T22:13:27.324ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 387d3af0-07c5-480d-840e-4805c74ee7db, dataset_name: DatasetName { pool_name: ZpoolName { id: 8d122e51-f03c-4659-8af4-3a5baca809c5 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:608
12102024-12-18T22:13:27.324ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1479 request = NewFilesystemRequest { dataset_id: 387d3af0-07c5-480d-840e-4805c74ee7db, dataset_name: DatasetName { pool_name: ZpoolName { id: 8d122e51-f03c-4659-8af4-3a5baca809c5 (zpool), kind: External }, kind: Crucible }, responder: ... }
12112024-12-18T22:13:27.380ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: ed99c029-5334-47b0-b85e-f2f87bb694f8, dataset_name: DatasetName { pool_name: ZpoolName { id: ebfff57f-9cb4-47bd-acd3-b83eb13e21b5 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:608
12122024-12-18T22:13:27.380ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1479 request = NewFilesystemRequest { dataset_id: ed99c029-5334-47b0-b85e-f2f87bb694f8, dataset_name: DatasetName { pool_name: ZpoolName { id: ebfff57f-9cb4-47bd-acd3-b83eb13e21b5 (zpool), kind: External }, kind: Crucible }, responder: ... }
12132024-12-18T22:13:27.452ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: bd8a0397-a96b-4af7-bb62-cac596d73425, dataset_name: DatasetName { pool_name: ZpoolName { id: d7b58ec6-9f7e-464f-b0dc-a0d484ac88ac (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:608
12142024-12-18T22:13:27.453ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1479 request = NewFilesystemRequest { dataset_id: bd8a0397-a96b-4af7-bb62-cac596d73425, dataset_name: DatasetName { pool_name: ZpoolName { id: d7b58ec6-9f7e-464f-b0dc-a0d484ac88ac (zpool), kind: External }, kind: Crucible }, responder: ... }
12152024-12-18T22:13:27.522ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: bb3be4a7-c724-4d22-bc17-549855e0c8cd, dataset_name: DatasetName { pool_name: ZpoolName { id: ad207096-a29a-4bc7-b04f-7cf8a526e7ae (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:608
12162024-12-18T22:13:27.522ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1479 request = NewFilesystemRequest { dataset_id: bb3be4a7-c724-4d22-bc17-549855e0c8cd, dataset_name: DatasetName { pool_name: ZpoolName { id: ad207096-a29a-4bc7-b04f-7cf8a526e7ae (zpool), kind: External }, kind: Crucible }, responder: ... }
12172024-12-18T22:13:27.579ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 2e4f87f5-8c7c-45a2-b576-510817bf70ba, dataset_name: DatasetName { pool_name: ZpoolName { id: a952a3c4-f4b2-4c9a-a310-fb464cba0cce (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:608
12182024-12-18T22:13:27.579ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1479 request = NewFilesystemRequest { dataset_id: 2e4f87f5-8c7c-45a2-b576-510817bf70ba, dataset_name: DatasetName { pool_name: ZpoolName { id: a952a3c4-f4b2-4c9a-a310-fb464cba0cce (zpool), kind: External }, kind: Crucible }, responder: ... }
12192024-12-18T22:13:27.646ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 864a9415-8555-4a87-a07b-905db0054ab1, dataset_name: DatasetName { pool_name: ZpoolName { id: 45dbe21c-5eaa-4707-b822-d1348b4d8afc (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:608
12202024-12-18T22:13:27.646ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1479 request = NewFilesystemRequest { dataset_id: 864a9415-8555-4a87-a07b-905db0054ab1, dataset_name: DatasetName { pool_name: ZpoolName { id: 45dbe21c-5eaa-4707-b822-d1348b4d8afc (zpool), kind: External }, kind: Crucible }, responder: ... }
12212024-12-18T22:13:27.709ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: fbb8f81a-e6a1-4d5a-980c-08bb005aae11, dataset_name: DatasetName { pool_name: ZpoolName { id: 378b1d3c-0145-41bf-ab1f-16bc3c7930e7 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:608
12222024-12-18T22:13:27.709ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1479 request = NewFilesystemRequest { dataset_id: fbb8f81a-e6a1-4d5a-980c-08bb005aae11, dataset_name: DatasetName { pool_name: ZpoolName { id: 378b1d3c-0145-41bf-ab1f-16bc3c7930e7 (zpool), kind: External }, kind: Crucible }, responder: ... }
12232024-12-18T22:13:27.780ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 892dfd48-eedc-487a-9abc-a386c4d5781d, dataset_name: DatasetName { pool_name: ZpoolName { id: 4bf1df73-f4b5-4c23-85b8-9b365d6ea8ae (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:608
12242024-12-18T22:13:27.780ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1479 request = NewFilesystemRequest { dataset_id: 892dfd48-eedc-487a-9abc-a386c4d5781d, dataset_name: DatasetName { pool_name: ZpoolName { id: 4bf1df73-f4b5-4c23-85b8-9b365d6ea8ae (zpool), kind: External }, kind: Crucible }, responder: ... }
12252024-12-18T22:13:27.852ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:608
12262024-12-18T22:13:27.852ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/f4e49932-892e-4e15-afe7-919d71bd3012/config/omicron-zones.json file = common/src/ledger.rs:177
12272024-12-18T22:13:27.853ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/de0dd618-e464-453d-9394-6cb21d5dbefa/config/omicron-zones.json file = common/src/ledger.rs:177
12282024-12-18T22:13:27.853ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:608
12292024-12-18T22:13:27.999ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12302024-12-18T22:13:28.000ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:608
12312024-12-18T22:13:28.000ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:608
12322024-12-18T22:13:28.000ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:608
12332024-12-18T22:13:28.001ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12342024-12-18T22:13:28.034ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:608
12352024-12-18T22:13:28.034ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:608
12362024-12-18T22:13:28.034ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:608
12372024-12-18T22:13:28.034ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:608
12382024-12-18T22:13:28.034ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:608
12392024-12-18T22:13:28.228ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12402024-12-18T22:13:28.229ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:608
12412024-12-18T22:13:28.242ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12422024-12-18T22:13:28.244ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12432024-12-18T22:13:28.300ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:608
12442024-12-18T22:13:28.301ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:608
12452024-12-18T22:13:28.301ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:608
12462024-12-18T22:13:28.301ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:608
12472024-12-18T22:13:28.301ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:608
12482024-12-18T22:13:28.301ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_864a9415-8555-4a87-a07b-905db0054ab1 file = illumos-utils/src/zone.rs:325
12492024-12-18T22:13:28.307ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_fbb8f81a-e6a1-4d5a-980c-08bb005aae11 file = illumos-utils/src/zone.rs:325
12502024-12-18T22:13:28.312ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_218e3da3-c056-4f46-bedf-ff540f2a1d48 file = illumos-utils/src/zone.rs:325
12512024-12-18T22:13:28.318ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_892dfd48-eedc-487a-9abc-a386c4d5781d file = illumos-utils/src/zone.rs:325
12522024-12-18T22:13:28.324ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_05d26e4d-8692-47ee-871b-e645e0477c82 file = illumos-utils/src/zone.rs:325
12532024-12-18T22:13:28.329ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_2e4f87f5-8c7c-45a2-b576-510817bf70ba file = illumos-utils/src/zone.rs:325
12542024-12-18T22:13:28.335ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_6fd466f3-f0b4-4d40-b657-fd8a20eb0188 file = illumos-utils/src/zone.rs:325
12552024-12-18T22:13:28.340ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_ed9cf056-3789-49ba-a138-0933a1135c28 file = illumos-utils/src/zone.rs:325
12562024-12-18T22:13:28.472ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_864a9415-8555-4a87-a07b-905db0054ab1 file = illumos-utils/src/zone.rs:363
12572024-12-18T22:13:28.477ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_fbb8f81a-e6a1-4d5a-980c-08bb005aae11 file = illumos-utils/src/zone.rs:363
12582024-12-18T22:13:28.483ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_218e3da3-c056-4f46-bedf-ff540f2a1d48 file = illumos-utils/src/zone.rs:363
12592024-12-18T22:13:28.488ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_892dfd48-eedc-487a-9abc-a386c4d5781d file = illumos-utils/src/zone.rs:363
12602024-12-18T22:13:28.494ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_05d26e4d-8692-47ee-871b-e645e0477c82 file = illumos-utils/src/zone.rs:363
12612024-12-18T22:13:28.499ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_2e4f87f5-8c7c-45a2-b576-510817bf70ba file = illumos-utils/src/zone.rs:363
12622024-12-18T22:13:28.504ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_6fd466f3-f0b4-4d40-b657-fd8a20eb0188 file = illumos-utils/src/zone.rs:363
12632024-12-18T22:13:28.510ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_ed9cf056-3789-49ba-a138-0933a1135c28 file = illumos-utils/src/zone.rs:363
12642024-12-18T22:13:28.516ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_bd8a0397-a96b-4af7-bb62-cac596d73425 file = illumos-utils/src/zone.rs:325
12652024-12-18T22:13:28.523ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_98356a8d-08b0-46fd-8961-c8be5019dba9 file = illumos-utils/src/zone.rs:325
12662024-12-18T22:13:28.529ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_387d3af0-07c5-480d-840e-4805c74ee7db file = illumos-utils/src/zone.rs:325
12672024-12-18T22:13:28.535ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_bb3be4a7-c724-4d22-bc17-549855e0c8cd file = illumos-utils/src/zone.rs:325
12682024-12-18T22:13:28.542ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_509b5c7f-9ddc-4e7c-956e-5984acfd38a7 file = illumos-utils/src/zone.rs:325
12692024-12-18T22:13:28.549ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_ed99c029-5334-47b0-b85e-f2f87bb694f8 file = illumos-utils/src/zone.rs:325
12702024-12-18T22:13:28.558ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_bd8a0397-a96b-4af7-bb62-cac596d73425 file = illumos-utils/src/zone.rs:363
12712024-12-18T22:13:28.568ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_98356a8d-08b0-46fd-8961-c8be5019dba9 file = illumos-utils/src/zone.rs:363
12722024-12-18T22:13:28.577ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_387d3af0-07c5-480d-840e-4805c74ee7db file = illumos-utils/src/zone.rs:363
12732024-12-18T22:13:28.586ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_bb3be4a7-c724-4d22-bc17-549855e0c8cd file = illumos-utils/src/zone.rs:363
12742024-12-18T22:13:28.596ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_509b5c7f-9ddc-4e7c-956e-5984acfd38a7 file = illumos-utils/src/zone.rs:363
12752024-12-18T22:13:28.628ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_ed99c029-5334-47b0-b85e-f2f87bb694f8 file = illumos-utils/src/zone.rs:363
12762024-12-18T22:13:28.772ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12772024-12-18T22:13:28.850ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12782024-12-18T22:13:28.853ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12792024-12-18T22:13:28.853ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12802024-12-18T22:13:28.945ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 211, 86]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
12812024-12-18T22:13:28.945ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1263 zone_type = nexus
12822024-12-18T22:13:29.064ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12832024-12-18T22:13:29.119ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12842024-12-18T22:13:29.175ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12852024-12-18T22:13:29.177ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12862024-12-18T22:13:29.177ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12872024-12-18T22:13:29.231ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 135, 206]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
12882024-12-18T22:13:29.231ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1263 zone_type = nexus
12892024-12-18T22:13:29.234ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12902024-12-18T22:13:29.234ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12912024-12-18T22:13:29.286ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 155, 145]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
12922024-12-18T22:13:29.286ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1263 zone_type = nexus
12932024-12-18T22:13:29.287ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:83
12942024-12-18T22:13:29.287ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:90
12952024-12-18T22:13:29.287ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:83
12962024-12-18T22:13:29.287ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:90
12972024-12-18T22:13:29.289ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12982024-12-18T22:13:29.289ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12992024-12-18T22:13:29.342ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 188, 248]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
13002024-12-18T22:13:29.342ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1263 zone_type = external_dns
13012024-12-18T22:13:29.343ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
13022024-12-18T22:13:29.343ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
13032024-12-18T22:13:29.392ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 132, 76]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
13042024-12-18T22:13:29.393ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1263 zone_type = external_dns
13052024-12-18T22:13:29.393ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:118
13062024-12-18T22:13:29.394ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:118
13072024-12-18T22:13:29.396ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:608
13082024-12-18T22:13:29.396ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:608
13092024-12-18T22:13:29.465ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:83
13102024-12-18T22:13:29.465ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:90
13112024-12-18T22:13:29.466ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_175d3cc8-9a02-4cf3-970c-8ec76a875436 file = illumos-utils/src/zone.rs:325
13122024-12-18T22:13:29.473ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:83
13132024-12-18T22:13:29.473ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:90
13142024-12-18T22:13:29.474ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:83
13152024-12-18T22:13:29.474ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:90
13162024-12-18T22:13:29.474ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:118
13172024-12-18T22:13:29.478ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:608
13182024-12-18T22:13:29.478ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:118
13192024-12-18T22:13:29.481ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:118
13202024-12-18T22:13:29.484ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:608
13212024-12-18T22:13:29.484ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:608
13222024-12-18T22:13:29.516ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_175d3cc8-9a02-4cf3-970c-8ec76a875436 file = illumos-utils/src/zone.rs:363
13232024-12-18T22:13:29.524ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395 file = illumos-utils/src/zone.rs:325
13242024-12-18T22:13:29.593ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_c0e3d114-075e-41a4-a4df-fa8131bbea97 file = illumos-utils/src/zone.rs:325
13252024-12-18T22:13:29.600ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395 file = illumos-utils/src/zone.rs:363
13262024-12-18T22:13:29.606ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_d0ef80fe-5a3c-4585-be47-819c465c7a37 file = illumos-utils/src/zone.rs:325
13272024-12-18T22:13:29.617ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_160de9b3-61fd-47fd-9883-78dcc7b014f0 file = illumos-utils/src/zone.rs:325
13282024-12-18T22:13:29.626ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_c0e3d114-075e-41a4-a4df-fa8131bbea97 file = illumos-utils/src/zone.rs:363
13292024-12-18T22:13:29.637ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_d0ef80fe-5a3c-4585-be47-819c465c7a37 file = illumos-utils/src/zone.rs:363
13302024-12-18T22:13:29.652ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_160de9b3-61fd-47fd-9883-78dcc7b014f0 file = illumos-utils/src/zone.rs:363
13312024-12-18T22:13:31.014ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 11.262740073s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
13322024-12-18T22:13:31.491ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_05d26e4d-8692-47ee-871b-e645e0477c82: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13332024-12-18T22:13:31.492ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_05d26e4d-8692-47ee-871b-e645e0477c82 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_05d26e4d-8692-47ee-871b-e645e0477c82
13342024-12-18T22:13:32.172ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_bb3be4a7-c724-4d22-bc17-549855e0c8cd: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_ad207096-a29a-4bc7-b04f-7cf8a526e7ae/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='917f0f9b-62c7-436b-b1f9-4e500be122ed'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13352024-12-18T22:13:32.172ZINFOSledAgent (ServiceManager): Booting oxz_crucible_bb3be4a7-c724-4d22-bc17-549855e0c8cd zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_bb3be4a7-c724-4d22-bc17-549855e0c8cd
13362024-12-18T22:13:32.185ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_bd8a0397-a96b-4af7-bb62-cac596d73425: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_d7b58ec6-9f7e-464f-b0dc-a0d484ac88ac/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='89f8f517-de16-47ed-b970-53886816e561'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13372024-12-18T22:13:32.185ZINFOSledAgent (ServiceManager): Booting oxz_crucible_bd8a0397-a96b-4af7-bb62-cac596d73425 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_bd8a0397-a96b-4af7-bb62-cac596d73425
13382024-12-18T22:13:32.193ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_fbb8f81a-e6a1-4d5a-980c-08bb005aae11: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_378b1d3c-0145-41bf-ab1f-16bc3c7930e7/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='4958d2ef-8714-4afc-9df4-15a8f25d6722'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13392024-12-18T22:13:32.193ZINFOSledAgent (ServiceManager): Booting oxz_crucible_fbb8f81a-e6a1-4d5a-980c-08bb005aae11 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_fbb8f81a-e6a1-4d5a-980c-08bb005aae11
13402024-12-18T22:13:32.205ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_892dfd48-eedc-487a-9abc-a386c4d5781d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_4bf1df73-f4b5-4c23-85b8-9b365d6ea8ae/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='384d7f2b-efd7-4f4a-afa1-1e1161ccf5ac'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13412024-12-18T22:13:32.205ZINFOSledAgent (ServiceManager): Booting oxz_crucible_892dfd48-eedc-487a-9abc-a386c4d5781d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_892dfd48-eedc-487a-9abc-a386c4d5781d
13422024-12-18T22:13:32.312ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_509b5c7f-9ddc-4e7c-956e-5984acfd38a7: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13432024-12-18T22:13:32.312ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_509b5c7f-9ddc-4e7c-956e-5984acfd38a7 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_509b5c7f-9ddc-4e7c-956e-5984acfd38a7
13442024-12-18T22:13:32.321ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_387d3af0-07c5-480d-840e-4805c74ee7db: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_8d122e51-f03c-4659-8af4-3a5baca809c5/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='684ccae5-4f51-4787-aeb0-e84500122e01'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13452024-12-18T22:13:32.321ZINFOSledAgent (ServiceManager): Booting oxz_crucible_387d3af0-07c5-480d-840e-4805c74ee7db zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_387d3af0-07c5-480d-840e-4805c74ee7db
13462024-12-18T22:13:32.332ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_864a9415-8555-4a87-a07b-905db0054ab1: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_45dbe21c-5eaa-4707-b822-d1348b4d8afc/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='2f913a2c-d3be-4c4b-92ac-8e3053446b24'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13472024-12-18T22:13:32.332ZINFOSledAgent (ServiceManager): Booting oxz_crucible_864a9415-8555-4a87-a07b-905db0054ab1 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_864a9415-8555-4a87-a07b-905db0054ab1
13482024-12-18T22:13:32.375ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_ed99c029-5334-47b0-b85e-f2f87bb694f8: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_ebfff57f-9cb4-47bd-acd3-b83eb13e21b5/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='783923fe-83f8-404f-804a-fd0de44da90b'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13492024-12-18T22:13:32.375ZINFOSledAgent (ServiceManager): Booting oxz_crucible_ed99c029-5334-47b0-b85e-f2f87bb694f8 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_ed99c029-5334-47b0-b85e-f2f87bb694f8
13502024-12-18T22:13:32.406ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_05d26e4d-8692-47ee-871b-e645e0477c82") failed: Property not found. retry in 45.698522ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_05d26e4d-8692-47ee-871b-e645e0477c82
13512024-12-18T22:13:32.419ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bb3be4a7-c724-4d22-bc17-549855e0c8cd") failed: Property not found. retry in 58.097772ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bb3be4a7-c724-4d22-bc17-549855e0c8cd
13522024-12-18T22:13:32.432ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bd8a0397-a96b-4af7-bb62-cac596d73425") failed: Property not found. retry in 56.11593ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bd8a0397-a96b-4af7-bb62-cac596d73425
13532024-12-18T22:13:32.457ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_892dfd48-eedc-487a-9abc-a386c4d5781d") failed: Property not found. retry in 66.994405ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_892dfd48-eedc-487a-9abc-a386c4d5781d
13542024-12-18T22:13:32.471ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fbb8f81a-e6a1-4d5a-980c-08bb005aae11") failed: Property not found. retry in 45.422702ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fbb8f81a-e6a1-4d5a-980c-08bb005aae11
13552024-12-18T22:13:32.484ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_05d26e4d-8692-47ee-871b-e645e0477c82") failed: Property not found. retry in 62.059252ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_05d26e4d-8692-47ee-871b-e645e0477c82
13562024-12-18T22:13:32.498ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bb3be4a7-c724-4d22-bc17-549855e0c8cd") failed: Property not found. retry in 70.938159ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bb3be4a7-c724-4d22-bc17-549855e0c8cd
13572024-12-18T22:13:32.512ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bd8a0397-a96b-4af7-bb62-cac596d73425") failed: Property not found. retry in 77.189794ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bd8a0397-a96b-4af7-bb62-cac596d73425
13582024-12-18T22:13:32.531ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fbb8f81a-e6a1-4d5a-980c-08bb005aae11") failed: Property not found. retry in 68.908161ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fbb8f81a-e6a1-4d5a-980c-08bb005aae11
13592024-12-18T22:13:32.716ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_892dfd48-eedc-487a-9abc-a386c4d5781d") failed: Property not found. retry in 90.164681ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_892dfd48-eedc-487a-9abc-a386c4d5781d
13602024-12-18T22:13:32.912ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fbb8f81a-e6a1-4d5a-980c-08bb005aae11") failed: Property not found. retry in 127.867404ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fbb8f81a-e6a1-4d5a-980c-08bb005aae11
13612024-12-18T22:13:39.101ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_05d26e4d-8692-47ee-871b-e645e0477c82") failed: Property not found. retry in 141.333792ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_05d26e4d-8692-47ee-871b-e645e0477c82
13622024-12-18T22:13:39.436ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bd8a0397-a96b-4af7-bb62-cac596d73425") failed: Property not found. retry in 194.424719ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bd8a0397-a96b-4af7-bb62-cac596d73425
13632024-12-18T22:13:39.567ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bb3be4a7-c724-4d22-bc17-549855e0c8cd") failed: Property not found. retry in 106.729903ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bb3be4a7-c724-4d22-bc17-549855e0c8cd
13642024-12-18T22:13:39.729ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fbb8f81a-e6a1-4d5a-980c-08bb005aae11") failed: Property not found. retry in 308.783605ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fbb8f81a-e6a1-4d5a-980c-08bb005aae11
13652024-12-18T22:13:39.864ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_892dfd48-eedc-487a-9abc-a386c4d5781d") failed: Property not found. retry in 158.30846ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_892dfd48-eedc-487a-9abc-a386c4d5781d
13662024-12-18T22:13:40.156ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_05d26e4d-8692-47ee-871b-e645e0477c82") failed: Property not found. retry in 294.01515ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_05d26e4d-8692-47ee-871b-e645e0477c82
13672024-12-18T22:13:40.179ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_ed9cf056-3789-49ba-a138-0933a1135c28: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13682024-12-18T22:13:40.231ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bd8a0397-a96b-4af7-bb62-cac596d73425") failed: Property not found. retry in 375.367651ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bd8a0397-a96b-4af7-bb62-cac596d73425
13692024-12-18T22:13:40.251ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_387d3af0-07c5-480d-840e-4805c74ee7db") failed: Property not found. retry in 34.6175ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_387d3af0-07c5-480d-840e-4805c74ee7db
13702024-12-18T22:13:40.272ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bb3be4a7-c724-4d22-bc17-549855e0c8cd") failed: Property not found. retry in 558.737272ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bb3be4a7-c724-4d22-bc17-549855e0c8cd
13712024-12-18T22:13:40.299ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_509b5c7f-9ddc-4e7c-956e-5984acfd38a7") failed: Property not found. retry in 46.588665ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_509b5c7f-9ddc-4e7c-956e-5984acfd38a7
13722024-12-18T22:13:40.317ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ed99c029-5334-47b0-b85e-f2f87bb694f8") failed: Property not found. retry in 25.213323ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ed99c029-5334-47b0-b85e-f2f87bb694f8
13732024-12-18T22:13:40.330ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_864a9415-8555-4a87-a07b-905db0054ab1") failed: Property not found. retry in 53.324987ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_864a9415-8555-4a87-a07b-905db0054ab1
13742024-12-18T22:13:40.347ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fbb8f81a-e6a1-4d5a-980c-08bb005aae11") failed: Property not found. retry in 681.357954ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fbb8f81a-e6a1-4d5a-980c-08bb005aae11
13752024-12-18T22:13:40.348ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_218e3da3-c056-4f46-bedf-ff540f2a1d48: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_7527a580-440a-4d33-b9e5-9f4ac1126696/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='fc08c7e6-d52f-4125-860f-5375e87d3ab4'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13762024-12-18T22:13:40.362ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_892dfd48-eedc-487a-9abc-a386c4d5781d") failed: Property not found. retry in 546.142224ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_892dfd48-eedc-487a-9abc-a386c4d5781d
13772024-12-18T22:13:40.363ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_2e4f87f5-8c7c-45a2-b576-510817bf70ba: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_a952a3c4-f4b2-4c9a-a310-fb464cba0cce/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='acf4b2db-6350-4763-b549-cdf5d032e18b'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13782024-12-18T22:13:40.363ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_ed9cf056-3789-49ba-a138-0933a1135c28 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_ed9cf056-3789-49ba-a138-0933a1135c28
13792024-12-18T22:13:40.524ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_387d3af0-07c5-480d-840e-4805c74ee7db") failed: Property not found. retry in 129.834522ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_387d3af0-07c5-480d-840e-4805c74ee7db
13802024-12-18T22:13:40.544ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_509b5c7f-9ddc-4e7c-956e-5984acfd38a7") failed: Property not found. retry in 86.46772ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_509b5c7f-9ddc-4e7c-956e-5984acfd38a7
13812024-12-18T22:13:40.571ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ed99c029-5334-47b0-b85e-f2f87bb694f8") failed: Property not found. retry in 110.622426ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ed99c029-5334-47b0-b85e-f2f87bb694f8
13822024-12-18T22:13:40.604ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_864a9415-8555-4a87-a07b-905db0054ab1") failed: Property not found. retry in 77.487074ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_864a9415-8555-4a87-a07b-905db0054ab1
13832024-12-18T22:13:40.605ZINFOSledAgent (ServiceManager): Booting oxz_crucible_218e3da3-c056-4f46-bedf-ff540f2a1d48 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_218e3da3-c056-4f46-bedf-ff540f2a1d48
13842024-12-18T22:13:40.639ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_05d26e4d-8692-47ee-871b-e645e0477c82") failed: Property not found. retry in 861.374134ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_05d26e4d-8692-47ee-871b-e645e0477c82
13852024-12-18T22:13:40.639ZINFOSledAgent (ServiceManager): Booting oxz_crucible_2e4f87f5-8c7c-45a2-b576-510817bf70ba zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_2e4f87f5-8c7c-45a2-b576-510817bf70ba
13862024-12-18T22:13:40.652ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_6fd466f3-f0b4-4d40-b657-fd8a20eb0188: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='6fd466f3-f0b4-4d40-b657-fd8a20eb0188'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13872024-12-18T22:13:40.671ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bd8a0397-a96b-4af7-bb62-cac596d73425") failed: Property not found. retry in 632.322664ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bd8a0397-a96b-4af7-bb62-cac596d73425
13882024-12-18T22:13:40.674ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_160de9b3-61fd-47fd-9883-78dcc7b014f0: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13892024-12-18T22:13:40.692ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_387d3af0-07c5-480d-840e-4805c74ee7db") failed: Property not found. retry in 184.767297ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_387d3af0-07c5-480d-840e-4805c74ee7db
13902024-12-18T22:13:40.707ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_509b5c7f-9ddc-4e7c-956e-5984acfd38a7") failed: Property not found. retry in 167.903501ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_509b5c7f-9ddc-4e7c-956e-5984acfd38a7
13912024-12-18T22:13:40.723ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ed99c029-5334-47b0-b85e-f2f87bb694f8") failed: Property not found. retry in 134.416716ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ed99c029-5334-47b0-b85e-f2f87bb694f8
13922024-12-18T22:13:40.742ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_864a9415-8555-4a87-a07b-905db0054ab1") failed: Property not found. retry in 201.561563ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_864a9415-8555-4a87-a07b-905db0054ab1
13932024-12-18T22:13:40.742ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_6fd466f3-f0b4-4d40-b657-fd8a20eb0188 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_oximeter_6fd466f3-f0b4-4d40-b657-fd8a20eb0188
13942024-12-18T22:13:40.758ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_160de9b3-61fd-47fd-9883-78dcc7b014f0 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_160de9b3-61fd-47fd-9883-78dcc7b014f0
13952024-12-18T22:13:40.849ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bb3be4a7-c724-4d22-bc17-549855e0c8cd") failed: Property not found. retry in 1.113671934s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bb3be4a7-c724-4d22-bc17-549855e0c8cd
13962024-12-18T22:13:40.876ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ed99c029-5334-47b0-b85e-f2f87bb694f8") failed: Property not found. retry in 540.174599ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ed99c029-5334-47b0-b85e-f2f87bb694f8
13972024-12-18T22:13:40.890ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_509b5c7f-9ddc-4e7c-956e-5984acfd38a7") failed: Property not found. retry in 293.62852ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_509b5c7f-9ddc-4e7c-956e-5984acfd38a7
13982024-12-18T22:13:40.903ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ed9cf056-3789-49ba-a138-0933a1135c28") failed: Property not found. retry in 39.196084ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ed9cf056-3789-49ba-a138-0933a1135c28
13992024-12-18T22:13:40.918ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_387d3af0-07c5-480d-840e-4805c74ee7db") failed: Property not found. retry in 216.538069ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_387d3af0-07c5-480d-840e-4805c74ee7db
14002024-12-18T22:13:40.933ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_892dfd48-eedc-487a-9abc-a386c4d5781d") failed: Property not found. retry in 738.414475ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_892dfd48-eedc-487a-9abc-a386c4d5781d
14012024-12-18T22:13:40.945ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_218e3da3-c056-4f46-bedf-ff540f2a1d48") failed: Property not found. retry in 40.985188ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_218e3da3-c056-4f46-bedf-ff540f2a1d48
14022024-12-18T22:13:40.958ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_864a9415-8555-4a87-a07b-905db0054ab1") failed: Property not found. retry in 206.887271ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_864a9415-8555-4a87-a07b-905db0054ab1
14032024-12-18T22:13:40.968ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e4f87f5-8c7c-45a2-b576-510817bf70ba") failed: Property not found. retry in 67.258554ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2e4f87f5-8c7c-45a2-b576-510817bf70ba
14042024-12-18T22:13:40.979ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ed9cf056-3789-49ba-a138-0933a1135c28") failed: Property not found. retry in 148.8402ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ed9cf056-3789-49ba-a138-0933a1135c28
14052024-12-18T22:13:40.998ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_218e3da3-c056-4f46-bedf-ff540f2a1d48") failed: Property not found. retry in 140.377079ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_218e3da3-c056-4f46-bedf-ff540f2a1d48
14062024-12-18T22:13:41.022ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6fd466f3-f0b4-4d40-b657-fd8a20eb0188") failed: Property not found. retry in 37.115429ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6fd466f3-f0b4-4d40-b657-fd8a20eb0188
14072024-12-18T22:13:41.043ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fbb8f81a-e6a1-4d5a-980c-08bb005aae11") failed: Property not found. retry in 554.397749ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fbb8f81a-e6a1-4d5a-980c-08bb005aae11
14082024-12-18T22:13:41.055ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e4f87f5-8c7c-45a2-b576-510817bf70ba") failed: Property not found. retry in 57.372385ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2e4f87f5-8c7c-45a2-b576-510817bf70ba
14092024-12-18T22:13:41.066ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_160de9b3-61fd-47fd-9883-78dcc7b014f0") failed: Property not found. retry in 47.001613ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_160de9b3-61fd-47fd-9883-78dcc7b014f0
14102024-12-18T22:13:41.078ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6fd466f3-f0b4-4d40-b657-fd8a20eb0188") failed: Property not found. retry in 70.286035ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6fd466f3-f0b4-4d40-b657-fd8a20eb0188
14112024-12-18T22:13:41.127ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e4f87f5-8c7c-45a2-b576-510817bf70ba") failed: Property not found. retry in 127.405772ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2e4f87f5-8c7c-45a2-b576-510817bf70ba
14122024-12-18T22:13:41.141ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_160de9b3-61fd-47fd-9883-78dcc7b014f0") failed: Property not found. retry in 101.995041ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_160de9b3-61fd-47fd-9883-78dcc7b014f0
14132024-12-18T22:13:41.152ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_218e3da3-c056-4f46-bedf-ff540f2a1d48") failed: Property not found. retry in 182.645423ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_218e3da3-c056-4f46-bedf-ff540f2a1d48
14142024-12-18T22:13:41.164ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ed9cf056-3789-49ba-a138-0933a1135c28") failed: Property not found. retry in 182.191641ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ed9cf056-3789-49ba-a138-0933a1135c28
14152024-12-18T22:13:41.179ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_387d3af0-07c5-480d-840e-4805c74ee7db") failed: Property not found. retry in 1.029533785s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_387d3af0-07c5-480d-840e-4805c74ee7db
14162024-12-18T22:13:41.194ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_864a9415-8555-4a87-a07b-905db0054ab1") failed: Property not found. retry in 520.00647ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_864a9415-8555-4a87-a07b-905db0054ab1
14172024-12-18T22:13:41.206ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6fd466f3-f0b4-4d40-b657-fd8a20eb0188") failed: Property not found. retry in 291.710878ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6fd466f3-f0b4-4d40-b657-fd8a20eb0188
14182024-12-18T22:13:41.229ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_509b5c7f-9ddc-4e7c-956e-5984acfd38a7") failed: Property not found. retry in 574.150069ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_509b5c7f-9ddc-4e7c-956e-5984acfd38a7
14192024-12-18T22:13:41.256ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_160de9b3-61fd-47fd-9883-78dcc7b014f0") failed: Property not found. retry in 123.550968ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_160de9b3-61fd-47fd-9883-78dcc7b014f0
14202024-12-18T22:13:41.272ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e4f87f5-8c7c-45a2-b576-510817bf70ba") failed: Property not found. retry in 339.428999ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2e4f87f5-8c7c-45a2-b576-510817bf70ba
14212024-12-18T22:13:41.387ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bd8a0397-a96b-4af7-bb62-cac596d73425") failed: Property not found. retry in 1.453367764s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bd8a0397-a96b-4af7-bb62-cac596d73425
14222024-12-18T22:13:41.430ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_218e3da3-c056-4f46-bedf-ff540f2a1d48") failed: Property not found. retry in 528.026189ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_218e3da3-c056-4f46-bedf-ff540f2a1d48
14232024-12-18T22:13:41.453ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ed9cf056-3789-49ba-a138-0933a1135c28") failed: Property not found. retry in 532.309932ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ed9cf056-3789-49ba-a138-0933a1135c28
14242024-12-18T22:13:41.475ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_160de9b3-61fd-47fd-9883-78dcc7b014f0") failed: Property not found. retry in 413.493999ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_160de9b3-61fd-47fd-9883-78dcc7b014f0
14252024-12-18T22:13:41.495ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ed99c029-5334-47b0-b85e-f2f87bb694f8") failed: Property not found. retry in 740.677672ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ed99c029-5334-47b0-b85e-f2f87bb694f8
14262024-12-18T22:13:41.545ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6fd466f3-f0b4-4d40-b657-fd8a20eb0188") failed: Property not found. retry in 262.092554ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6fd466f3-f0b4-4d40-b657-fd8a20eb0188
14272024-12-18T22:13:41.568ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_05d26e4d-8692-47ee-871b-e645e0477c82") failed: Property not found. retry in 893.436794ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_05d26e4d-8692-47ee-871b-e645e0477c82
14282024-12-18T22:13:41.618ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fbb8f81a-e6a1-4d5a-980c-08bb005aae11") failed: Property not found. retry in 1.166745862s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fbb8f81a-e6a1-4d5a-980c-08bb005aae11
14292024-12-18T22:13:41.632ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e4f87f5-8c7c-45a2-b576-510817bf70ba") failed: Property not found. retry in 1.166422661s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2e4f87f5-8c7c-45a2-b576-510817bf70ba
14302024-12-18T22:13:41.692ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_892dfd48-eedc-487a-9abc-a386c4d5781d") failed: Property not found. retry in 992.007721ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_892dfd48-eedc-487a-9abc-a386c4d5781d
14312024-12-18T22:13:41.733ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_864a9415-8555-4a87-a07b-905db0054ab1") failed: Property not found. retry in 1.368383915s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_864a9415-8555-4a87-a07b-905db0054ab1
14322024-12-18T22:13:41.797ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_c0e3d114-075e-41a4-a4df-fa8131bbea97: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14332024-12-18T22:13:41.797ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_175d3cc8-9a02-4cf3-970c-8ec76a875436: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14342024-12-18T22:13:41.797ZINFOSledAgent (ServiceManager): Booting oxz_nexus_c0e3d114-075e-41a4-a4df-fa8131bbea97 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_c0e3d114-075e-41a4-a4df-fa8131bbea97
14352024-12-18T22:13:41.823ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_509b5c7f-9ddc-4e7c-956e-5984acfd38a7") failed: Property not found. retry in 1.498790374s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_509b5c7f-9ddc-4e7c-956e-5984acfd38a7
14362024-12-18T22:13:41.823ZINFOSledAgent (ServiceManager): Booting oxz_nexus_175d3cc8-9a02-4cf3-970c-8ec76a875436 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_175d3cc8-9a02-4cf3-970c-8ec76a875436
14372024-12-18T22:13:41.848ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6fd466f3-f0b4-4d40-b657-fd8a20eb0188") failed: Property not found. retry in 924.798332ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6fd466f3-f0b4-4d40-b657-fd8a20eb0188
14382024-12-18T22:13:41.909ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_160de9b3-61fd-47fd-9883-78dcc7b014f0") failed: Property not found. retry in 705.188801ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_160de9b3-61fd-47fd-9883-78dcc7b014f0
14392024-12-18T22:13:41.975ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_218e3da3-c056-4f46-bedf-ff540f2a1d48") failed: Property not found. retry in 866.88546ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_218e3da3-c056-4f46-bedf-ff540f2a1d48
14402024-12-18T22:13:41.994ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bb3be4a7-c724-4d22-bc17-549855e0c8cd") failed: Property not found. retry in 1.296629588s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bb3be4a7-c724-4d22-bc17-549855e0c8cd
14412024-12-18T22:13:42.010ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ed9cf056-3789-49ba-a138-0933a1135c28") failed: Property not found. retry in 759.518273ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ed9cf056-3789-49ba-a138-0933a1135c28
14422024-12-18T22:13:42.107ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c0e3d114-075e-41a4-a4df-fa8131bbea97") failed: Property not found. retry in 33.413021ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c0e3d114-075e-41a4-a4df-fa8131bbea97
14432024-12-18T22:13:42.126ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_175d3cc8-9a02-4cf3-970c-8ec76a875436") failed: Property not found. retry in 36.992857ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_175d3cc8-9a02-4cf3-970c-8ec76a875436
14442024-12-18T22:13:42.154ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c0e3d114-075e-41a4-a4df-fa8131bbea97") failed: Property not found. retry in 130.014314ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c0e3d114-075e-41a4-a4df-fa8131bbea97
14452024-12-18T22:13:42.175ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_175d3cc8-9a02-4cf3-970c-8ec76a875436") failed: Property not found. retry in 135.836016ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_175d3cc8-9a02-4cf3-970c-8ec76a875436
14462024-12-18T22:13:42.188ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_d0ef80fe-5a3c-4585-be47-819c465c7a37: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14472024-12-18T22:13:42.188ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_d0ef80fe-5a3c-4585-be47-819c465c7a37 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_d0ef80fe-5a3c-4585-be47-819c465c7a37
14482024-12-18T22:13:42.332ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_387d3af0-07c5-480d-840e-4805c74ee7db") failed: Property not found. retry in 1.287282381s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_387d3af0-07c5-480d-840e-4805c74ee7db
14492024-12-18T22:13:42.388ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_175d3cc8-9a02-4cf3-970c-8ec76a875436") failed: Property not found. retry in 191.917767ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_175d3cc8-9a02-4cf3-970c-8ec76a875436
14502024-12-18T22:13:42.404ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c0e3d114-075e-41a4-a4df-fa8131bbea97") failed: Property not found. retry in 215.467541ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c0e3d114-075e-41a4-a4df-fa8131bbea97
14512024-12-18T22:13:42.422ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ed99c029-5334-47b0-b85e-f2f87bb694f8") failed: Property not found. retry in 1.459336036s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ed99c029-5334-47b0-b85e-f2f87bb694f8
14522024-12-18T22:13:42.481ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_05d26e4d-8692-47ee-871b-e645e0477c82") failed: Property not found. retry in 1.161686046s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_05d26e4d-8692-47ee-871b-e645e0477c82
14532024-12-18T22:13:42.600ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_175d3cc8-9a02-4cf3-970c-8ec76a875436") failed: Property not found. retry in 551.720623ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_175d3cc8-9a02-4cf3-970c-8ec76a875436
14542024-12-18T22:13:42.636ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_160de9b3-61fd-47fd-9883-78dcc7b014f0") failed: Property not found. retry in 1.33494728s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_160de9b3-61fd-47fd-9883-78dcc7b014f0
14552024-12-18T22:13:42.654ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c0e3d114-075e-41a4-a4df-fa8131bbea97") failed: Property not found. retry in 581.90267ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c0e3d114-075e-41a4-a4df-fa8131bbea97
14562024-12-18T22:13:42.700ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_892dfd48-eedc-487a-9abc-a386c4d5781d") failed: Property not found. retry in 1.324107407s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_892dfd48-eedc-487a-9abc-a386c4d5781d
14572024-12-18T22:13:42.722ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d0ef80fe-5a3c-4585-be47-819c465c7a37") failed: Property not found. retry in 25.142747ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d0ef80fe-5a3c-4585-be47-819c465c7a37
14582024-12-18T22:13:42.760ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d0ef80fe-5a3c-4585-be47-819c465c7a37") failed: Property not found. retry in 103.806014ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d0ef80fe-5a3c-4585-be47-819c465c7a37
14592024-12-18T22:13:42.782ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ed9cf056-3789-49ba-a138-0933a1135c28") failed: Property not found. retry in 965.27394ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ed9cf056-3789-49ba-a138-0933a1135c28
14602024-12-18T22:13:42.791ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6fd466f3-f0b4-4d40-b657-fd8a20eb0188") failed: Property not found. retry in 1.114998333s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6fd466f3-f0b4-4d40-b657-fd8a20eb0188
14612024-12-18T22:13:42.805ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fbb8f81a-e6a1-4d5a-980c-08bb005aae11") failed: Property not found. retry in 1.310343079s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fbb8f81a-e6a1-4d5a-980c-08bb005aae11
14622024-12-18T22:13:42.819ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e4f87f5-8c7c-45a2-b576-510817bf70ba") failed: Property not found. retry in 590.090188ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2e4f87f5-8c7c-45a2-b576-510817bf70ba
14632024-12-18T22:13:42.852ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bd8a0397-a96b-4af7-bb62-cac596d73425") failed: Property not found. retry in 528.496468ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bd8a0397-a96b-4af7-bb62-cac596d73425
14642024-12-18T22:13:42.864ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_218e3da3-c056-4f46-bedf-ff540f2a1d48") failed: Property not found. retry in 579.321432ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_218e3da3-c056-4f46-bedf-ff540f2a1d48
14652024-12-18T22:13:42.874ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d0ef80fe-5a3c-4585-be47-819c465c7a37") failed: Property not found. retry in 118.027663ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d0ef80fe-5a3c-4585-be47-819c465c7a37
14662024-12-18T22:13:43.010ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d0ef80fe-5a3c-4585-be47-819c465c7a37") failed: Property not found. retry in 521.22797ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d0ef80fe-5a3c-4585-be47-819c465c7a37
14672024-12-18T22:13:43.115ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_864a9415-8555-4a87-a07b-905db0054ab1") failed: Property not found. retry in 902.542118ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_864a9415-8555-4a87-a07b-905db0054ab1
14682024-12-18T22:13:43.166ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_175d3cc8-9a02-4cf3-970c-8ec76a875436") failed: Property not found. retry in 829.06245ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_175d3cc8-9a02-4cf3-970c-8ec76a875436
14692024-12-18T22:13:43.247ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c0e3d114-075e-41a4-a4df-fa8131bbea97") failed: Property not found. retry in 833.215816ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c0e3d114-075e-41a4-a4df-fa8131bbea97
14702024-12-18T22:13:43.302ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bb3be4a7-c724-4d22-bc17-549855e0c8cd") failed: Property not found. retry in 853.336896ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bb3be4a7-c724-4d22-bc17-549855e0c8cd
14712024-12-18T22:13:43.334ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_509b5c7f-9ddc-4e7c-956e-5984acfd38a7") failed: Property not found. retry in 812.383509ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_509b5c7f-9ddc-4e7c-956e-5984acfd38a7
14722024-12-18T22:13:43.390ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bd8a0397-a96b-4af7-bb62-cac596d73425") failed: Property not found. retry in 893.229512ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bd8a0397-a96b-4af7-bb62-cac596d73425
14732024-12-18T22:13:43.391ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14742024-12-18T22:13:43.391ZINFOSledAgent (ServiceManager): Booting oxz_nexus_9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
14752024-12-18T22:13:43.421ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e4f87f5-8c7c-45a2-b576-510817bf70ba") failed: Property not found. retry in 1.415014927s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2e4f87f5-8c7c-45a2-b576-510817bf70ba
14762024-12-18T22:13:43.456ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_218e3da3-c056-4f46-bedf-ff540f2a1d48") failed: Property not found. retry in 1.120902538s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_218e3da3-c056-4f46-bedf-ff540f2a1d48
14772024-12-18T22:13:43.544ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d0ef80fe-5a3c-4585-be47-819c465c7a37") failed: Property not found. retry in 892.925999ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d0ef80fe-5a3c-4585-be47-819c465c7a37
14782024-12-18T22:13:43.599ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395") failed: Property not found. retry in 34.910613ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
14792024-12-18T22:13:43.633ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_387d3af0-07c5-480d-840e-4805c74ee7db") failed: Property not found. retry in 595.395467ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_387d3af0-07c5-480d-840e-4805c74ee7db
14802024-12-18T22:13:43.645ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395") failed: Property not found. retry in 52.107465ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
14812024-12-18T22:13:43.658ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_05d26e4d-8692-47ee-871b-e645e0477c82") failed: Property not found. retry in 1.231296697s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_05d26e4d-8692-47ee-871b-e645e0477c82
14822024-12-18T22:13:43.710ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395") failed: Property not found. retry in 224.497494ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
14832024-12-18T22:13:43.762ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ed9cf056-3789-49ba-a138-0933a1135c28") failed: Property not found. retry in 1.438891815s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ed9cf056-3789-49ba-a138-0933a1135c28
14842024-12-18T22:13:43.923ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ed99c029-5334-47b0-b85e-f2f87bb694f8") failed: Property not found. retry in 1.044704321s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ed99c029-5334-47b0-b85e-f2f87bb694f8
14852024-12-18T22:13:43.954ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6fd466f3-f0b4-4d40-b657-fd8a20eb0188") failed: Property not found. retry in 1.444349723s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6fd466f3-f0b4-4d40-b657-fd8a20eb0188
14862024-12-18T22:13:43.973ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395") failed: Property not found. retry in 233.933968ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
14872024-12-18T22:13:43.996ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_160de9b3-61fd-47fd-9883-78dcc7b014f0") failed: Property not found. retry in 1.101558026s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_160de9b3-61fd-47fd-9883-78dcc7b014f0
14882024-12-18T22:13:44.018ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_175d3cc8-9a02-4cf3-970c-8ec76a875436") failed: Property not found. retry in 904.833376ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_175d3cc8-9a02-4cf3-970c-8ec76a875436
14892024-12-18T22:13:44.039ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_864a9415-8555-4a87-a07b-905db0054ab1") failed: Property not found. retry in 981.377002ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_864a9415-8555-4a87-a07b-905db0054ab1
14902024-12-18T22:13:44.066ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_892dfd48-eedc-487a-9abc-a386c4d5781d") failed: Property not found. retry in 507.181078ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_892dfd48-eedc-487a-9abc-a386c4d5781d
14912024-12-18T22:13:44.094ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c0e3d114-075e-41a4-a4df-fa8131bbea97") failed: Property not found. retry in 1.047903542s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c0e3d114-075e-41a4-a4df-fa8131bbea97
14922024-12-18T22:13:44.130ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fbb8f81a-e6a1-4d5a-980c-08bb005aae11") failed: Property not found. retry in 803.301481ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fbb8f81a-e6a1-4d5a-980c-08bb005aae11
14932024-12-18T22:13:44.160ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_509b5c7f-9ddc-4e7c-956e-5984acfd38a7") failed: Property not found. retry in 901.452002ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_509b5c7f-9ddc-4e7c-956e-5984acfd38a7
14942024-12-18T22:13:44.172ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bb3be4a7-c724-4d22-bc17-549855e0c8cd") failed: Property not found. retry in 803.099855ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bb3be4a7-c724-4d22-bc17-549855e0c8cd
14952024-12-18T22:13:44.219ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395") failed: Property not found. retry in 530.995557ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
14962024-12-18T22:13:44.242ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_387d3af0-07c5-480d-840e-4805c74ee7db") failed: Property not found. retry in 1.113139939s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_387d3af0-07c5-480d-840e-4805c74ee7db
14972024-12-18T22:13:44.300ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bd8a0397-a96b-4af7-bb62-cac596d73425") failed: Property not found. retry in 1.406067992s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bd8a0397-a96b-4af7-bb62-cac596d73425
14982024-12-18T22:13:44.450ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d0ef80fe-5a3c-4585-be47-819c465c7a37") failed: Property not found. retry in 1.105940354s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d0ef80fe-5a3c-4585-be47-819c465c7a37
14992024-12-18T22:13:44.587ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_892dfd48-eedc-487a-9abc-a386c4d5781d") failed: Property not found. retry in 876.370708ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_892dfd48-eedc-487a-9abc-a386c4d5781d
15002024-12-18T22:13:44.598ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_218e3da3-c056-4f46-bedf-ff540f2a1d48") failed: Property not found. retry in 1.260709508s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_218e3da3-c056-4f46-bedf-ff540f2a1d48
15012024-12-18T22:13:44.760ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395") failed: Property not found. retry in 1.083354269s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
15022024-12-18T22:13:44.850ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e4f87f5-8c7c-45a2-b576-510817bf70ba") failed: Property not found. retry in 807.082336ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2e4f87f5-8c7c-45a2-b576-510817bf70ba
15032024-12-18T22:13:44.902ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_05d26e4d-8692-47ee-871b-e645e0477c82") failed: Property not found. retry in 761.70378ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_05d26e4d-8692-47ee-871b-e645e0477c82
15042024-12-18T22:13:45.051ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_864a9415-8555-4a87-a07b-905db0054ab1") failed: Property not found. retry in 1.091833402s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_864a9415-8555-4a87-a07b-905db0054ab1
15052024-12-18T22:13:45.065ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fbb8f81a-e6a1-4d5a-980c-08bb005aae11") failed: Property not found. retry in 1.483706202s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fbb8f81a-e6a1-4d5a-980c-08bb005aae11
15062024-12-18T22:13:45.078ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_175d3cc8-9a02-4cf3-970c-8ec76a875436") failed: Property not found. retry in 789.376286ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_175d3cc8-9a02-4cf3-970c-8ec76a875436
15072024-12-18T22:13:45.090ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bb3be4a7-c724-4d22-bc17-549855e0c8cd") failed: Property not found. retry in 1.162240788s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bb3be4a7-c724-4d22-bc17-549855e0c8cd
15082024-12-18T22:13:45.101ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_509b5c7f-9ddc-4e7c-956e-5984acfd38a7") failed: Property not found. retry in 511.519917ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_509b5c7f-9ddc-4e7c-956e-5984acfd38a7
15092024-12-18T22:13:45.114ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ed99c029-5334-47b0-b85e-f2f87bb694f8") failed: Property not found. retry in 1.157727452s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ed99c029-5334-47b0-b85e-f2f87bb694f8
15102024-12-18T22:13:45.128ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_160de9b3-61fd-47fd-9883-78dcc7b014f0") failed: Property not found. retry in 946.204952ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_160de9b3-61fd-47fd-9883-78dcc7b014f0
15112024-12-18T22:13:45.154ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c0e3d114-075e-41a4-a4df-fa8131bbea97") failed: Property not found. retry in 1.42745508s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c0e3d114-075e-41a4-a4df-fa8131bbea97
15122024-12-18T22:13:45.214ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ed9cf056-3789-49ba-a138-0933a1135c28") failed: Property not found. retry in 998.7717ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ed9cf056-3789-49ba-a138-0933a1135c28
15132024-12-18T22:13:45.367ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_387d3af0-07c5-480d-840e-4805c74ee7db") failed: Property not found. retry in 635.454216ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_387d3af0-07c5-480d-840e-4805c74ee7db
15142024-12-18T22:13:45.413ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6fd466f3-f0b4-4d40-b657-fd8a20eb0188") failed: Property not found. retry in 549.211223ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6fd466f3-f0b4-4d40-b657-fd8a20eb0188
15152024-12-18T22:13:45.477ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_892dfd48-eedc-487a-9abc-a386c4d5781d") failed: Property not found. retry in 532.493351ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_892dfd48-eedc-487a-9abc-a386c4d5781d
15162024-12-18T22:13:45.570ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d0ef80fe-5a3c-4585-be47-819c465c7a37") failed: Property not found. retry in 1.306239949s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d0ef80fe-5a3c-4585-be47-819c465c7a37
15172024-12-18T22:13:45.624ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_509b5c7f-9ddc-4e7c-956e-5984acfd38a7") failed: Property not found. retry in 1.114319376s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_509b5c7f-9ddc-4e7c-956e-5984acfd38a7
15182024-12-18T22:13:45.667ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e4f87f5-8c7c-45a2-b576-510817bf70ba") failed: Property not found. retry in 773.971587ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2e4f87f5-8c7c-45a2-b576-510817bf70ba
15192024-12-18T22:13:45.677ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_05d26e4d-8692-47ee-871b-e645e0477c82") failed: Property not found. retry in 1.208443255s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_05d26e4d-8692-47ee-871b-e645e0477c82
15202024-12-18T22:13:45.716ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bd8a0397-a96b-4af7-bb62-cac596d73425") failed: Property not found. retry in 769.77362ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bd8a0397-a96b-4af7-bb62-cac596d73425
15212024-12-18T22:13:45.853ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395") failed: Property not found. retry in 1.31334968s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
15222024-12-18T22:13:45.869ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_218e3da3-c056-4f46-bedf-ff540f2a1d48") failed: Property not found. retry in 649.107433ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_218e3da3-c056-4f46-bedf-ff540f2a1d48
15232024-12-18T22:13:45.878ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_175d3cc8-9a02-4cf3-970c-8ec76a875436") failed: Property not found. retry in 568.412777ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_175d3cc8-9a02-4cf3-970c-8ec76a875436
15242024-12-18T22:13:45.971ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6fd466f3-f0b4-4d40-b657-fd8a20eb0188") failed: Property not found. retry in 513.031942ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6fd466f3-f0b4-4d40-b657-fd8a20eb0188
15252024-12-18T22:13:46.013ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_387d3af0-07c5-480d-840e-4805c74ee7db") failed: Property not found. retry in 1.082227579s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_387d3af0-07c5-480d-840e-4805c74ee7db
15262024-12-18T22:13:46.022ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_892dfd48-eedc-487a-9abc-a386c4d5781d") failed: Property not found. retry in 703.251346ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_892dfd48-eedc-487a-9abc-a386c4d5781d
15272024-12-18T22:13:46.083ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_160de9b3-61fd-47fd-9883-78dcc7b014f0") failed: Property not found. retry in 745.65967ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_160de9b3-61fd-47fd-9883-78dcc7b014f0
15282024-12-18T22:13:46.152ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_864a9415-8555-4a87-a07b-905db0054ab1") failed: Property not found. retry in 999.516088ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_864a9415-8555-4a87-a07b-905db0054ab1
15292024-12-18T22:13:46.224ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ed9cf056-3789-49ba-a138-0933a1135c28") failed: Property not found. retry in 1.157041843s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ed9cf056-3789-49ba-a138-0933a1135c28
15302024-12-18T22:13:46.264ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bb3be4a7-c724-4d22-bc17-549855e0c8cd") failed: Property not found. retry in 673.808481ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bb3be4a7-c724-4d22-bc17-549855e0c8cd
15312024-12-18T22:13:46.281ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ed99c029-5334-47b0-b85e-f2f87bb694f8") failed: Property not found. retry in 745.916975ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ed99c029-5334-47b0-b85e-f2f87bb694f8
15322024-12-18T22:13:46.452ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e4f87f5-8c7c-45a2-b576-510817bf70ba") failed: Property not found. retry in 733.373813ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2e4f87f5-8c7c-45a2-b576-510817bf70ba
15332024-12-18T22:13:46.460ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_175d3cc8-9a02-4cf3-970c-8ec76a875436") failed: Property not found. retry in 817.912338ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_175d3cc8-9a02-4cf3-970c-8ec76a875436
15342024-12-18T22:13:46.479ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:41574
15352024-12-18T22:13:46.539ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58926 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:41574 req_id = e16608f9-8a6b-443b-962d-95538d3fb59c response_code = 200 uri = /baseboard
15362024-12-18T22:13:46.550ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_218e3da3-c056-4f46-bedf-ff540f2a1d48") failed: Property not found. retry in 705.084455ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_218e3da3-c056-4f46-bedf-ff540f2a1d48
15372024-12-18T22:13:46.559ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6fd466f3-f0b4-4d40-b657-fd8a20eb0188") failed: Property not found. retry in 552.068511ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6fd466f3-f0b4-4d40-b657-fd8a20eb0188
15382024-12-18T22:13:46.567ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bd8a0397-a96b-4af7-bb62-cac596d73425") failed: Property not found. retry in 539.768915ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bd8a0397-a96b-4af7-bb62-cac596d73425
15392024-12-18T22:13:46.576ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fbb8f81a-e6a1-4d5a-980c-08bb005aae11") failed: Property not found. retry in 1.025649857s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fbb8f81a-e6a1-4d5a-980c-08bb005aae11
15402024-12-18T22:13:46.591ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c0e3d114-075e-41a4-a4df-fa8131bbea97") failed: Property not found. retry in 530.817386ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c0e3d114-075e-41a4-a4df-fa8131bbea97
15412024-12-18T22:13:46.736ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_892dfd48-eedc-487a-9abc-a386c4d5781d") failed: Property not found. retry in 543.348809ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_892dfd48-eedc-487a-9abc-a386c4d5781d
15422024-12-18T22:13:46.748ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_509b5c7f-9ddc-4e7c-956e-5984acfd38a7") failed: Property not found. retry in 1.381986903s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_509b5c7f-9ddc-4e7c-956e-5984acfd38a7
15432024-12-18T22:13:46.837ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_160de9b3-61fd-47fd-9883-78dcc7b014f0") failed: Property not found. retry in 1.146730256s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_160de9b3-61fd-47fd-9883-78dcc7b014f0
15442024-12-18T22:13:46.885ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d0ef80fe-5a3c-4585-be47-819c465c7a37") failed: Property not found. retry in 1.432836913s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d0ef80fe-5a3c-4585-be47-819c465c7a37
15452024-12-18T22:13:46.896ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_05d26e4d-8692-47ee-871b-e645e0477c82") failed: Property not found. retry in 686.549007ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_05d26e4d-8692-47ee-871b-e645e0477c82
15462024-12-18T22:13:46.948ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bb3be4a7-c724-4d22-bc17-549855e0c8cd") failed: Property not found. retry in 921.750518ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bb3be4a7-c724-4d22-bc17-549855e0c8cd
15472024-12-18T22:13:47.035ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ed99c029-5334-47b0-b85e-f2f87bb694f8") failed: Property not found. retry in 1.476531799s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ed99c029-5334-47b0-b85e-f2f87bb694f8
15482024-12-18T22:13:47.103ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_387d3af0-07c5-480d-840e-4805c74ee7db") failed: Property not found. retry in 552.901951ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_387d3af0-07c5-480d-840e-4805c74ee7db
15492024-12-18T22:13:47.114ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bd8a0397-a96b-4af7-bb62-cac596d73425") failed: Property not found. retry in 762.357795ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bd8a0397-a96b-4af7-bb62-cac596d73425
15502024-12-18T22:13:47.122ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6fd466f3-f0b4-4d40-b657-fd8a20eb0188") failed: Property not found. retry in 1.337443613s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6fd466f3-f0b4-4d40-b657-fd8a20eb0188
15512024-12-18T22:13:47.129ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c0e3d114-075e-41a4-a4df-fa8131bbea97") failed: Property not found. retry in 817.196314ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c0e3d114-075e-41a4-a4df-fa8131bbea97
15522024-12-18T22:13:47.160ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_864a9415-8555-4a87-a07b-905db0054ab1") failed: Property not found. retry in 858.782397ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_864a9415-8555-4a87-a07b-905db0054ab1
15532024-12-18T22:13:47.174ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395") failed: Property not found. retry in 773.144116ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
15542024-12-18T22:13:47.195ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e4f87f5-8c7c-45a2-b576-510817bf70ba") failed: Property not found. retry in 894.163375ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2e4f87f5-8c7c-45a2-b576-510817bf70ba
15552024-12-18T22:13:47.265ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_218e3da3-c056-4f46-bedf-ff540f2a1d48") failed: Property not found. retry in 1.055488798s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_218e3da3-c056-4f46-bedf-ff540f2a1d48
15562024-12-18T22:13:47.287ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_175d3cc8-9a02-4cf3-970c-8ec76a875436") failed: Property not found. retry in 1.292920322s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_175d3cc8-9a02-4cf3-970c-8ec76a875436
15572024-12-18T22:13:47.294ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_892dfd48-eedc-487a-9abc-a386c4d5781d") failed: Property not found. retry in 718.117532ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_892dfd48-eedc-487a-9abc-a386c4d5781d
15582024-12-18T22:13:47.388ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ed9cf056-3789-49ba-a138-0933a1135c28") failed: Property not found. retry in 940.546282ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ed9cf056-3789-49ba-a138-0933a1135c28
15592024-12-18T22:13:47.592ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_05d26e4d-8692-47ee-871b-e645e0477c82") failed: Property not found. retry in 572.132464ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_05d26e4d-8692-47ee-871b-e645e0477c82
15602024-12-18T22:13:47.612ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fbb8f81a-e6a1-4d5a-980c-08bb005aae11") failed: Property not found. retry in 1.109132476s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fbb8f81a-e6a1-4d5a-980c-08bb005aae11
15612024-12-18T22:13:47.665ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_387d3af0-07c5-480d-840e-4805c74ee7db") failed: Property not found. retry in 566.290196ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_387d3af0-07c5-480d-840e-4805c74ee7db
15622024-12-18T22:13:47.879ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bb3be4a7-c724-4d22-bc17-549855e0c8cd") failed: Property not found. retry in 982.550786ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bb3be4a7-c724-4d22-bc17-549855e0c8cd
15632024-12-18T22:13:47.888ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bd8a0397-a96b-4af7-bb62-cac596d73425") failed: Property not found. retry in 589.657279ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bd8a0397-a96b-4af7-bb62-cac596d73425
15642024-12-18T22:13:47.955ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395") failed: Property not found. retry in 1.015254701s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
15652024-12-18T22:13:47.963ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c0e3d114-075e-41a4-a4df-fa8131bbea97") failed: Property not found. retry in 799.393991ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c0e3d114-075e-41a4-a4df-fa8131bbea97
15662024-12-18T22:13:47.993ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_160de9b3-61fd-47fd-9883-78dcc7b014f0") failed: Property not found. retry in 1.395208467s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_160de9b3-61fd-47fd-9883-78dcc7b014f0
15672024-12-18T22:13:48.021ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_892dfd48-eedc-487a-9abc-a386c4d5781d") failed: Property not found. retry in 621.383225ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_892dfd48-eedc-487a-9abc-a386c4d5781d
15682024-12-18T22:13:48.035ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_864a9415-8555-4a87-a07b-905db0054ab1") failed: Property not found. retry in 1.029012272s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_864a9415-8555-4a87-a07b-905db0054ab1
15692024-12-18T22:13:48.097ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e4f87f5-8c7c-45a2-b576-510817bf70ba") failed: Property not found. retry in 932.021591ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2e4f87f5-8c7c-45a2-b576-510817bf70ba
15702024-12-18T22:13:48.141ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_509b5c7f-9ddc-4e7c-956e-5984acfd38a7") failed: Property not found. retry in 570.976016ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_509b5c7f-9ddc-4e7c-956e-5984acfd38a7
15712024-12-18T22:13:48.173ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_05d26e4d-8692-47ee-871b-e645e0477c82") failed: Property not found. retry in 851.280338ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_05d26e4d-8692-47ee-871b-e645e0477c82
15722024-12-18T22:13:48.241ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_387d3af0-07c5-480d-840e-4805c74ee7db") failed: Property not found. retry in 1.379475482s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_387d3af0-07c5-480d-840e-4805c74ee7db
15732024-12-18T22:13:48.329ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d0ef80fe-5a3c-4585-be47-819c465c7a37") failed: Property not found. retry in 647.941428ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d0ef80fe-5a3c-4585-be47-819c465c7a37
15742024-12-18T22:13:48.337ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_218e3da3-c056-4f46-bedf-ff540f2a1d48") failed: Property not found. retry in 578.187844ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_218e3da3-c056-4f46-bedf-ff540f2a1d48
15752024-12-18T22:13:48.345ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ed9cf056-3789-49ba-a138-0933a1135c28") failed: Property not found. retry in 1.2217201s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ed9cf056-3789-49ba-a138-0933a1135c28
15762024-12-18T22:13:48.471ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6fd466f3-f0b4-4d40-b657-fd8a20eb0188") failed: Property not found. retry in 727.762127ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6fd466f3-f0b4-4d40-b657-fd8a20eb0188
15772024-12-18T22:13:48.488ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bd8a0397-a96b-4af7-bb62-cac596d73425") failed: Property not found. retry in 753.776417ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bd8a0397-a96b-4af7-bb62-cac596d73425
15782024-12-18T22:13:48.526ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ed99c029-5334-47b0-b85e-f2f87bb694f8") failed: Property not found. retry in 1.262183316s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ed99c029-5334-47b0-b85e-f2f87bb694f8
15792024-12-18T22:13:48.595ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_175d3cc8-9a02-4cf3-970c-8ec76a875436") failed: Property not found. retry in 1.286359066s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_175d3cc8-9a02-4cf3-970c-8ec76a875436
15802024-12-18T22:13:48.655ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_892dfd48-eedc-487a-9abc-a386c4d5781d") failed: Property not found. retry in 948.863075ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_892dfd48-eedc-487a-9abc-a386c4d5781d
15812024-12-18T22:13:48.722ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_509b5c7f-9ddc-4e7c-956e-5984acfd38a7") failed: Property not found. retry in 626.491848ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_509b5c7f-9ddc-4e7c-956e-5984acfd38a7
15822024-12-18T22:13:48.731ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fbb8f81a-e6a1-4d5a-980c-08bb005aae11") failed: Property not found. retry in 796.305496ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fbb8f81a-e6a1-4d5a-980c-08bb005aae11
15832024-12-18T22:13:48.774ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c0e3d114-075e-41a4-a4df-fa8131bbea97") failed: Property not found. retry in 607.751948ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c0e3d114-075e-41a4-a4df-fa8131bbea97
15842024-12-18T22:13:48.872ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bb3be4a7-c724-4d22-bc17-549855e0c8cd") failed: Property not found. retry in 951.900828ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bb3be4a7-c724-4d22-bc17-549855e0c8cd
15852024-12-18T22:13:48.926ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_218e3da3-c056-4f46-bedf-ff540f2a1d48") failed: Property not found. retry in 739.989428ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_218e3da3-c056-4f46-bedf-ff540f2a1d48
15862024-12-18T22:13:48.980ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395") failed: Property not found. retry in 1.429743804s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
15872024-12-18T22:13:48.988ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d0ef80fe-5a3c-4585-be47-819c465c7a37") failed: Property not found. retry in 1.207318358s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d0ef80fe-5a3c-4585-be47-819c465c7a37
15882024-12-18T22:13:49.033ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_05d26e4d-8692-47ee-871b-e645e0477c82") failed: Property not found. retry in 1.367173549s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_05d26e4d-8692-47ee-871b-e645e0477c82
15892024-12-18T22:13:49.041ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e4f87f5-8c7c-45a2-b576-510817bf70ba") failed: Property not found. retry in 1.460623392s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2e4f87f5-8c7c-45a2-b576-510817bf70ba
15902024-12-18T22:13:49.073ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_864a9415-8555-4a87-a07b-905db0054ab1") failed: Property not found. retry in 523.440602ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_864a9415-8555-4a87-a07b-905db0054ab1
15912024-12-18T22:13:49.208ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6fd466f3-f0b4-4d40-b657-fd8a20eb0188") failed: Property not found. retry in 727.722164ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6fd466f3-f0b4-4d40-b657-fd8a20eb0188
15922024-12-18T22:13:49.254ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bd8a0397-a96b-4af7-bb62-cac596d73425") failed: Property not found. retry in 574.011202ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bd8a0397-a96b-4af7-bb62-cac596d73425
15932024-12-18T22:13:49.358ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_509b5c7f-9ddc-4e7c-956e-5984acfd38a7") failed: Property not found. retry in 1.090114139s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_509b5c7f-9ddc-4e7c-956e-5984acfd38a7
15942024-12-18T22:13:49.391ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c0e3d114-075e-41a4-a4df-fa8131bbea97") failed: Property not found. retry in 746.33459ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c0e3d114-075e-41a4-a4df-fa8131bbea97
15952024-12-18T22:13:49.399ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_160de9b3-61fd-47fd-9883-78dcc7b014f0") failed: Property not found. retry in 1.386697443s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_160de9b3-61fd-47fd-9883-78dcc7b014f0
15962024-12-18T22:13:49.537ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fbb8f81a-e6a1-4d5a-980c-08bb005aae11") failed: Property not found. retry in 1.00555878s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fbb8f81a-e6a1-4d5a-980c-08bb005aae11
15972024-12-18T22:13:49.576ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ed9cf056-3789-49ba-a138-0933a1135c28") failed: Property not found. retry in 558.53936ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ed9cf056-3789-49ba-a138-0933a1135c28
15982024-12-18T22:13:49.608ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_864a9415-8555-4a87-a07b-905db0054ab1") failed: Property not found. retry in 792.312947ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_864a9415-8555-4a87-a07b-905db0054ab1
15992024-12-18T22:13:49.616ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_892dfd48-eedc-487a-9abc-a386c4d5781d") failed: Property not found. retry in 908.785767ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_892dfd48-eedc-487a-9abc-a386c4d5781d
16002024-12-18T22:13:49.630ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_387d3af0-07c5-480d-840e-4805c74ee7db") failed: Property not found. retry in 1.178804376s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_387d3af0-07c5-480d-840e-4805c74ee7db
16012024-12-18T22:13:49.675ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_218e3da3-c056-4f46-bedf-ff540f2a1d48") failed: Property not found. retry in 886.833417ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_218e3da3-c056-4f46-bedf-ff540f2a1d48
16022024-12-18T22:13:49.798ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ed99c029-5334-47b0-b85e-f2f87bb694f8") failed: Property not found. retry in 1.04502914s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ed99c029-5334-47b0-b85e-f2f87bb694f8
16032024-12-18T22:13:49.835ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bb3be4a7-c724-4d22-bc17-549855e0c8cd") failed: Property not found. retry in 1.459254623s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bb3be4a7-c724-4d22-bc17-549855e0c8cd
16042024-12-18T22:13:49.842ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bd8a0397-a96b-4af7-bb62-cac596d73425") failed: Property not found. retry in 782.1563ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bd8a0397-a96b-4af7-bb62-cac596d73425
16052024-12-18T22:13:49.890ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_175d3cc8-9a02-4cf3-970c-8ec76a875436") failed: Property not found. retry in 903.195624ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_175d3cc8-9a02-4cf3-970c-8ec76a875436
16062024-12-18T22:13:49.957ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6fd466f3-f0b4-4d40-b657-fd8a20eb0188") failed: Property not found. retry in 1.180162465s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6fd466f3-f0b4-4d40-b657-fd8a20eb0188
16072024-12-18T22:13:50.147ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ed9cf056-3789-49ba-a138-0933a1135c28") failed: Property not found. retry in 1.458414691s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ed9cf056-3789-49ba-a138-0933a1135c28
16082024-12-18T22:13:50.157ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c0e3d114-075e-41a4-a4df-fa8131bbea97") failed: Property not found. retry in 840.017239ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c0e3d114-075e-41a4-a4df-fa8131bbea97
16092024-12-18T22:13:50.205ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d0ef80fe-5a3c-4585-be47-819c465c7a37") failed: Property not found. retry in 1.249144044s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d0ef80fe-5a3c-4585-be47-819c465c7a37
16102024-12-18T22:13:50.409ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_864a9415-8555-4a87-a07b-905db0054ab1") failed: Property not found. retry in 1.123569302s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_864a9415-8555-4a87-a07b-905db0054ab1
16112024-12-18T22:13:50.418ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_05d26e4d-8692-47ee-871b-e645e0477c82") failed: Property not found. retry in 1.35094796s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_05d26e4d-8692-47ee-871b-e645e0477c82
16122024-12-18T22:13:50.426ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395") failed: Property not found. retry in 1.435140953s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
16132024-12-18T22:13:50.458ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_509b5c7f-9ddc-4e7c-956e-5984acfd38a7") failed: Property not found. retry in 1.492213395s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_509b5c7f-9ddc-4e7c-956e-5984acfd38a7
16142024-12-18T22:13:50.469ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_98356a8d-08b0-46fd-8961-c8be5019dba9: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin-single"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:8123'/> <propval type="astring" name="ch_binary" value='/opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
16152024-12-18T22:13:50.477ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_98356a8d-08b0-46fd-8961-c8be5019dba9 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_clickhouse_98356a8d-08b0-46fd-8961-c8be5019dba9
16162024-12-18T22:13:50.512ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e4f87f5-8c7c-45a2-b576-510817bf70ba") failed: Property not found. retry in 731.906279ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2e4f87f5-8c7c-45a2-b576-510817bf70ba
16172024-12-18T22:13:50.535ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_892dfd48-eedc-487a-9abc-a386c4d5781d") failed: Property not found. retry in 1.012418864s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_892dfd48-eedc-487a-9abc-a386c4d5781d
16182024-12-18T22:13:50.552ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fbb8f81a-e6a1-4d5a-980c-08bb005aae11") failed: Property not found. retry in 535.486431ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fbb8f81a-e6a1-4d5a-980c-08bb005aae11
16192024-12-18T22:13:50.572ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_218e3da3-c056-4f46-bedf-ff540f2a1d48") failed: Property not found. retry in 775.402354ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_218e3da3-c056-4f46-bedf-ff540f2a1d48
16202024-12-18T22:13:50.634ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bd8a0397-a96b-4af7-bb62-cac596d73425") failed: Property not found. retry in 1.442684118s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bd8a0397-a96b-4af7-bb62-cac596d73425
16212024-12-18T22:13:50.667ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_98356a8d-08b0-46fd-8961-c8be5019dba9") failed: Property not found. retry in 26.48541ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_98356a8d-08b0-46fd-8961-c8be5019dba9
16222024-12-18T22:13:50.703ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_98356a8d-08b0-46fd-8961-c8be5019dba9") failed: Property not found. retry in 106.725106ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_98356a8d-08b0-46fd-8961-c8be5019dba9
16232024-12-18T22:13:50.797ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_160de9b3-61fd-47fd-9883-78dcc7b014f0") failed: Property not found. retry in 1.20877316s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_160de9b3-61fd-47fd-9883-78dcc7b014f0
16242024-12-18T22:13:50.805ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_175d3cc8-9a02-4cf3-970c-8ec76a875436") failed: Property not found. retry in 1.175838626s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_175d3cc8-9a02-4cf3-970c-8ec76a875436
16252024-12-18T22:13:50.820ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_98356a8d-08b0-46fd-8961-c8be5019dba9") failed: Property not found. retry in 135.663702ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_98356a8d-08b0-46fd-8961-c8be5019dba9
16262024-12-18T22:13:50.831ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_387d3af0-07c5-480d-840e-4805c74ee7db") failed: Property not found. retry in 1.121027933s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_387d3af0-07c5-480d-840e-4805c74ee7db
16272024-12-18T22:13:50.864ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ed99c029-5334-47b0-b85e-f2f87bb694f8") failed: Property not found. retry in 1.352750334s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ed99c029-5334-47b0-b85e-f2f87bb694f8
16282024-12-18T22:13:50.966ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_98356a8d-08b0-46fd-8961-c8be5019dba9") failed: Property not found. retry in 434.077789ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_98356a8d-08b0-46fd-8961-c8be5019dba9
16292024-12-18T22:13:51.007ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c0e3d114-075e-41a4-a4df-fa8131bbea97") failed: Property not found. retry in 1.159471342s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c0e3d114-075e-41a4-a4df-fa8131bbea97
16302024-12-18T22:13:51.097ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fbb8f81a-e6a1-4d5a-980c-08bb005aae11") failed: Property not found. retry in 984.490351ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fbb8f81a-e6a1-4d5a-980c-08bb005aae11
16312024-12-18T22:13:51.148ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6fd466f3-f0b4-4d40-b657-fd8a20eb0188") failed: Property not found. retry in 527.754337ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6fd466f3-f0b4-4d40-b657-fd8a20eb0188
16322024-12-18T22:13:51.254ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e4f87f5-8c7c-45a2-b576-510817bf70ba") failed: Property not found. retry in 1.273962427s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2e4f87f5-8c7c-45a2-b576-510817bf70ba
16332024-12-18T22:13:51.303ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bb3be4a7-c724-4d22-bc17-549855e0c8cd") failed: Property not found. retry in 1.462125964s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bb3be4a7-c724-4d22-bc17-549855e0c8cd
16342024-12-18T22:13:51.355ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_218e3da3-c056-4f46-bedf-ff540f2a1d48") failed: Property not found. retry in 786.012081ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_218e3da3-c056-4f46-bedf-ff540f2a1d48
16352024-12-18T22:13:51.410ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_98356a8d-08b0-46fd-8961-c8be5019dba9") failed: Property not found. retry in 723.149893ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_98356a8d-08b0-46fd-8961-c8be5019dba9
16362024-12-18T22:13:51.465ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d0ef80fe-5a3c-4585-be47-819c465c7a37") failed: Property not found. retry in 960.252367ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d0ef80fe-5a3c-4585-be47-819c465c7a37
16372024-12-18T22:13:51.543ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_864a9415-8555-4a87-a07b-905db0054ab1") failed: Property not found. retry in 1.242726268s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_864a9415-8555-4a87-a07b-905db0054ab1
16382024-12-18T22:13:51.558ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_892dfd48-eedc-487a-9abc-a386c4d5781d") failed: Property not found. retry in 960.437414ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_892dfd48-eedc-487a-9abc-a386c4d5781d
16392024-12-18T22:13:51.617ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ed9cf056-3789-49ba-a138-0933a1135c28") failed: Property not found. retry in 604.991001ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ed9cf056-3789-49ba-a138-0933a1135c28
16402024-12-18T22:13:51.685ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6fd466f3-f0b4-4d40-b657-fd8a20eb0188") failed: Property not found. retry in 1.032240327s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6fd466f3-f0b4-4d40-b657-fd8a20eb0188
16412024-12-18T22:13:51.778ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_05d26e4d-8692-47ee-871b-e645e0477c82") failed: Property not found. retry in 515.433054ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_05d26e4d-8692-47ee-871b-e645e0477c82
16422024-12-18T22:13:51.871ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395") failed: Property not found. retry in 1.047368991s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
16432024-12-18T22:13:51.959ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_509b5c7f-9ddc-4e7c-956e-5984acfd38a7") failed: Property not found. retry in 929.660426ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_509b5c7f-9ddc-4e7c-956e-5984acfd38a7
16442024-12-18T22:13:51.967ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_387d3af0-07c5-480d-840e-4805c74ee7db") failed: Property not found. retry in 945.39514ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_387d3af0-07c5-480d-840e-4805c74ee7db
16452024-12-18T22:13:51.990ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_175d3cc8-9a02-4cf3-970c-8ec76a875436") failed: Property not found. retry in 515.528428ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_175d3cc8-9a02-4cf3-970c-8ec76a875436
16462024-12-18T22:13:52.015ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_160de9b3-61fd-47fd-9883-78dcc7b014f0") failed: Property not found. retry in 1.158318523s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_160de9b3-61fd-47fd-9883-78dcc7b014f0
16472024-12-18T22:13:52.087ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bd8a0397-a96b-4af7-bb62-cac596d73425") failed: Property not found. retry in 541.491229ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bd8a0397-a96b-4af7-bb62-cac596d73425
16482024-12-18T22:13:52.095ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fbb8f81a-e6a1-4d5a-980c-08bb005aae11") failed: Property not found. retry in 1.20707413s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fbb8f81a-e6a1-4d5a-980c-08bb005aae11
16492024-12-18T22:13:52.144ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_98356a8d-08b0-46fd-8961-c8be5019dba9") failed: Property not found. retry in 1.19100722s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_98356a8d-08b0-46fd-8961-c8be5019dba9
16502024-12-18T22:13:52.153ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_218e3da3-c056-4f46-bedf-ff540f2a1d48") failed: Property not found. retry in 844.858448ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_218e3da3-c056-4f46-bedf-ff540f2a1d48
16512024-12-18T22:13:52.176ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c0e3d114-075e-41a4-a4df-fa8131bbea97") failed: Property not found. retry in 875.109592ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c0e3d114-075e-41a4-a4df-fa8131bbea97
16522024-12-18T22:13:52.226ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ed99c029-5334-47b0-b85e-f2f87bb694f8") failed: Property not found. retry in 840.602545ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ed99c029-5334-47b0-b85e-f2f87bb694f8
16532024-12-18T22:13:52.233ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ed9cf056-3789-49ba-a138-0933a1135c28") failed: Property not found. retry in 1.168248256s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ed9cf056-3789-49ba-a138-0933a1135c28
16542024-12-18T22:13:52.302ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_05d26e4d-8692-47ee-871b-e645e0477c82") failed: Property not found. retry in 1.085835273s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_05d26e4d-8692-47ee-871b-e645e0477c82
16552024-12-18T22:13:52.435ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d0ef80fe-5a3c-4585-be47-819c465c7a37") failed: Property not found. retry in 1.10849305s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d0ef80fe-5a3c-4585-be47-819c465c7a37
16562024-12-18T22:13:52.515ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_175d3cc8-9a02-4cf3-970c-8ec76a875436") failed: Property not found. retry in 713.446904ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_175d3cc8-9a02-4cf3-970c-8ec76a875436
16572024-12-18T22:13:52.530ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_892dfd48-eedc-487a-9abc-a386c4d5781d") failed: Property not found. retry in 677.048785ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_892dfd48-eedc-487a-9abc-a386c4d5781d
16582024-12-18T22:13:52.538ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e4f87f5-8c7c-45a2-b576-510817bf70ba") failed: Property not found. retry in 557.851196ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2e4f87f5-8c7c-45a2-b576-510817bf70ba
16592024-12-18T22:13:52.638ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bd8a0397-a96b-4af7-bb62-cac596d73425") failed: Property not found. retry in 845.247412ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bd8a0397-a96b-4af7-bb62-cac596d73425
16602024-12-18T22:13:52.728ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6fd466f3-f0b4-4d40-b657-fd8a20eb0188") failed: Property not found. retry in 524.963348ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6fd466f3-f0b4-4d40-b657-fd8a20eb0188
16612024-12-18T22:13:52.776ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bb3be4a7-c724-4d22-bc17-549855e0c8cd") failed: Property not found. retry in 842.465751ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bb3be4a7-c724-4d22-bc17-549855e0c8cd
16622024-12-18T22:13:52.795ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_864a9415-8555-4a87-a07b-905db0054ab1") failed: Property not found. retry in 626.854495ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_864a9415-8555-4a87-a07b-905db0054ab1
16632024-12-18T22:13:52.900ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_509b5c7f-9ddc-4e7c-956e-5984acfd38a7") failed: Property not found. retry in 1.001332768s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_509b5c7f-9ddc-4e7c-956e-5984acfd38a7
16642024-12-18T22:13:52.923ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_387d3af0-07c5-480d-840e-4805c74ee7db") failed: Property not found. retry in 678.249069ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_387d3af0-07c5-480d-840e-4805c74ee7db
16652024-12-18T22:13:52.931ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395") failed: Property not found. retry in 1.160550936s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
16662024-12-18T22:13:53.009ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_218e3da3-c056-4f46-bedf-ff540f2a1d48") failed: Property not found. retry in 1.498035573s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_218e3da3-c056-4f46-bedf-ff540f2a1d48
16672024-12-18T22:13:53.061ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c0e3d114-075e-41a4-a4df-fa8131bbea97") failed: Property not found. retry in 971.405151ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c0e3d114-075e-41a4-a4df-fa8131bbea97
16682024-12-18T22:13:53.075ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ed99c029-5334-47b0-b85e-f2f87bb694f8") failed: Property not found. retry in 1.24273262s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ed99c029-5334-47b0-b85e-f2f87bb694f8
16692024-12-18T22:13:53.106ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e4f87f5-8c7c-45a2-b576-510817bf70ba") failed: Property not found. retry in 1.040067667s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2e4f87f5-8c7c-45a2-b576-510817bf70ba
16702024-12-18T22:13:53.182ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_160de9b3-61fd-47fd-9883-78dcc7b014f0") failed: Property not found. retry in 1.220084882s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_160de9b3-61fd-47fd-9883-78dcc7b014f0
16712024-12-18T22:13:53.217ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_892dfd48-eedc-487a-9abc-a386c4d5781d") failed: Property not found. retry in 1.303050906s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_892dfd48-eedc-487a-9abc-a386c4d5781d
16722024-12-18T22:13:53.239ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_175d3cc8-9a02-4cf3-970c-8ec76a875436") failed: Property not found. retry in 549.225333ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_175d3cc8-9a02-4cf3-970c-8ec76a875436
16732024-12-18T22:13:53.262ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6fd466f3-f0b4-4d40-b657-fd8a20eb0188") failed: Property not found. retry in 1.287625326s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6fd466f3-f0b4-4d40-b657-fd8a20eb0188
16742024-12-18T22:13:53.311ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fbb8f81a-e6a1-4d5a-980c-08bb005aae11") failed: Property not found. retry in 1.148625032s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fbb8f81a-e6a1-4d5a-980c-08bb005aae11
16752024-12-18T22:13:53.344ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_98356a8d-08b0-46fd-8961-c8be5019dba9") failed: Property not found. retry in 517.896116ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_98356a8d-08b0-46fd-8961-c8be5019dba9
16762024-12-18T22:13:53.398ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_05d26e4d-8692-47ee-871b-e645e0477c82") failed: Property not found. retry in 553.996261ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_05d26e4d-8692-47ee-871b-e645e0477c82
16772024-12-18T22:13:53.415ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ed9cf056-3789-49ba-a138-0933a1135c28") failed: Property not found. retry in 1.326889725s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ed9cf056-3789-49ba-a138-0933a1135c28
16782024-12-18T22:13:53.433ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_864a9415-8555-4a87-a07b-905db0054ab1") failed: Property not found. retry in 650.086331ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_864a9415-8555-4a87-a07b-905db0054ab1
16792024-12-18T22:13:53.494ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bd8a0397-a96b-4af7-bb62-cac596d73425") failed: Property not found. retry in 1.453235148s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bd8a0397-a96b-4af7-bb62-cac596d73425
16802024-12-18T22:13:53.554ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d0ef80fe-5a3c-4585-be47-819c465c7a37") failed: Property not found. retry in 1.227128672s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d0ef80fe-5a3c-4585-be47-819c465c7a37
16812024-12-18T22:13:53.611ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_387d3af0-07c5-480d-840e-4805c74ee7db") failed: Property not found. retry in 1.465740616s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_387d3af0-07c5-480d-840e-4805c74ee7db
16822024-12-18T22:13:53.629ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bb3be4a7-c724-4d22-bc17-549855e0c8cd") failed: Property not found. retry in 1.373317242s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bb3be4a7-c724-4d22-bc17-549855e0c8cd
16832024-12-18T22:13:53.799ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_175d3cc8-9a02-4cf3-970c-8ec76a875436") failed: Property not found. retry in 1.20335352s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_175d3cc8-9a02-4cf3-970c-8ec76a875436
16842024-12-18T22:13:53.873ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_98356a8d-08b0-46fd-8961-c8be5019dba9") failed: Property not found. retry in 1.151138523s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_98356a8d-08b0-46fd-8961-c8be5019dba9
16852024-12-18T22:13:53.911ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_509b5c7f-9ddc-4e7c-956e-5984acfd38a7") failed: Property not found. retry in 1.048874746s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_509b5c7f-9ddc-4e7c-956e-5984acfd38a7
16862024-12-18T22:13:53.962ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_05d26e4d-8692-47ee-871b-e645e0477c82") failed: Property not found. retry in 932.61251ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_05d26e4d-8692-47ee-871b-e645e0477c82
16872024-12-18T22:13:54.042ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c0e3d114-075e-41a4-a4df-fa8131bbea97") failed: Property not found. retry in 1.350777409s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c0e3d114-075e-41a4-a4df-fa8131bbea97
16882024-12-18T22:13:54.094ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_864a9415-8555-4a87-a07b-905db0054ab1") failed: Property not found. retry in 1.201807371s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_864a9415-8555-4a87-a07b-905db0054ab1
16892024-12-18T22:13:54.103ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395") failed: Property not found. retry in 736.103143ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
16902024-12-18T22:13:54.157ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e4f87f5-8c7c-45a2-b576-510817bf70ba") failed: Property not found. retry in 1.157293672s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2e4f87f5-8c7c-45a2-b576-510817bf70ba
16912024-12-18T22:13:54.328ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ed99c029-5334-47b0-b85e-f2f87bb694f8") failed: Property not found. retry in 582.887264ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ed99c029-5334-47b0-b85e-f2f87bb694f8
16922024-12-18T22:13:54.411ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_160de9b3-61fd-47fd-9883-78dcc7b014f0") failed: Property not found. retry in 1.333071898s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_160de9b3-61fd-47fd-9883-78dcc7b014f0
16932024-12-18T22:13:54.472ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fbb8f81a-e6a1-4d5a-980c-08bb005aae11") failed: Property not found. retry in 922.666537ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fbb8f81a-e6a1-4d5a-980c-08bb005aae11
16942024-12-18T22:13:54.519ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_218e3da3-c056-4f46-bedf-ff540f2a1d48") failed: Property not found. retry in 507.44332ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_218e3da3-c056-4f46-bedf-ff540f2a1d48
16952024-12-18T22:13:54.532ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_892dfd48-eedc-487a-9abc-a386c4d5781d") failed: Property not found. retry in 586.924795ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_892dfd48-eedc-487a-9abc-a386c4d5781d
16962024-12-18T22:13:54.561ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6fd466f3-f0b4-4d40-b657-fd8a20eb0188") failed: Property not found. retry in 977.089103ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6fd466f3-f0b4-4d40-b657-fd8a20eb0188
16972024-12-18T22:13:54.755ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ed9cf056-3789-49ba-a138-0933a1135c28") failed: Property not found. retry in 722.614876ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ed9cf056-3789-49ba-a138-0933a1135c28
16982024-12-18T22:13:54.794ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d0ef80fe-5a3c-4585-be47-819c465c7a37") failed: Property not found. retry in 1.363079044s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d0ef80fe-5a3c-4585-be47-819c465c7a37
16992024-12-18T22:13:54.852ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395") failed: Property not found. retry in 550.244265ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
17002024-12-18T22:13:54.909ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_05d26e4d-8692-47ee-871b-e645e0477c82") failed: Property not found. retry in 1.189629417s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_05d26e4d-8692-47ee-871b-e645e0477c82
17012024-12-18T22:13:54.925ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ed99c029-5334-47b0-b85e-f2f87bb694f8") failed: Property not found. retry in 866.580056ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ed99c029-5334-47b0-b85e-f2f87bb694f8
17022024-12-18T22:13:54.960ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bd8a0397-a96b-4af7-bb62-cac596d73425") failed: Property not found. retry in 891.925485ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bd8a0397-a96b-4af7-bb62-cac596d73425
17032024-12-18T22:13:54.972ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_509b5c7f-9ddc-4e7c-956e-5984acfd38a7") failed: Property not found. retry in 646.347541ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_509b5c7f-9ddc-4e7c-956e-5984acfd38a7
17042024-12-18T22:13:55.019ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_175d3cc8-9a02-4cf3-970c-8ec76a875436") failed: Property not found. retry in 883.73667ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_175d3cc8-9a02-4cf3-970c-8ec76a875436
17052024-12-18T22:13:55.033ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bb3be4a7-c724-4d22-bc17-549855e0c8cd") failed: Property not found. retry in 870.361758ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bb3be4a7-c724-4d22-bc17-549855e0c8cd
17062024-12-18T22:13:55.047ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_218e3da3-c056-4f46-bedf-ff540f2a1d48") failed: Property not found. retry in 575.903784ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_218e3da3-c056-4f46-bedf-ff540f2a1d48
17072024-12-18T22:13:55.061ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_98356a8d-08b0-46fd-8961-c8be5019dba9") failed: Property not found. retry in 521.247158ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_98356a8d-08b0-46fd-8961-c8be5019dba9
17082024-12-18T22:13:55.091ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_387d3af0-07c5-480d-840e-4805c74ee7db") failed: Property not found. retry in 1.322983547s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_387d3af0-07c5-480d-840e-4805c74ee7db
17092024-12-18T22:13:55.133ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_892dfd48-eedc-487a-9abc-a386c4d5781d") failed: Property not found. retry in 639.552157ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_892dfd48-eedc-487a-9abc-a386c4d5781d
17102024-12-18T22:13:55.307ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_864a9415-8555-4a87-a07b-905db0054ab1") failed: Property not found. retry in 1.047397346s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_864a9415-8555-4a87-a07b-905db0054ab1
17112024-12-18T22:13:55.324ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e4f87f5-8c7c-45a2-b576-510817bf70ba") failed: Property not found. retry in 1.227601965s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2e4f87f5-8c7c-45a2-b576-510817bf70ba
17122024-12-18T22:13:55.406ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c0e3d114-075e-41a4-a4df-fa8131bbea97") failed: Property not found. retry in 1.330314239s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c0e3d114-075e-41a4-a4df-fa8131bbea97
17132024-12-18T22:13:55.418ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fbb8f81a-e6a1-4d5a-980c-08bb005aae11") failed: Property not found. retry in 820.529108ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fbb8f81a-e6a1-4d5a-980c-08bb005aae11
17142024-12-18T22:13:55.430ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395") failed: Property not found. retry in 1.304475843s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
17152024-12-18T22:13:55.490ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ed9cf056-3789-49ba-a138-0933a1135c28") failed: Property not found. retry in 1.1837587s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ed9cf056-3789-49ba-a138-0933a1135c28
17162024-12-18T22:13:55.549ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6fd466f3-f0b4-4d40-b657-fd8a20eb0188") failed: Property not found. retry in 687.757417ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6fd466f3-f0b4-4d40-b657-fd8a20eb0188
17172024-12-18T22:13:55.593ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_98356a8d-08b0-46fd-8961-c8be5019dba9") failed: Property not found. retry in 535.323427ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_98356a8d-08b0-46fd-8961-c8be5019dba9
17182024-12-18T22:13:55.631ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_509b5c7f-9ddc-4e7c-956e-5984acfd38a7") failed: Property not found. retry in 1.3811477s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_509b5c7f-9ddc-4e7c-956e-5984acfd38a7
17192024-12-18T22:13:55.643ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_218e3da3-c056-4f46-bedf-ff540f2a1d48") failed: Property not found. retry in 1.425858648s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_218e3da3-c056-4f46-bedf-ff540f2a1d48
17202024-12-18T22:13:55.759ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_160de9b3-61fd-47fd-9883-78dcc7b014f0") failed: Property not found. retry in 1.205257112s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_160de9b3-61fd-47fd-9883-78dcc7b014f0
17212024-12-18T22:13:55.795ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_892dfd48-eedc-487a-9abc-a386c4d5781d") failed: Property not found. retry in 1.257872466s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_892dfd48-eedc-487a-9abc-a386c4d5781d
17222024-12-18T22:13:55.808ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ed99c029-5334-47b0-b85e-f2f87bb694f8") failed: Property not found. retry in 1.105725672s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ed99c029-5334-47b0-b85e-f2f87bb694f8
17232024-12-18T22:13:55.864ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bd8a0397-a96b-4af7-bb62-cac596d73425") failed: Property not found. retry in 1.057549501s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bd8a0397-a96b-4af7-bb62-cac596d73425
17242024-12-18T22:13:55.914ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_175d3cc8-9a02-4cf3-970c-8ec76a875436") failed: Property not found. retry in 788.236221ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_175d3cc8-9a02-4cf3-970c-8ec76a875436
17252024-12-18T22:13:55.929ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bb3be4a7-c724-4d22-bc17-549855e0c8cd") failed: Property not found. retry in 1.211269211s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bb3be4a7-c724-4d22-bc17-549855e0c8cd
17262024-12-18T22:13:56.113ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_05d26e4d-8692-47ee-871b-e645e0477c82") failed: Property not found. retry in 1.456070889s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_05d26e4d-8692-47ee-871b-e645e0477c82
17272024-12-18T22:13:56.148ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_98356a8d-08b0-46fd-8961-c8be5019dba9") failed: Property not found. retry in 751.767088ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_98356a8d-08b0-46fd-8961-c8be5019dba9
17282024-12-18T22:13:56.174ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d0ef80fe-5a3c-4585-be47-819c465c7a37") failed: Property not found. retry in 692.721467ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d0ef80fe-5a3c-4585-be47-819c465c7a37
17292024-12-18T22:13:56.255ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6fd466f3-f0b4-4d40-b657-fd8a20eb0188") failed: Property not found. retry in 673.294127ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6fd466f3-f0b4-4d40-b657-fd8a20eb0188
17302024-12-18T22:13:56.268ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fbb8f81a-e6a1-4d5a-980c-08bb005aae11") failed: Property not found. retry in 683.88515ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fbb8f81a-e6a1-4d5a-980c-08bb005aae11
17312024-12-18T22:13:56.370ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_864a9415-8555-4a87-a07b-905db0054ab1") failed: Property not found. retry in 1.346112823s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_864a9415-8555-4a87-a07b-905db0054ab1
17322024-12-18T22:13:56.432ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_387d3af0-07c5-480d-840e-4805c74ee7db") failed: Property not found. retry in 773.58903ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_387d3af0-07c5-480d-840e-4805c74ee7db
17332024-12-18T22:13:56.569ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e4f87f5-8c7c-45a2-b576-510817bf70ba") failed: Property not found. retry in 1.151490997s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2e4f87f5-8c7c-45a2-b576-510817bf70ba
17342024-12-18T22:13:56.688ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ed9cf056-3789-49ba-a138-0933a1135c28") failed: Property not found. retry in 1.34836848s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ed9cf056-3789-49ba-a138-0933a1135c28
17352024-12-18T22:13:56.719ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_175d3cc8-9a02-4cf3-970c-8ec76a875436") failed: Property not found. retry in 1.235621839s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_175d3cc8-9a02-4cf3-970c-8ec76a875436
17362024-12-18T22:13:56.750ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395") failed: Property not found. retry in 1.284659243s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
17372024-12-18T22:13:56.767ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c0e3d114-075e-41a4-a4df-fa8131bbea97") failed: Property not found. retry in 1.019661684s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c0e3d114-075e-41a4-a4df-fa8131bbea97
17382024-12-18T22:13:56.881ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d0ef80fe-5a3c-4585-be47-819c465c7a37") failed: Property not found. retry in 1.236152262s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d0ef80fe-5a3c-4585-be47-819c465c7a37
17392024-12-18T22:13:56.916ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_98356a8d-08b0-46fd-8961-c8be5019dba9") failed: Property not found. retry in 672.245838ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_98356a8d-08b0-46fd-8961-c8be5019dba9
17402024-12-18T22:13:56.929ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ed99c029-5334-47b0-b85e-f2f87bb694f8") failed: Property not found. retry in 565.577581ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ed99c029-5334-47b0-b85e-f2f87bb694f8
17412024-12-18T22:13:56.941ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6fd466f3-f0b4-4d40-b657-fd8a20eb0188") failed: Property not found. retry in 1.007013362s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6fd466f3-f0b4-4d40-b657-fd8a20eb0188
17422024-12-18T22:13:56.953ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bd8a0397-a96b-4af7-bb62-cac596d73425") failed: Property not found. retry in 1.233679007s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bd8a0397-a96b-4af7-bb62-cac596d73425
17432024-12-18T22:13:56.962ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fbb8f81a-e6a1-4d5a-980c-08bb005aae11") failed: Property not found. retry in 526.233071ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fbb8f81a-e6a1-4d5a-980c-08bb005aae11
17442024-12-18T22:13:56.976ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_160de9b3-61fd-47fd-9883-78dcc7b014f0") failed: Property not found. retry in 681.863149ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_160de9b3-61fd-47fd-9883-78dcc7b014f0
17452024-12-18T22:13:57.025ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_509b5c7f-9ddc-4e7c-956e-5984acfd38a7") failed: Property not found. retry in 760.433162ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_509b5c7f-9ddc-4e7c-956e-5984acfd38a7
17462024-12-18T22:13:57.065ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_892dfd48-eedc-487a-9abc-a386c4d5781d") failed: Property not found. retry in 976.779968ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_892dfd48-eedc-487a-9abc-a386c4d5781d
17472024-12-18T22:13:57.081ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_218e3da3-c056-4f46-bedf-ff540f2a1d48") failed: Property not found. retry in 537.411355ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_218e3da3-c056-4f46-bedf-ff540f2a1d48
17482024-12-18T22:13:57.153ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bb3be4a7-c724-4d22-bc17-549855e0c8cd") failed: Property not found. retry in 986.913673ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bb3be4a7-c724-4d22-bc17-549855e0c8cd
17492024-12-18T22:13:57.217ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_387d3af0-07c5-480d-840e-4805c74ee7db") failed: Property not found. retry in 719.644001ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_387d3af0-07c5-480d-840e-4805c74ee7db
17502024-12-18T22:13:57.502ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fbb8f81a-e6a1-4d5a-980c-08bb005aae11") failed: Property not found. retry in 1.490339147s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fbb8f81a-e6a1-4d5a-980c-08bb005aae11
17512024-12-18T22:13:57.514ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ed99c029-5334-47b0-b85e-f2f87bb694f8") failed: Property not found. retry in 1.252112939s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ed99c029-5334-47b0-b85e-f2f87bb694f8
17522024-12-18T22:13:57.581ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_05d26e4d-8692-47ee-871b-e645e0477c82") failed: Property not found. retry in 882.579952ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_05d26e4d-8692-47ee-871b-e645e0477c82
17532024-12-18T22:13:57.598ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_98356a8d-08b0-46fd-8961-c8be5019dba9") failed: Property not found. retry in 713.705549ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_98356a8d-08b0-46fd-8961-c8be5019dba9
17542024-12-18T22:13:57.631ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_218e3da3-c056-4f46-bedf-ff540f2a1d48") failed: Property not found. retry in 500.09621ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_218e3da3-c056-4f46-bedf-ff540f2a1d48
17552024-12-18T22:13:57.658ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 43.50549287s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
17562024-12-18T22:13:57.669ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_160de9b3-61fd-47fd-9883-78dcc7b014f0") failed: Property not found. retry in 1.342214512s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_160de9b3-61fd-47fd-9883-78dcc7b014f0
17572024-12-18T22:13:57.729ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_864a9415-8555-4a87-a07b-905db0054ab1") failed: Property not found. retry in 1.464642753s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_864a9415-8555-4a87-a07b-905db0054ab1
17582024-12-18T22:13:57.739ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e4f87f5-8c7c-45a2-b576-510817bf70ba") failed: Property not found. retry in 774.777277ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2e4f87f5-8c7c-45a2-b576-510817bf70ba
17592024-12-18T22:13:57.801ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_509b5c7f-9ddc-4e7c-956e-5984acfd38a7") failed: Property not found. retry in 1.499948882s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_509b5c7f-9ddc-4e7c-956e-5984acfd38a7
17602024-12-18T22:13:57.814ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c0e3d114-075e-41a4-a4df-fa8131bbea97") failed: Property not found. retry in 1.399075918s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c0e3d114-075e-41a4-a4df-fa8131bbea97
17612024-12-18T22:13:57.952ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_387d3af0-07c5-480d-840e-4805c74ee7db") failed: Property not found. retry in 749.703715ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_387d3af0-07c5-480d-840e-4805c74ee7db
17622024-12-18T22:13:57.965ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6fd466f3-f0b4-4d40-b657-fd8a20eb0188") failed: Property not found. retry in 1.188623288s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6fd466f3-f0b4-4d40-b657-fd8a20eb0188
17632024-12-18T22:13:57.976ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_175d3cc8-9a02-4cf3-970c-8ec76a875436") failed: Property not found. retry in 1.474672443s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_175d3cc8-9a02-4cf3-970c-8ec76a875436
17642024-12-18T22:13:58.049ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395") failed: Property not found. retry in 997.37048ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
17652024-12-18T22:13:58.063ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_892dfd48-eedc-487a-9abc-a386c4d5781d") failed: Property not found. retry in 742.908575ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_892dfd48-eedc-487a-9abc-a386c4d5781d
17662024-12-18T22:13:58.073ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ed9cf056-3789-49ba-a138-0933a1135c28") failed: Property not found. retry in 1.34887696s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ed9cf056-3789-49ba-a138-0933a1135c28
17672024-12-18T22:13:58.130ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d0ef80fe-5a3c-4585-be47-819c465c7a37") failed: Property not found. retry in 1.203622894s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d0ef80fe-5a3c-4585-be47-819c465c7a37
17682024-12-18T22:13:58.146ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_218e3da3-c056-4f46-bedf-ff540f2a1d48") failed: Property not found. retry in 1.259372701s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_218e3da3-c056-4f46-bedf-ff540f2a1d48
17692024-12-18T22:13:58.162ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bb3be4a7-c724-4d22-bc17-549855e0c8cd") failed: Property not found. retry in 1.162120747s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bb3be4a7-c724-4d22-bc17-549855e0c8cd
17702024-12-18T22:13:58.198ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bd8a0397-a96b-4af7-bb62-cac596d73425") failed: Property not found. retry in 848.284178ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bd8a0397-a96b-4af7-bb62-cac596d73425
17712024-12-18T22:13:58.325ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_98356a8d-08b0-46fd-8961-c8be5019dba9") failed: Property not found. retry in 701.55903ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_98356a8d-08b0-46fd-8961-c8be5019dba9
17722024-12-18T22:13:58.480ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_05d26e4d-8692-47ee-871b-e645e0477c82") failed: Property not found. retry in 908.808358ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_05d26e4d-8692-47ee-871b-e645e0477c82
17732024-12-18T22:13:58.526ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e4f87f5-8c7c-45a2-b576-510817bf70ba") failed: Property not found. retry in 732.088733ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2e4f87f5-8c7c-45a2-b576-510817bf70ba
17742024-12-18T22:13:58.715ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_387d3af0-07c5-480d-840e-4805c74ee7db") failed: Property not found. retry in 1.073717525s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_387d3af0-07c5-480d-840e-4805c74ee7db
17752024-12-18T22:13:58.780ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ed99c029-5334-47b0-b85e-f2f87bb694f8") failed: Property not found. retry in 1.362568405s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ed99c029-5334-47b0-b85e-f2f87bb694f8
17762024-12-18T22:13:58.818ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_892dfd48-eedc-487a-9abc-a386c4d5781d") failed: Property not found. retry in 1.329306974s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_892dfd48-eedc-487a-9abc-a386c4d5781d
17772024-12-18T22:13:59.008ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fbb8f81a-e6a1-4d5a-980c-08bb005aae11") failed: Property not found. retry in 608.381157ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fbb8f81a-e6a1-4d5a-980c-08bb005aae11
17782024-12-18T22:13:59.027ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_160de9b3-61fd-47fd-9883-78dcc7b014f0") failed: Property not found. retry in 1.09100882s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_160de9b3-61fd-47fd-9883-78dcc7b014f0
17792024-12-18T22:13:59.041ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_98356a8d-08b0-46fd-8961-c8be5019dba9") failed: Property not found. retry in 782.376086ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_98356a8d-08b0-46fd-8961-c8be5019dba9
17802024-12-18T22:13:59.057ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395") failed: Property not found. retry in 1.156640913s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
17812024-12-18T22:13:59.068ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bd8a0397-a96b-4af7-bb62-cac596d73425") failed: Property not found. retry in 850.810392ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bd8a0397-a96b-4af7-bb62-cac596d73425
17822024-12-18T22:13:59.167ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6fd466f3-f0b4-4d40-b657-fd8a20eb0188") failed: Property not found. retry in 532.796376ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6fd466f3-f0b4-4d40-b657-fd8a20eb0188
17832024-12-18T22:13:59.205ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_864a9415-8555-4a87-a07b-905db0054ab1") failed: Property not found. retry in 848.946874ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_864a9415-8555-4a87-a07b-905db0054ab1
17842024-12-18T22:13:59.225ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c0e3d114-075e-41a4-a4df-fa8131bbea97") failed: Property not found. retry in 656.511554ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c0e3d114-075e-41a4-a4df-fa8131bbea97
17852024-12-18T22:13:59.280ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e4f87f5-8c7c-45a2-b576-510817bf70ba") failed: Property not found. retry in 639.854479ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2e4f87f5-8c7c-45a2-b576-510817bf70ba
17862024-12-18T22:13:59.314ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_509b5c7f-9ddc-4e7c-956e-5984acfd38a7") failed: Property not found. retry in 632.902627ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_509b5c7f-9ddc-4e7c-956e-5984acfd38a7
17872024-12-18T22:13:59.337ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bb3be4a7-c724-4d22-bc17-549855e0c8cd") failed: Property not found. retry in 841.997595ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bb3be4a7-c724-4d22-bc17-549855e0c8cd
17882024-12-18T22:13:59.349ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d0ef80fe-5a3c-4585-be47-819c465c7a37") failed: Property not found. retry in 956.691243ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d0ef80fe-5a3c-4585-be47-819c465c7a37
17892024-12-18T22:13:59.400ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_05d26e4d-8692-47ee-871b-e645e0477c82") failed: Property not found. retry in 569.144674ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_05d26e4d-8692-47ee-871b-e645e0477c82
17902024-12-18T22:13:59.418ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_218e3da3-c056-4f46-bedf-ff540f2a1d48") failed: Property not found. retry in 927.240354ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_218e3da3-c056-4f46-bedf-ff540f2a1d48
17912024-12-18T22:13:59.436ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ed9cf056-3789-49ba-a138-0933a1135c28") failed: Property not found. retry in 726.373212ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ed9cf056-3789-49ba-a138-0933a1135c28
17922024-12-18T22:13:59.466ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_175d3cc8-9a02-4cf3-970c-8ec76a875436") failed: Property not found. retry in 771.817391ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_175d3cc8-9a02-4cf3-970c-8ec76a875436
17932024-12-18T22:13:59.629ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fbb8f81a-e6a1-4d5a-980c-08bb005aae11") failed: Property not found. retry in 1.483538177s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fbb8f81a-e6a1-4d5a-980c-08bb005aae11
17942024-12-18T22:13:59.711ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6fd466f3-f0b4-4d40-b657-fd8a20eb0188") failed: Property not found. retry in 1.475987123s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6fd466f3-f0b4-4d40-b657-fd8a20eb0188
17952024-12-18T22:13:59.801ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_387d3af0-07c5-480d-840e-4805c74ee7db") failed: Property not found. retry in 956.783559ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_387d3af0-07c5-480d-840e-4805c74ee7db
17962024-12-18T22:13:59.835ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_98356a8d-08b0-46fd-8961-c8be5019dba9") failed: Property not found. retry in 1.335540843s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_98356a8d-08b0-46fd-8961-c8be5019dba9
17972024-12-18T22:13:59.893ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c0e3d114-075e-41a4-a4df-fa8131bbea97") failed: Property not found. retry in 1.167055367s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c0e3d114-075e-41a4-a4df-fa8131bbea97
17982024-12-18T22:13:59.931ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bd8a0397-a96b-4af7-bb62-cac596d73425") failed: Property not found. retry in 1.337328026s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bd8a0397-a96b-4af7-bb62-cac596d73425
17992024-12-18T22:13:59.942ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e4f87f5-8c7c-45a2-b576-510817bf70ba") failed: Property not found. retry in 856.631148ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2e4f87f5-8c7c-45a2-b576-510817bf70ba
18002024-12-18T22:13:59.958ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_509b5c7f-9ddc-4e7c-956e-5984acfd38a7") failed: Property not found. retry in 1.150396341s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_509b5c7f-9ddc-4e7c-956e-5984acfd38a7
18012024-12-18T22:13:59.978ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_05d26e4d-8692-47ee-871b-e645e0477c82") failed: Property not found. retry in 809.12645ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_05d26e4d-8692-47ee-871b-e645e0477c82
18022024-12-18T22:14:00.064ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_864a9415-8555-4a87-a07b-905db0054ab1") failed: Property not found. retry in 1.149152046s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_864a9415-8555-4a87-a07b-905db0054ab1
18032024-12-18T22:14:00.130ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_160de9b3-61fd-47fd-9883-78dcc7b014f0") failed: Property not found. retry in 1.13617454s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_160de9b3-61fd-47fd-9883-78dcc7b014f0
18042024-12-18T22:14:00.154ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ed99c029-5334-47b0-b85e-f2f87bb694f8") failed: Property not found. retry in 697.860097ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ed99c029-5334-47b0-b85e-f2f87bb694f8
18052024-12-18T22:14:00.163ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_892dfd48-eedc-487a-9abc-a386c4d5781d") failed: Property not found. retry in 982.494189ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_892dfd48-eedc-487a-9abc-a386c4d5781d
18062024-12-18T22:14:00.172ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ed9cf056-3789-49ba-a138-0933a1135c28") failed: Property not found. retry in 1.150443505s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ed9cf056-3789-49ba-a138-0933a1135c28
18072024-12-18T22:14:00.229ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395") failed: Property not found. retry in 824.896213ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
18082024-12-18T22:14:00.248ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_175d3cc8-9a02-4cf3-970c-8ec76a875436") failed: Property not found. retry in 600.307483ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_175d3cc8-9a02-4cf3-970c-8ec76a875436
18092024-12-18T22:14:00.317ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d0ef80fe-5a3c-4585-be47-819c465c7a37") failed: Property not found. retry in 972.754226ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d0ef80fe-5a3c-4585-be47-819c465c7a37
18102024-12-18T22:14:00.356ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_218e3da3-c056-4f46-bedf-ff540f2a1d48") failed: Property not found. retry in 1.21261017s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_218e3da3-c056-4f46-bedf-ff540f2a1d48
18112024-12-18T22:14:00.768ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_387d3af0-07c5-480d-840e-4805c74ee7db") failed: Property not found. retry in 548.687579ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_387d3af0-07c5-480d-840e-4805c74ee7db
18122024-12-18T22:14:00.806ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_05d26e4d-8692-47ee-871b-e645e0477c82") failed: Property not found. retry in 997.959749ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_05d26e4d-8692-47ee-871b-e645e0477c82
18132024-12-18T22:14:00.818ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e4f87f5-8c7c-45a2-b576-510817bf70ba") failed: Property not found. retry in 534.853762ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2e4f87f5-8c7c-45a2-b576-510817bf70ba
18142024-12-18T22:14:00.858ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_175d3cc8-9a02-4cf3-970c-8ec76a875436") failed: Property not found. retry in 1.278216564s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_175d3cc8-9a02-4cf3-970c-8ec76a875436
18152024-12-18T22:14:00.867ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ed99c029-5334-47b0-b85e-f2f87bb694f8") failed: Property not found. retry in 535.901831ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ed99c029-5334-47b0-b85e-f2f87bb694f8
18162024-12-18T22:14:01.066ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395") failed: Property not found. retry in 638.242161ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
18172024-12-18T22:14:01.078ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c0e3d114-075e-41a4-a4df-fa8131bbea97") failed: Property not found. retry in 1.497561516s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c0e3d114-075e-41a4-a4df-fa8131bbea97
18182024-12-18T22:14:01.120ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_509b5c7f-9ddc-4e7c-956e-5984acfd38a7") failed: Property not found. retry in 712.320085ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_509b5c7f-9ddc-4e7c-956e-5984acfd38a7
18192024-12-18T22:14:01.160ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_892dfd48-eedc-487a-9abc-a386c4d5781d") failed: Property not found. retry in 879.531425ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_892dfd48-eedc-487a-9abc-a386c4d5781d
18202024-12-18T22:14:01.181ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_98356a8d-08b0-46fd-8961-c8be5019dba9") failed: Property not found. retry in 550.995696ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_98356a8d-08b0-46fd-8961-c8be5019dba9
18212024-12-18T22:14:01.223ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_864a9415-8555-4a87-a07b-905db0054ab1") failed: Property not found. retry in 1.486650869s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_864a9415-8555-4a87-a07b-905db0054ab1
18222024-12-18T22:14:01.279ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_160de9b3-61fd-47fd-9883-78dcc7b014f0") failed: Property not found. retry in 968.298267ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_160de9b3-61fd-47fd-9883-78dcc7b014f0
18232024-12-18T22:14:01.291ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bd8a0397-a96b-4af7-bb62-cac596d73425") failed: Property not found. retry in 691.880917ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bd8a0397-a96b-4af7-bb62-cac596d73425
18242024-12-18T22:14:01.327ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_387d3af0-07c5-480d-840e-4805c74ee7db") failed: Property not found. retry in 650.360592ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_387d3af0-07c5-480d-840e-4805c74ee7db
18252024-12-18T22:14:01.366ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e4f87f5-8c7c-45a2-b576-510817bf70ba") failed: Property not found. retry in 911.490745ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2e4f87f5-8c7c-45a2-b576-510817bf70ba
18262024-12-18T22:14:01.414ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ed99c029-5334-47b0-b85e-f2f87bb694f8") failed: Property not found. retry in 1.271957302s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ed99c029-5334-47b0-b85e-f2f87bb694f8
18272024-12-18T22:14:01.580ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_218e3da3-c056-4f46-bedf-ff540f2a1d48") failed: Property not found. retry in 969.09069ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_218e3da3-c056-4f46-bedf-ff540f2a1d48
18282024-12-18T22:14:01.721ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395") failed: Property not found. retry in 1.398706422s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
18292024-12-18T22:14:01.748ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_98356a8d-08b0-46fd-8961-c8be5019dba9") failed: Property not found. retry in 1.134388046s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_98356a8d-08b0-46fd-8961-c8be5019dba9
18302024-12-18T22:14:03.166ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_864a9415-8555-4a87-a07b-905db0054ab1
18312024-12-18T22:14:03.166ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_fbb8f81a-e6a1-4d5a-980c-08bb005aae11
18322024-12-18T22:14:03.166ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_218e3da3-c056-4f46-bedf-ff540f2a1d48
18332024-12-18T22:14:03.166ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_nexus_175d3cc8-9a02-4cf3-970c-8ec76a875436
18342024-12-18T22:14:03.166ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_nexus_9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
18352024-12-18T22:14:03.166ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_892dfd48-eedc-487a-9abc-a386c4d5781d
18362024-12-18T22:14:03.166ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_pantry_05d26e4d-8692-47ee-871b-e645e0477c82
18372024-12-18T22:14:03.166ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_2e4f87f5-8c7c-45a2-b576-510817bf70ba
18382024-12-18T22:14:03.166ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_oximeter_6fd466f3-f0b4-4d40-b657-fd8a20eb0188
18392024-12-18T22:14:03.166ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_pantry_ed9cf056-3789-49ba-a138-0933a1135c28
18402024-12-18T22:14:03.166ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_bd8a0397-a96b-4af7-bb62-cac596d73425
18412024-12-18T22:14:03.166ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_external_dns_d0ef80fe-5a3c-4585-be47-819c465c7a37
18422024-12-18T22:14:03.166ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_external_dns_160de9b3-61fd-47fd-9883-78dcc7b014f0
18432024-12-18T22:14:03.166ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_nexus_c0e3d114-075e-41a4-a4df-fa8131bbea97
18442024-12-18T22:14:03.166ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_clickhouse_98356a8d-08b0-46fd-8961-c8be5019dba9
18452024-12-18T22:14:03.166ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_387d3af0-07c5-480d-840e-4805c74ee7db
18462024-12-18T22:14:03.166ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_bb3be4a7-c724-4d22-bc17-549855e0c8cd
18472024-12-18T22:14:03.166ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_pantry_509b5c7f-9ddc-4e7c-956e-5984acfd38a7
18482024-12-18T22:14:03.166ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_ed99c029-5334-47b0-b85e-f2f87bb694f8
18492024-12-18T22:14:03.167ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/f4e49932-892e-4e15-afe7-919d71bd3012/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
18502024-12-18T22:14:03.173ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/de0dd618-e464-453d-9394-6cb21d5dbefa/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
18512024-12-18T22:14:03.177ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36592272 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:38196 req_id = 4b0b82ed-124d-4aee-864e-ea3a4d1beda0 response_code = 204 uri = /omicron-zones
18522024-12-18T22:14:03.199ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1415
18532024-12-18T22:14:03.405ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:790
18542024-12-18T22:14:03.411ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::a]:12221 file = sled-agent/src/rack_setup/service.rs:802
18552024-12-18T22:14:03.462ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, rib_priority: None, vlan_id: None, }, ], switch: Switch0, tx_eq: None, uplink_port_fec: Some( None, ), uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:1016
18562024-12-18T22:14:06.855ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/cb51312e-7ab9-47f9-9ff4-bd0991c68cd7/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
18572024-12-18T22:14:06.934ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/cb51312e-7ab9-47f9-9ff4-bd0991c68cd7/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
18582024-12-18T22:14:07.090ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/cb51312e-7ab9-47f9-9ff4-bd0991c68cd7/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
18592024-12-18T22:14:07.225ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/cb51312e-7ab9-47f9-9ff4-bd0991c68cd7/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
18602024-12-18T22:14:07.318ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/cb51312e-7ab9-47f9-9ff4-bd0991c68cd7/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
18612024-12-18T22:14:07.433ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/cb51312e-7ab9-47f9-9ff4-bd0991c68cd7/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
18622024-12-18T22:14:07.663ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/cb51312e-7ab9-47f9-9ff4-bd0991c68cd7/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
18632024-12-18T22:14:07.919ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/cb51312e-7ab9-47f9-9ff4-bd0991c68cd7/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
18642024-12-18T22:14:08.236ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/cb51312e-7ab9-47f9-9ff4-bd0991c68cd7/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
18652024-12-18T22:14:08.749ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/cb51312e-7ab9-47f9-9ff4-bd0991c68cd7/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
18662024-12-18T22:14:09.196ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/cb51312e-7ab9-47f9-9ff4-bd0991c68cd7/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
18672024-12-18T22:14:09.986ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/cb51312e-7ab9-47f9-9ff4-bd0991c68cd7/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
18682024-12-18T22:14:10.499ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/cb51312e-7ab9-47f9-9ff4-bd0991c68cd7/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
18692024-12-18T22:14:12.060ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "df21bcac-1162-4575-8432-37f29712359e", "content-length": "173", "date": "Wed, 18 Dec 2024 22:14:11 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"cb51312e-7ab9-47f9-9ff4-bd0991c68cd7\"", request_id: "df21bcac-1162-4575-8432-37f29712359e" } file = sled-agent/src/rack_setup/service.rs:1078
18702024-12-18T22:14:13.118ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "485d5a9c-c549-44d8-9cc9-5fbc65bd3211", "content-length": "173", "date": "Wed, 18 Dec 2024 22:14:13 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"cb51312e-7ab9-47f9-9ff4-bd0991c68cd7\"", request_id: "485d5a9c-c549-44d8-9cc9-5fbc65bd3211" } file = sled-agent/src/rack_setup/service.rs:1078
18712024-12-18T22:14:14.597ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "bf36a793-dd39-4c5e-8f16-00ea98ded569", "content-length": "173", "date": "Wed, 18 Dec 2024 22:14:13 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"44b7e384-368a-4bb9-a5b4-e1c12506ebd3\"", request_id: "bf36a793-dd39-4c5e-8f16-00ea98ded569" } file = sled-agent/src/rack_setup/service.rs:1078
18722024-12-18T22:14:16.581ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:39693
18732024-12-18T22:14:16.581ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:39693 req_id = 561de7f3-9a1b-4ec4-aead-46f43b1a7476 response_code = 200 uri = /baseboard
18742024-12-18T22:14:16.995ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "19d06408-57db-4d4c-8308-3f8c9ed5a352", "content-length": "173", "date": "Wed, 18 Dec 2024 22:14:16 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"44b7e384-368a-4bb9-a5b4-e1c12506ebd3\"", request_id: "19d06408-57db-4d4c-8308-3f8c9ed5a352" } file = sled-agent/src/rack_setup/service.rs:1078
18752024-12-18T22:14:18.810ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "4cf5f394-6b40-45af-b4a3-63ce1992bec1", "content-length": "173", "date": "Wed, 18 Dec 2024 22:14:18 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"44b7e384-368a-4bb9-a5b4-e1c12506ebd3\"", request_id: "4cf5f394-6b40-45af-b4a3-63ce1992bec1" } file = sled-agent/src/rack_setup/service.rs:1078
18762024-12-18T22:14:21.423ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "2f811a75-3aa8-434d-809f-bccd41b5fbab", "content-length": "173", "date": "Wed, 18 Dec 2024 22:14:21 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"44b7e384-368a-4bb9-a5b4-e1c12506ebd3\"", request_id: "2f811a75-3aa8-434d-809f-bccd41b5fbab" } file = sled-agent/src/rack_setup/service.rs:1078
18772024-12-18T22:14:23.938ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "6dcc587d-8533-44f8-92dc-ea10f5e75f94", "content-length": "173", "date": "Wed, 18 Dec 2024 22:14:23 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"44b7e384-368a-4bb9-a5b4-e1c12506ebd3\"", request_id: "6dcc587d-8533-44f8-92dc-ea10f5e75f94" } file = sled-agent/src/rack_setup/service.rs:1078
18782024-12-18T22:14:29.101ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "8bc91e54-aabb-400d-ab0d-b69e38f47c4a", "content-length": "173", "date": "Wed, 18 Dec 2024 22:14:29 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"44b7e384-368a-4bb9-a5b4-e1c12506ebd3\"", request_id: "8bc91e54-aabb-400d-ab0d-b69e38f47c4a" } file = sled-agent/src/rack_setup/service.rs:1078
18792024-12-18T22:14:34.311ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "ccfb682d-a44b-4bc9-ad0e-1a50a6d56e61", "content-length": "173", "date": "Wed, 18 Dec 2024 22:14:34 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"44b7e384-368a-4bb9-a5b4-e1c12506ebd3\"", request_id: "ccfb682d-a44b-4bc9-ad0e-1a50a6d56e61" } file = sled-agent/src/rack_setup/service.rs:1078
18802024-12-18T22:14:38.697ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "e290201b-7eeb-4d5c-9762-4d77512488b5", "content-length": "173", "date": "Wed, 18 Dec 2024 22:14:38 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"44b7e384-368a-4bb9-a5b4-e1c12506ebd3\"", request_id: "e290201b-7eeb-4d5c-9762-4d77512488b5" } file = sled-agent/src/rack_setup/service.rs:1078
18812024-12-18T22:14:41.724ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:500 new_generation = 1 old_generation = 1 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
18822024-12-18T22:14:41.816ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40308
18832024-12-18T22:14:41.819ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:608
18842024-12-18T22:14:41.819ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:608
18852024-12-18T22:14:41.819ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/f4e49932-892e-4e15-afe7-919d71bd3012/config/omicron-zones.json file = common/src/ledger.rs:177
18862024-12-18T22:14:41.820ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/de0dd618-e464-453d-9394-6cb21d5dbefa/config/omicron-zones.json file = common/src/ledger.rs:177
18872024-12-18T22:14:41.831ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7527a580-440a-4d33-b9e5-9f4ac1126696 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:608
18882024-12-18T22:14:41.831ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1119 request = datasets_list zpool = oxp_7527a580-440a-4d33-b9e5-9f4ac1126696
18892024-12-18T22:14:41.854ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8d122e51-f03c-4659-8af4-3a5baca809c5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:608
18902024-12-18T22:14:41.854ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1119 request = datasets_list zpool = oxp_8d122e51-f03c-4659-8af4-3a5baca809c5
18912024-12-18T22:14:41.877ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ebfff57f-9cb4-47bd-acd3-b83eb13e21b5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:608
18922024-12-18T22:14:41.877ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1119 request = datasets_list zpool = oxp_ebfff57f-9cb4-47bd-acd3-b83eb13e21b5
18932024-12-18T22:14:41.899ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d7b58ec6-9f7e-464f-b0dc-a0d484ac88ac (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:608
18942024-12-18T22:14:41.899ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1119 request = datasets_list zpool = oxp_d7b58ec6-9f7e-464f-b0dc-a0d484ac88ac
18952024-12-18T22:14:41.919ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ad207096-a29a-4bc7-b04f-7cf8a526e7ae (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:608
18962024-12-18T22:14:41.919ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1119 request = datasets_list zpool = oxp_ad207096-a29a-4bc7-b04f-7cf8a526e7ae
18972024-12-18T22:14:41.939ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a952a3c4-f4b2-4c9a-a310-fb464cba0cce (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:608
18982024-12-18T22:14:41.939ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1119 request = datasets_list zpool = oxp_a952a3c4-f4b2-4c9a-a310-fb464cba0cce
18992024-12-18T22:14:41.959ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 45dbe21c-5eaa-4707-b822-d1348b4d8afc (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:608
19002024-12-18T22:14:41.959ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1119 request = datasets_list zpool = oxp_45dbe21c-5eaa-4707-b822-d1348b4d8afc
19012024-12-18T22:14:41.979ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 378b1d3c-0145-41bf-ab1f-16bc3c7930e7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:608
19022024-12-18T22:14:41.979ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1119 request = datasets_list zpool = oxp_378b1d3c-0145-41bf-ab1f-16bc3c7930e7
19032024-12-18T22:14:41.998ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4bf1df73-f4b5-4c23-85b8-9b365d6ea8ae (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:608
19042024-12-18T22:14:41.998ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1119 request = datasets_list zpool = oxp_4bf1df73-f4b5-4c23-85b8-9b365d6ea8ae
19052024-12-18T22:14:42.010ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 194341 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40308 req_id = 9760cb87-07bc-475c-8ff8-e88a1756e509 response_code = 200 uri = /inventory
19062024-12-18T22:14:42.916ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58151
19072024-12-18T22:14:42.917ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 681 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58151 req_id = ceb91fad-998b-4aed-b3ba-eac64d60962e response_code = 200 uri = /vpc-routes
19082024-12-18T22:14:42.933ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51753
19092024-12-18T22:14:42.933ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 26 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51753 req_id = 7b6c173b-91e2-4a67-9842-d4719f5750d0 response_code = 200 uri = /vpc-routes
19102024-12-18T22:14:42.948ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 values = ExternalIpGatewayMap { mappings: {} }
19112024-12-18T22:14:42.948ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1319 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58151 req_id = 8d7b6780-c042-4f46-9076-54a1ad54c562 response_code = 204 uri = /eip-gateways
19122024-12-18T22:14:42.957ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35561
19132024-12-18T22:14:42.958ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 368 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35561 req_id = 3035f938-71e6-42cb-aff4-be5d52c229e0 response_code = 200 uri = /v2p
19142024-12-18T22:14:42.977ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 values = ExternalIpGatewayMap { mappings: {} }
19152024-12-18T22:14:42.977ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 28 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51753 req_id = a780481b-0e05-4ee8-b64f-6ba7e67bc4cb response_code = 204 uri = /eip-gateways
19162024-12-18T22:14:43.032ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46975
19172024-12-18T22:14:43.032ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46975 req_id = 7754f883-63a3-4feb-b787-63ad156fb001 response_code = 200 uri = /v2p
19182024-12-18T22:14:43.077ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3847 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58151 req_id = ef02af46-145f-40d5-a200-218ed2a9dd98 response_code = 204 uri = /vpc-routes
19192024-12-18T22:14:43.078ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:486 new_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 4 } old_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 4 } subnet = RouterId { vni: Vni(100), kind: System }
19202024-12-18T22:14:43.078ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51753 req_id = 66e0f298-2bf1-4953-9af6-d0181724fa1a response_code = 204 uri = /vpc-routes
19212024-12-18T22:14:43.947ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51923
19222024-12-18T22:14:43.947ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51923 req_id = ece99a25-fac2-44bf-ab30-caae52e0f66f response_code = 200 uri = /vpc-routes
19232024-12-18T22:14:43.994ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 values = ExternalIpGatewayMap { mappings: {} }
19242024-12-18T22:14:43.994ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51923 req_id = f05b21f3-697f-41b0-8f97-471de5bdbce1 response_code = 204 uri = /eip-gateways
19252024-12-18T22:14:44.003ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 217 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51923 req_id = f1deeea9-8179-48a9-8434-185d7e892189 response_code = 204 uri = /vpc-routes
19262024-12-18T22:14:44.016ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47032
19272024-12-18T22:14:44.016ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47032 req_id = 3f6bc164-130f-4848-89cc-9e51e8445679 response_code = 200 uri = /v2p
19282024-12-18T22:14:46.583ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43845
19292024-12-18T22:14:46.584ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 104d2c5b-1a03-416e-83a1-9840a7797640, kind: Service { id: d0ef80fe-5a3c-4585-be47-819c465c7a37 }, name: Name("external-dns-d0ef80fe-5a3c-4585-be47-819c465c7a37"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 188, 248])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 607e1df6-370f-4c69-a01b-1dec075c60ae, kind: Service { id: 160de9b3-61fd-47fd-9883-78dcc7b014f0 }, name: Name("external-dns-160de9b3-61fd-47fd-9883-78dcc7b014f0"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 132, 76])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0bab2332-a525-46aa-9d7e-fb4af64f3c88, kind: Service { id: 9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395 }, name: Name("nexus-9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 211, 86])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: af14a7c6-4009-42e7-b00a-57c5ae0399bb, kind: Service { id: 175d3cc8-9a02-4cf3-970c-8ec76a875436 }, name: Name("nexus-175d3cc8-9a02-4cf3-970c-8ec76a875436"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 135, 206])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d048e606-7b77-4cdc-951d-7050040ab8d1, kind: Service { id: c0e3d114-075e-41a4-a4df-fa8131bbea97 }, name: Name("nexus-c0e3d114-075e-41a4-a4df-fa8131bbea97"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 155, 145])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
19302024-12-18T22:14:46.584ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19312024-12-18T22:14:46.584ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19322024-12-18T22:14:46.584ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
19332024-12-18T22:14:46.584ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19342024-12-18T22:14:46.584ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19352024-12-18T22:14:46.584ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19362024-12-18T22:14:46.584ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1123 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43845 req_id = b14c1583-4d17-4e6c-859a-f58ac0b2bef6 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
19372024-12-18T22:14:46.585ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:1088
19382024-12-18T22:14:46.590ZINFOSledAgent (RSS): Writing ledger to /pool/int/f4e49932-892e-4e15-afe7-919d71bd3012/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
19392024-12-18T22:14:46.590ZINFOSledAgent (RSS): Writing ledger to /pool/int/de0dd618-e464-453d-9394-6cb21d5dbefa/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
19402024-12-18T22:14:46.614ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45137
19412024-12-18T22:14:46.614ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45137 req_id = 099a41a7-6c48-403d-8697-51cda8e4ae6f response_code = 200 uri = /baseboard
19422024-12-18T22:14:46.886ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47107
19432024-12-18T22:14:46.886ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:608
19442024-12-18T22:14:46.886ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:608
19452024-12-18T22:14:46.886ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/f4e49932-892e-4e15-afe7-919d71bd3012/config/omicron-zones.json file = common/src/ledger.rs:177
19462024-12-18T22:14:46.886ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/de0dd618-e464-453d-9394-6cb21d5dbefa/config/omicron-zones.json file = common/src/ledger.rs:177
19472024-12-18T22:14:46.898ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7527a580-440a-4d33-b9e5-9f4ac1126696 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:608
19482024-12-18T22:14:46.898ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1119 request = datasets_list zpool = oxp_7527a580-440a-4d33-b9e5-9f4ac1126696
19492024-12-18T22:14:46.922ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8d122e51-f03c-4659-8af4-3a5baca809c5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:608
19502024-12-18T22:14:46.923ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1119 request = datasets_list zpool = oxp_8d122e51-f03c-4659-8af4-3a5baca809c5
19512024-12-18T22:14:46.945ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ebfff57f-9cb4-47bd-acd3-b83eb13e21b5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:608
19522024-12-18T22:14:46.945ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1119 request = datasets_list zpool = oxp_ebfff57f-9cb4-47bd-acd3-b83eb13e21b5
19532024-12-18T22:14:46.968ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d7b58ec6-9f7e-464f-b0dc-a0d484ac88ac (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:608
19542024-12-18T22:14:46.968ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1119 request = datasets_list zpool = oxp_d7b58ec6-9f7e-464f-b0dc-a0d484ac88ac
19552024-12-18T22:14:46.988ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ad207096-a29a-4bc7-b04f-7cf8a526e7ae (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:608
19562024-12-18T22:14:46.988ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1119 request = datasets_list zpool = oxp_ad207096-a29a-4bc7-b04f-7cf8a526e7ae
19572024-12-18T22:14:47.008ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a952a3c4-f4b2-4c9a-a310-fb464cba0cce (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:608
19582024-12-18T22:14:47.008ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1119 request = datasets_list zpool = oxp_a952a3c4-f4b2-4c9a-a310-fb464cba0cce
19592024-12-18T22:14:47.030ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 45dbe21c-5eaa-4707-b822-d1348b4d8afc (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:608
19602024-12-18T22:14:47.030ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1119 request = datasets_list zpool = oxp_45dbe21c-5eaa-4707-b822-d1348b4d8afc
19612024-12-18T22:14:47.050ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 378b1d3c-0145-41bf-ab1f-16bc3c7930e7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:608
19622024-12-18T22:14:47.050ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1119 request = datasets_list zpool = oxp_378b1d3c-0145-41bf-ab1f-16bc3c7930e7
19632024-12-18T22:14:47.072ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4bf1df73-f4b5-4c23-85b8-9b365d6ea8ae (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:608
19642024-12-18T22:14:47.072ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1119 request = datasets_list zpool = oxp_4bf1df73-f4b5-4c23-85b8-9b365d6ea8ae
19652024-12-18T22:14:47.085ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 198806 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47107 req_id = ac4f2db2-0935-4b03-b9b6-8fc2fe7c6cbb response_code = 200 uri = /inventory
19662024-12-18T22:14:47.374ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63030
19672024-12-18T22:14:47.374ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 104d2c5b-1a03-416e-83a1-9840a7797640, kind: Service { id: d0ef80fe-5a3c-4585-be47-819c465c7a37 }, name: Name("external-dns-d0ef80fe-5a3c-4585-be47-819c465c7a37"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 188, 248])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 607e1df6-370f-4c69-a01b-1dec075c60ae, kind: Service { id: 160de9b3-61fd-47fd-9883-78dcc7b014f0 }, name: Name("external-dns-160de9b3-61fd-47fd-9883-78dcc7b014f0"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 132, 76])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0bab2332-a525-46aa-9d7e-fb4af64f3c88, kind: Service { id: 9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395 }, name: Name("nexus-9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 211, 86])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: af14a7c6-4009-42e7-b00a-57c5ae0399bb, kind: Service { id: 175d3cc8-9a02-4cf3-970c-8ec76a875436 }, name: Name("nexus-175d3cc8-9a02-4cf3-970c-8ec76a875436"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 135, 206])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d048e606-7b77-4cdc-951d-7050040ab8d1, kind: Service { id: c0e3d114-075e-41a4-a4df-fa8131bbea97 }, name: Name("nexus-c0e3d114-075e-41a4-a4df-fa8131bbea97"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 155, 145])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
19682024-12-18T22:14:47.374ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19692024-12-18T22:14:47.374ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19702024-12-18T22:14:47.374ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
19712024-12-18T22:14:47.374ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19722024-12-18T22:14:47.374ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19732024-12-18T22:14:47.374ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19742024-12-18T22:14:47.375ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 361 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63030 req_id = ab950b11-305d-4417-b104-0634cc996ec5 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
19752024-12-18T22:14:47.388ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49815
19762024-12-18T22:14:47.388ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 104d2c5b-1a03-416e-83a1-9840a7797640, kind: Service { id: d0ef80fe-5a3c-4585-be47-819c465c7a37 }, name: Name("external-dns-d0ef80fe-5a3c-4585-be47-819c465c7a37"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 188, 248])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 607e1df6-370f-4c69-a01b-1dec075c60ae, kind: Service { id: 160de9b3-61fd-47fd-9883-78dcc7b014f0 }, name: Name("external-dns-160de9b3-61fd-47fd-9883-78dcc7b014f0"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 132, 76])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0bab2332-a525-46aa-9d7e-fb4af64f3c88, kind: Service { id: 9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395 }, name: Name("nexus-9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 211, 86])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: af14a7c6-4009-42e7-b00a-57c5ae0399bb, kind: Service { id: 175d3cc8-9a02-4cf3-970c-8ec76a875436 }, name: Name("nexus-175d3cc8-9a02-4cf3-970c-8ec76a875436"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 135, 206])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d048e606-7b77-4cdc-951d-7050040ab8d1, kind: Service { id: c0e3d114-075e-41a4-a4df-fa8131bbea97 }, name: Name("nexus-c0e3d114-075e-41a4-a4df-fa8131bbea97"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 155, 145])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
19772024-12-18T22:14:47.388ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19782024-12-18T22:14:47.388ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19792024-12-18T22:14:47.388ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
19802024-12-18T22:14:47.388ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19812024-12-18T22:14:47.388ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19822024-12-18T22:14:47.388ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19832024-12-18T22:14:47.388ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 260 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49815 req_id = 8c187de4-ba77-45e7-9362-cd83936ef7d1 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
19842024-12-18T22:14:47.439ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64890
19852024-12-18T22:14:47.439ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 104d2c5b-1a03-416e-83a1-9840a7797640, kind: Service { id: d0ef80fe-5a3c-4585-be47-819c465c7a37 }, name: Name("external-dns-d0ef80fe-5a3c-4585-be47-819c465c7a37"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 188, 248])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 607e1df6-370f-4c69-a01b-1dec075c60ae, kind: Service { id: 160de9b3-61fd-47fd-9883-78dcc7b014f0 }, name: Name("external-dns-160de9b3-61fd-47fd-9883-78dcc7b014f0"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 132, 76])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0bab2332-a525-46aa-9d7e-fb4af64f3c88, kind: Service { id: 9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395 }, name: Name("nexus-9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 211, 86])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: af14a7c6-4009-42e7-b00a-57c5ae0399bb, kind: Service { id: 175d3cc8-9a02-4cf3-970c-8ec76a875436 }, name: Name("nexus-175d3cc8-9a02-4cf3-970c-8ec76a875436"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 135, 206])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d048e606-7b77-4cdc-951d-7050040ab8d1, kind: Service { id: c0e3d114-075e-41a4-a4df-fa8131bbea97 }, name: Name("nexus-c0e3d114-075e-41a4-a4df-fa8131bbea97"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 155, 145])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
19862024-12-18T22:14:47.439ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19872024-12-18T22:14:47.439ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19882024-12-18T22:14:47.439ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
19892024-12-18T22:14:47.439ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19902024-12-18T22:14:47.439ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19912024-12-18T22:14:47.439ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19922024-12-18T22:14:47.439ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 257 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64890 req_id = c55ac207-1cf4-478a-9c66-f92a8ba58aa8 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
19932024-12-18T22:14:52.860ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53397
19942024-12-18T22:14:52.860ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53397 req_id = f889b004-c5da-49cf-ad02-1e6c3b6a514e response_code = 200 uri = /vpc-routes
19952024-12-18T22:14:52.886ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 values = ExternalIpGatewayMap { mappings: {} }
19962024-12-18T22:14:52.886ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53397 req_id = 8a15d48f-5675-4c3c-88b3-4d3997d25150 response_code = 204 uri = /eip-gateways
19972024-12-18T22:14:53.036ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 239 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53397 req_id = e3f8dc51-3219-4d58-8b7c-ebfe85bab3be response_code = 204 uri = /vpc-routes
19982024-12-18T22:15:11.631ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:43671 remote_addr = [fd00:1122:3344:101::d]:59797 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
19992024-12-18T22:15:11.657ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 25601 local_addr = [fd00:1122:3344:101::1]:43671 method = GET remote_addr = [fd00:1122:3344:101::d]:59797 req_id = b7f363de-791d-45c5-a972-5f4dd3052781 response_code = 200 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 uri = /44b7e384-368a-4bb9-a5b4-e1c12506ebd3
20002024-12-18T22:15:12.986ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59052
20012024-12-18T22:15:12.986ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59052 req_id = 70021564-b000-49bb-8854-0510365f8683 response_code = 200 uri = /vpc-routes
20022024-12-18T22:15:13.005ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48562
20032024-12-18T22:15:13.005ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48562 req_id = 37b034e6-0a6e-4d29-a931-71d201be2797 response_code = 200 uri = /vpc-routes
20042024-12-18T22:15:13.045ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 values = ExternalIpGatewayMap { mappings: {} }
20052024-12-18T22:15:13.045ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59052 req_id = 58ee0660-b5a6-42ab-8557-72839ec86dd7 response_code = 204 uri = /eip-gateways
20062024-12-18T22:15:13.057ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 391 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59052 req_id = 72acce73-a868-48ab-b90c-6e86a5f6e491 response_code = 204 uri = /vpc-routes
20072024-12-18T22:15:13.073ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 values = ExternalIpGatewayMap { mappings: {} }
20082024-12-18T22:15:13.073ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48562 req_id = e0e3094e-ae27-4590-a25c-0adc445fd0b7 response_code = 204 uri = /eip-gateways
20092024-12-18T22:15:13.084ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 281 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48562 req_id = 00dd391a-437a-4b74-a80c-6ffc4ddc5271 response_code = 204 uri = /vpc-routes
20102024-12-18T22:15:13.162ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59985
20112024-12-18T22:15:13.163ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20122024-12-18T22:15:13.254ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20132024-12-18T22:15:13.329ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 166980 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:59985 req_id = fef8022f-1397-4fb5-a97f-3dc94490633f response_code = 204 uri = /switch-ports
20142024-12-18T22:15:13.329ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41327
20152024-12-18T22:15:13.330ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 290 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41327 req_id = 592cfbe3-0749-4d3d-bd97-f5eaef9ec3a7 response_code = 200 uri = /v2p
20162024-12-18T22:15:13.330ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 495 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59985 req_id = dd9ef5ee-5449-450c-907b-e39dbd0e47d2 response_code = 200 uri = /network-bootstore-config
20172024-12-18T22:15:13.333ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54406
20182024-12-18T22:15:13.333ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20192024-12-18T22:15:13.382ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20202024-12-18T22:15:13.442ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108444 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:54406 req_id = d390a73e-8fb6-40e9-bd70-f1ccdaac2de5 response_code = 204 uri = /switch-ports
20212024-12-18T22:15:13.442ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51637
20222024-12-18T22:15:13.442ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 216 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51637 req_id = 9fd8c00a-b2d3-4425-9e83-4910ca391572 response_code = 200 uri = /v2p
20232024-12-18T22:15:13.442ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 257 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54406 req_id = 667723fe-da1a-4d8e-9f3f-baf63b635bea response_code = 200 uri = /network-bootstore-config
20242024-12-18T22:15:13.478ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
20252024-12-18T22:15:13.479ZINFOSledAgent (bootstore): Writing ledger to /pool/int/f4e49932-892e-4e15-afe7-919d71bd3012/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
20262024-12-18T22:15:13.480ZINFOSledAgent (bootstore): Writing ledger to /pool/int/de0dd618-e464-453d-9394-6cb21d5dbefa/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
20272024-12-18T22:15:13.481ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
20282024-12-18T22:15:13.481ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7476 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59985 req_id = b5192c24-53e2-43e4-a74b-a779cc89849d response_code = 204 uri = /network-bootstore-config
20292024-12-18T22:15:13.512ZINFOSledAgent (bootstore): Attempting to update network config with generation: 3, current_generation: 2 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
20302024-12-18T22:15:13.512ZINFOSledAgent (bootstore): Writing ledger to /pool/int/f4e49932-892e-4e15-afe7-919d71bd3012/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
20312024-12-18T22:15:13.512ZINFOSledAgent (bootstore): Writing ledger to /pool/int/de0dd618-e464-453d-9394-6cb21d5dbefa/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
20322024-12-18T22:15:13.512ZINFOSledAgent (bootstore): Broadcasting network config with generation 3 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
20332024-12-18T22:15:13.512ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 706 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54406 req_id = 1cb9ab8e-16df-4ea0-be17-19eeb8e041df response_code = 204 uri = /network-bootstore-config
20342024-12-18T22:15:14.015ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47029
20352024-12-18T22:15:14.015ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47029 req_id = a76b71d2-f175-439b-aad7-16f10450bae9 response_code = 200 uri = /vpc-routes
20362024-12-18T22:15:14.033ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 values = ExternalIpGatewayMap { mappings: {} }
20372024-12-18T22:15:14.034ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47029 req_id = be173176-a710-4fd8-9d33-3307fe3e2413 response_code = 204 uri = /eip-gateways
20382024-12-18T22:15:14.043ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 249 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47029 req_id = a28c9e12-67dc-4f67-9ee3-45a033893b0b response_code = 204 uri = /vpc-routes
20392024-12-18T22:15:14.197ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65162
20402024-12-18T22:15:14.197ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65162 req_id = 83ac757c-038e-4194-9e72-a019c1669fff response_code = 200 uri = /v2p
20412024-12-18T22:15:14.535ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50136
20422024-12-18T22:15:14.535ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20432024-12-18T22:15:14.572ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20442024-12-18T22:15:14.627ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91511 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:50136 req_id = 6ba2cb0a-e6af-4e70-a9ee-032b83d25363 response_code = 204 uri = /switch-ports
20452024-12-18T22:15:14.627ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50136 req_id = cef7995a-a162-4533-ab20-67d5a0c6cf56 response_code = 200 uri = /network-bootstore-config
20462024-12-18T22:15:16.646ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:59401
20472024-12-18T22:15:16.646ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:59401 req_id = 9a51ad6a-b751-48b5-940d-a1fce7592b4d response_code = 200 uri = /baseboard
20482024-12-18T22:15:41.637ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6289 local_addr = [fd00:1122:3344:101::1]:43671 method = GET remote_addr = [fd00:1122:3344:101::d]:59797 req_id = 2b483328-9f55-4ffd-a1d7-548b0a896784 response_code = 200 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 uri = /44b7e384-368a-4bb9-a5b4-e1c12506ebd3
20492024-12-18T22:15:42.978ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51640
20502024-12-18T22:15:42.978ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51640 req_id = 1734b0fe-0eb7-4b75-9b7f-aec7c0a82f7e response_code = 200 uri = /vpc-routes
20512024-12-18T22:15:42.983ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53246
20522024-12-18T22:15:42.984ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53246 req_id = 805983b3-590a-46a0-95e2-e041706aca98 response_code = 200 uri = /vpc-routes
20532024-12-18T22:15:43.030ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 values = ExternalIpGatewayMap { mappings: {} }
20542024-12-18T22:15:43.030ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51640 req_id = 4e98cd11-b67a-4db9-a628-00d7181f3ca6 response_code = 204 uri = /eip-gateways
20552024-12-18T22:15:43.035ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 values = ExternalIpGatewayMap { mappings: {} }
20562024-12-18T22:15:43.035ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53246 req_id = 02f2eb87-810a-4367-9c5e-0bf27e4a5867 response_code = 204 uri = /eip-gateways
20572024-12-18T22:15:43.046ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 214 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53246 req_id = afd31baf-936e-4088-b6dc-2aeda46c5a57 response_code = 204 uri = /vpc-routes
20582024-12-18T22:15:43.067ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52315
20592024-12-18T22:15:43.067ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52315 req_id = c40031c5-7fa9-465d-841a-01b0da2d2122 response_code = 200 uri = /v2p
20602024-12-18T22:15:43.074ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51640 req_id = e68c9326-2ab5-4323-8756-6c689d2b4e28 response_code = 204 uri = /vpc-routes
20612024-12-18T22:15:43.143ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51202
20622024-12-18T22:15:43.143ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20632024-12-18T22:15:43.187ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20642024-12-18T22:15:43.248ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105021 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:51202 req_id = 75e97847-352c-4b0d-8df4-4066f27d51cf response_code = 204 uri = /switch-ports
20652024-12-18T22:15:43.248ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60448
20662024-12-18T22:15:43.248ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37683
20672024-12-18T22:15:43.248ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20682024-12-18T22:15:43.252ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3718 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60448 req_id = a46c5013-c844-46ea-9896-69233157b3a1 response_code = 200 uri = /v2p
20692024-12-18T22:15:43.252ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3750 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51202 req_id = d27694d1-453a-4cd7-b806-f5aa9b845f63 response_code = 200 uri = /network-bootstore-config
20702024-12-18T22:15:43.285ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20712024-12-18T22:15:43.342ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93775 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:37683 req_id = 325c867a-5d05-476d-bc76-815180d7633a response_code = 204 uri = /switch-ports
20722024-12-18T22:15:43.342ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37683 req_id = 5b3d032d-0a81-40ea-b2a9-baa03ca2cfa9 response_code = 200 uri = /network-bootstore-config
20732024-12-18T22:15:43.927ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44031
20742024-12-18T22:15:43.927ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44031 req_id = 2440d382-19bc-4d76-9cec-8cbda021ac11 response_code = 200 uri = /vpc-routes
20752024-12-18T22:15:43.979ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 values = ExternalIpGatewayMap { mappings: {} }
20762024-12-18T22:15:43.979ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44031 req_id = f761a375-ce2d-485c-a81d-6a8c1582c5a4 response_code = 204 uri = /eip-gateways
20772024-12-18T22:15:43.988ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 248 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44031 req_id = 8cf43cfc-dcb4-4e1e-99a2-c7ec1a935d07 response_code = 204 uri = /vpc-routes
20782024-12-18T22:15:44.113ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51772
20792024-12-18T22:15:44.114ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51772 req_id = 4b6a9029-7c11-4df0-8c2b-ddc20a366736 response_code = 200 uri = /v2p
20802024-12-18T22:15:44.188ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63475
20812024-12-18T22:15:44.188ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20822024-12-18T22:15:44.223ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20832024-12-18T22:15:44.276ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87861 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:63475 req_id = 097c4348-163b-48f0-993e-4be5e97cf29b response_code = 204 uri = /switch-ports
20842024-12-18T22:15:44.276ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63475 req_id = 2c478c68-cbd3-46cc-9c14-d6ab370cd0bb response_code = 200 uri = /network-bootstore-config
20852024-12-18T22:15:46.681ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:33071
20862024-12-18T22:15:46.681ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:33071 req_id = 99c0aca5-c8ce-4032-b35c-ac197a5f9deb response_code = 200 uri = /baseboard
20872024-12-18T22:16:09.783ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
20882024-12-18T22:16:11.638ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6567 local_addr = [fd00:1122:3344:101::1]:43671 method = GET remote_addr = [fd00:1122:3344:101::d]:59797 req_id = 649bbc0b-2c65-4034-9cce-cce426e0897f response_code = 200 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 uri = /44b7e384-368a-4bb9-a5b4-e1c12506ebd3
20892024-12-18T22:16:13.042ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57544
20902024-12-18T22:16:13.043ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57544 req_id = 1957a53c-4f30-4577-b7e5-91b439390691 response_code = 200 uri = /v2p
20912024-12-18T22:16:13.077ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55430
20922024-12-18T22:16:13.077ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55430 req_id = f2178cdd-3245-4974-88a8-4c16b501903a response_code = 200 uri = /vpc-routes
20932024-12-18T22:16:13.122ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 values = ExternalIpGatewayMap { mappings: {} }
20942024-12-18T22:16:13.122ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55430 req_id = 8574e2dd-5767-437e-9f09-2a490cf6327c response_code = 204 uri = /eip-gateways
20952024-12-18T22:16:13.132ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 224 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55430 req_id = 307322f6-aa73-4065-9dd2-f86fd4e99feb response_code = 204 uri = /vpc-routes
20962024-12-18T22:16:13.215ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41190
20972024-12-18T22:16:13.215ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20982024-12-18T22:16:13.255ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20992024-12-18T22:16:13.315ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99781 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:41190 req_id = 47661f4f-a933-408f-800a-f255eec62fcb response_code = 204 uri = /switch-ports
21002024-12-18T22:16:13.315ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59884
21012024-12-18T22:16:13.315ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53926
21022024-12-18T22:16:13.315ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53926 req_id = 1360e835-aca5-441b-8c99-c06a7dd99397 response_code = 200 uri = /vpc-routes
21032024-12-18T22:16:13.315ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 243 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41190 req_id = d6d9ae15-e6d9-4940-b52f-ae8c3f7236c7 response_code = 200 uri = /network-bootstore-config
21042024-12-18T22:16:13.315ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 280 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59884 req_id = 7add743a-b1f0-4a9d-8964-3253c4fb5927 response_code = 200 uri = /v2p
21052024-12-18T22:16:13.349ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35160
21062024-12-18T22:16:13.349ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21072024-12-18T22:16:13.387ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21082024-12-18T22:16:13.439ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90452 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:35160 req_id = 33e13ad9-3def-4d23-b0f7-104f8996152b response_code = 204 uri = /switch-ports
21092024-12-18T22:16:13.440ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 values = ExternalIpGatewayMap { mappings: {} }
21102024-12-18T22:16:13.440ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 167 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53926 req_id = b7352770-7f7f-4b68-a265-524bc9e6e0f3 response_code = 204 uri = /eip-gateways
21112024-12-18T22:16:13.440ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 240 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35160 req_id = ba8a91b2-fca2-4ea4-ad05-1f9ab3f88fff response_code = 200 uri = /network-bootstore-config
21122024-12-18T22:16:13.454ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 235 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53926 req_id = 077145e7-d5f5-49c5-88c4-bfc18fe8fcf9 response_code = 204 uri = /vpc-routes
21132024-12-18T22:16:14.249ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58185
21142024-12-18T22:16:14.249ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58185 req_id = 9fb04b5d-91f3-44e9-98f1-c4353d7b6d7b response_code = 200 uri = /vpc-routes
21152024-12-18T22:16:14.289ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 values = ExternalIpGatewayMap { mappings: {} }
21162024-12-18T22:16:14.289ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58185 req_id = a1b8870a-41b1-4680-b4fb-14fcabc08b50 response_code = 204 uri = /eip-gateways
21172024-12-18T22:16:14.298ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 180 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58185 req_id = 208c4fbc-a8ce-40cc-9883-e6ed3a0dc517 response_code = 204 uri = /vpc-routes
21182024-12-18T22:16:14.392ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62935
21192024-12-18T22:16:14.392ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62935 req_id = 02825f0c-395c-4370-96b0-535723b63820 response_code = 200 uri = /v2p
21202024-12-18T22:16:14.409ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58697
21212024-12-18T22:16:14.409ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21222024-12-18T22:16:14.444ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21232024-12-18T22:16:14.499ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90501 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:58697 req_id = cf04d8b4-e98b-4c22-b334-e8350f33c5fe response_code = 204 uri = /switch-ports
21242024-12-18T22:16:14.500ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58697 req_id = 52b162cb-b2be-4a2e-b09a-4c1dabb0c1f3 response_code = 200 uri = /network-bootstore-config
21252024-12-18T22:16:16.715ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:51793
21262024-12-18T22:16:16.715ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:51793 req_id = e55dbc42-ac56-4e1a-a057-9463798744c3 response_code = 200 uri = /baseboard
21272024-12-18T22:16:41.638ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6722 local_addr = [fd00:1122:3344:101::1]:43671 method = GET remote_addr = [fd00:1122:3344:101::d]:59797 req_id = 19c7b42b-fc1a-402b-8dc1-61601244b13c response_code = 200 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 uri = /44b7e384-368a-4bb9-a5b4-e1c12506ebd3
21282024-12-18T22:16:42.937ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52110
21292024-12-18T22:16:42.937ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52110 req_id = 29d42830-03df-451d-b977-8d79be0a90d1 response_code = 200 uri = /vpc-routes
21302024-12-18T22:16:42.951ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50353
21312024-12-18T22:16:42.951ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50353 req_id = b531933f-cbcc-4d3e-9388-50e0167a3a77 response_code = 200 uri = /vpc-routes
21322024-12-18T22:16:42.983ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 values = ExternalIpGatewayMap { mappings: {} }
21332024-12-18T22:16:42.983ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52110 req_id = 35c2c8f8-da84-4b15-8d08-9c5fd217312d response_code = 204 uri = /eip-gateways
21342024-12-18T22:16:42.993ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 234 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52110 req_id = 0dcf3661-af73-48b8-a689-5273a4f1d175 response_code = 204 uri = /vpc-routes
21352024-12-18T22:16:43.001ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 values = ExternalIpGatewayMap { mappings: {} }
21362024-12-18T22:16:43.001ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50353 req_id = 8f70b166-b13c-4f3e-9264-f44dd0bc6448 response_code = 204 uri = /eip-gateways
21372024-12-18T22:16:43.010ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 233 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50353 req_id = 7d9b5780-1979-4a24-8485-c4a41e3b9668 response_code = 204 uri = /vpc-routes
21382024-12-18T22:16:43.071ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46703
21392024-12-18T22:16:43.071ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46703 req_id = 15d6dc96-37f7-414e-99ce-cf208adf5319 response_code = 200 uri = /v2p
21402024-12-18T22:16:43.141ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50296
21412024-12-18T22:16:43.141ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21422024-12-18T22:16:43.187ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21432024-12-18T22:16:43.251ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110297 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:50296 req_id = 8f89f03e-9a66-4993-9fda-c545aac9d372 response_code = 204 uri = /switch-ports
21442024-12-18T22:16:43.252ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44953
21452024-12-18T22:16:43.252ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53277
21462024-12-18T22:16:43.252ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50296 req_id = 2b479b27-5f0e-449c-8dbc-122586047077 response_code = 200 uri = /network-bootstore-config
21472024-12-18T22:16:43.252ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21482024-12-18T22:16:43.255ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3272 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53277 req_id = ba0225bf-f28f-485f-927f-25968447130c response_code = 200 uri = /v2p
21492024-12-18T22:16:43.286ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21502024-12-18T22:16:43.345ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92894 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:44953 req_id = 673b94a3-d5ab-43ab-9a8f-cb7cc93b837b response_code = 204 uri = /switch-ports
21512024-12-18T22:16:43.345ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44953 req_id = 9a6b496f-352d-4f53-86a1-09f89bbe3bc1 response_code = 200 uri = /network-bootstore-config
21522024-12-18T22:16:43.957ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56585
21532024-12-18T22:16:43.958ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56585 req_id = 969b664f-9dd0-4567-9782-818a1ca32931 response_code = 200 uri = /vpc-routes
21542024-12-18T22:16:44.009ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 values = ExternalIpGatewayMap { mappings: {} }
21552024-12-18T22:16:44.009ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56585 req_id = 88408e79-d0a3-46a4-82fd-6ab9999ead6d response_code = 204 uri = /eip-gateways
21562024-12-18T22:16:44.019ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 219 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56585 req_id = 56171954-0f80-46d4-b57d-14c2ccd7d71e response_code = 204 uri = /vpc-routes
21572024-12-18T22:16:44.066ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51573
21582024-12-18T22:16:44.066ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51573 req_id = 808f7195-d58a-43cc-824b-fc6716c4c25c response_code = 200 uri = /v2p
21592024-12-18T22:16:44.217ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52208
21602024-12-18T22:16:44.217ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21612024-12-18T22:16:44.254ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21622024-12-18T22:16:44.312ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95476 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:52208 req_id = a32dff42-4a49-482b-b67e-a0cdae3979ae response_code = 204 uri = /switch-ports
21632024-12-18T22:16:44.312ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52208 req_id = 84ce7d69-ea79-41e2-bb2a-b4416799a90e response_code = 200 uri = /network-bootstore-config
21642024-12-18T22:16:46.750ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54266
21652024-12-18T22:16:46.750ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54266 req_id = df547620-a98a-4029-912f-20ad4a42b541 response_code = 200 uri = /baseboard
21662024-12-18T22:17:11.636ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5066 local_addr = [fd00:1122:3344:101::1]:43671 method = GET remote_addr = [fd00:1122:3344:101::d]:59797 req_id = 593b04d3-0ad5-4f70-9813-a2672a1e3b18 response_code = 200 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 uri = /44b7e384-368a-4bb9-a5b4-e1c12506ebd3
21672024-12-18T22:17:13.320ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48001
21682024-12-18T22:17:13.320ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48001 req_id = cb42cde7-b944-4e27-af5d-d05bb3904489 response_code = 200 uri = /vpc-routes
21692024-12-18T22:17:13.349ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61153
21702024-12-18T22:17:13.349ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61153 req_id = adc6b0be-3cb8-4599-96ca-f3331bf55018 response_code = 200 uri = /vpc-routes
21712024-12-18T22:17:13.380ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 values = ExternalIpGatewayMap { mappings: {} }
21722024-12-18T22:17:13.380ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48001 req_id = ae758dd3-72ff-41fe-9268-486c59bc656e response_code = 204 uri = /eip-gateways
21732024-12-18T22:17:13.401ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 217 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48001 req_id = 80f1005e-c480-4c98-864c-345924f1093d response_code = 204 uri = /vpc-routes
21742024-12-18T22:17:13.413ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 values = ExternalIpGatewayMap { mappings: {} }
21752024-12-18T22:17:13.413ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61153 req_id = 49ba918f-a60c-4b2f-958b-eba9112c8afb response_code = 204 uri = /eip-gateways
21762024-12-18T22:17:13.422ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 183 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61153 req_id = 394ecbfb-22d8-4f4b-9aa6-b01443a8cbb3 response_code = 204 uri = /vpc-routes
21772024-12-18T22:17:13.423ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52818
21782024-12-18T22:17:13.423ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21792024-12-18T22:17:13.467ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21802024-12-18T22:17:13.517ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94043 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:52818 req_id = 854d4241-0f2e-42b8-b4fc-0f634e7ef186 response_code = 204 uri = /switch-ports
21812024-12-18T22:17:13.517ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58533
21822024-12-18T22:17:13.517ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51669
21832024-12-18T22:17:13.517ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46584
21842024-12-18T22:17:13.518ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 316 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52818 req_id = 6c793146-fd8a-4a48-96b2-d2b50206bede response_code = 200 uri = /network-bootstore-config
21852024-12-18T22:17:13.518ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21862024-12-18T22:17:13.518ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 218 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51669 req_id = 9ed0524b-c5ba-495b-bd1b-e06fe8500b69 response_code = 200 uri = /v2p
21872024-12-18T22:17:13.518ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 280 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46584 req_id = 92046413-e631-4702-a19a-4fbe6cf6b4c2 response_code = 200 uri = /v2p
21882024-12-18T22:17:13.555ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21892024-12-18T22:17:13.610ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92175 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:58533 req_id = f75d742c-65a3-4d0d-a42a-8d0911e70605 response_code = 204 uri = /switch-ports
21902024-12-18T22:17:13.610ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58533 req_id = 089583b0-327f-4582-943e-91da917558ee response_code = 200 uri = /network-bootstore-config
21912024-12-18T22:17:14.234ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64668
21922024-12-18T22:17:14.234ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64668 req_id = 8c7950d7-3c9b-47db-8a86-0ec7e7b58dee response_code = 200 uri = /v2p
21932024-12-18T22:17:14.255ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63604
21942024-12-18T22:17:14.256ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63604 req_id = f8152625-2ecb-44c1-ab20-cc7fae47fcac response_code = 200 uri = /vpc-routes
21952024-12-18T22:17:14.270ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 values = ExternalIpGatewayMap { mappings: {} }
21962024-12-18T22:17:14.270ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63604 req_id = a5e189f5-c75f-4499-af8d-a015df89ec76 response_code = 204 uri = /eip-gateways
21972024-12-18T22:17:14.280ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 234 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63604 req_id = 752ac3ac-4791-4c8f-9328-2b1179552cfb response_code = 204 uri = /vpc-routes
21982024-12-18T22:17:14.465ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52533
21992024-12-18T22:17:14.465ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22002024-12-18T22:17:14.503ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22012024-12-18T22:17:14.561ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95949 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:52533 req_id = d6d8a5f4-c12f-4c42-9b9d-a6c24d4fd5ca response_code = 204 uri = /switch-ports
22022024-12-18T22:17:14.561ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52533 req_id = ea76f9fe-dc1c-4f3d-a43e-a3e944d4be7f response_code = 200 uri = /network-bootstore-config
22032024-12-18T22:17:16.784ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:34033
22042024-12-18T22:17:16.784ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:34033 req_id = 40e1c99c-c7ae-4211-81c6-033314d9b4e4 response_code = 200 uri = /baseboard
22052024-12-18T22:17:41.637ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5694 local_addr = [fd00:1122:3344:101::1]:43671 method = GET remote_addr = [fd00:1122:3344:101::d]:59797 req_id = 4a1c64ab-b8de-4550-8559-4372a68eb49c response_code = 200 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 uri = /44b7e384-368a-4bb9-a5b4-e1c12506ebd3
22062024-12-18T22:17:42.917ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55885
22072024-12-18T22:17:42.917ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55885 req_id = e4113bbc-23e5-41de-8010-db606d2bc8e1 response_code = 200 uri = /vpc-routes
22082024-12-18T22:17:42.969ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 values = ExternalIpGatewayMap { mappings: {} }
22092024-12-18T22:17:42.969ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55885 req_id = faa4139a-0849-45e0-8f78-e99896d180e5 response_code = 204 uri = /eip-gateways
22102024-12-18T22:17:42.978ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 244 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55885 req_id = 5aabe31b-49a4-4664-9209-f3c8b696f9eb response_code = 204 uri = /vpc-routes
22112024-12-18T22:17:43.009ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43099
22122024-12-18T22:17:43.009ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43099 req_id = 3aa7d368-6851-4708-8bc5-8e76c4a89cf3 response_code = 200 uri = /v2p
22132024-12-18T22:17:43.021ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61302
22142024-12-18T22:17:43.021ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22152024-12-18T22:17:43.062ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22162024-12-18T22:17:43.118ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96676 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:61302 req_id = 1e9712ad-b213-47b0-adbf-9aa3c01c40f1 response_code = 204 uri = /switch-ports
22172024-12-18T22:17:43.118ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39573
22182024-12-18T22:17:43.118ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60345
22192024-12-18T22:17:43.119ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55929
22202024-12-18T22:17:43.119ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 232 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61302 req_id = c6685fe8-44a1-460e-a13d-1cf80dafef7e response_code = 200 uri = /network-bootstore-config
22212024-12-18T22:17:43.119ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 170 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39573 req_id = afd157f6-f2f6-4491-b592-137cc91c7277 response_code = 200 uri = /vpc-routes
22222024-12-18T22:17:43.119ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 208 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60345 req_id = 0fb96f41-3e00-42b3-b84e-adfa75daf019 response_code = 200 uri = /v2p
22232024-12-18T22:17:43.119ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22242024-12-18T22:17:43.138ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 values = ExternalIpGatewayMap { mappings: {} }
22252024-12-18T22:17:43.138ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 778 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39573 req_id = 51c523ad-f50b-4b44-91a2-7b5c946d76e7 response_code = 204 uri = /eip-gateways
22262024-12-18T22:17:43.150ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 993 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39573 req_id = 84ab56da-5711-495b-b657-8a8dc7387a70 response_code = 204 uri = /vpc-routes
22272024-12-18T22:17:43.159ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22282024-12-18T22:17:43.221ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102676 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:55929 req_id = e9d0361f-2bfb-47f5-97dd-436571307ab4 response_code = 204 uri = /switch-ports
22292024-12-18T22:17:43.222ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 202 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55929 req_id = 1beca9f9-46d4-4e57-9e44-13843ac63b86 response_code = 200 uri = /network-bootstore-config
22302024-12-18T22:17:44.036ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57965
22312024-12-18T22:17:44.036ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57965 req_id = c2f81cb5-b3b8-4a3c-a375-d7e8e93d7ca8 response_code = 200 uri = /vpc-routes
22322024-12-18T22:17:44.090ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 values = ExternalIpGatewayMap { mappings: {} }
22332024-12-18T22:17:44.090ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57965 req_id = 652b5a7d-b2c9-4ea0-a528-d90070975519 response_code = 204 uri = /eip-gateways
22342024-12-18T22:17:44.100ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57965 req_id = 5b5b0a3a-9861-4746-a289-d4682269b19c response_code = 204 uri = /vpc-routes
22352024-12-18T22:17:44.164ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48220
22362024-12-18T22:17:44.164ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22372024-12-18T22:17:44.203ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22382024-12-18T22:17:44.263ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99656 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:48220 req_id = e10e8bfd-8c1d-4583-8fde-36874ff27b6f response_code = 204 uri = /switch-ports
22392024-12-18T22:17:44.263ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57706
22402024-12-18T22:17:44.264ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57706 req_id = 4b035790-c792-420c-ad37-9b64a8d61dad response_code = 200 uri = /v2p
22412024-12-18T22:17:44.264ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48220 req_id = 4f98f652-ef2d-4feb-abcc-9d94406bfe0b response_code = 200 uri = /network-bootstore-config
22422024-12-18T22:17:46.818ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:60088
22432024-12-18T22:17:46.819ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:60088 req_id = a9d5bd4b-c90c-4b68-8b94-3cc5f95447b1 response_code = 200 uri = /baseboard
22442024-12-18T22:18:11.638ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5710 local_addr = [fd00:1122:3344:101::1]:43671 method = GET remote_addr = [fd00:1122:3344:101::d]:59797 req_id = 82c7fb59-a8a0-4467-a056-408398a1ca49 response_code = 200 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 uri = /44b7e384-368a-4bb9-a5b4-e1c12506ebd3
22452024-12-18T22:18:13.072ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64630
22462024-12-18T22:18:13.072ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64630 req_id = 2a7ef722-78a0-45b6-9f31-4315eacc5ae8 response_code = 200 uri = /vpc-routes
22472024-12-18T22:18:13.120ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 values = ExternalIpGatewayMap { mappings: {} }
22482024-12-18T22:18:13.120ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64630 req_id = c0f4ca9c-a7e0-4e74-9b3c-2b51c558accb response_code = 204 uri = /eip-gateways
22492024-12-18T22:18:13.126ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41276
22502024-12-18T22:18:13.126ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 30 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41276 req_id = dbfb58a7-3b2a-4c1f-aa16-6c6144743727 response_code = 200 uri = /vpc-routes
22512024-12-18T22:18:13.151ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44702
22522024-12-18T22:18:13.152ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44702 req_id = 1e522473-0cb3-498d-9fec-465ea069a90e response_code = 200 uri = /v2p
22532024-12-18T22:18:13.177ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 359 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64630 req_id = 6f67f567-ab4d-445d-a285-43015cfbaf42 response_code = 204 uri = /vpc-routes
22542024-12-18T22:18:13.204ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 values = ExternalIpGatewayMap { mappings: {} }
22552024-12-18T22:18:13.204ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41276 req_id = e3c1339d-9994-4cdd-ad82-d5c005aaaf7b response_code = 204 uri = /eip-gateways
22562024-12-18T22:18:13.214ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50176
22572024-12-18T22:18:13.214ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22582024-12-18T22:18:13.255ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22592024-12-18T22:18:13.314ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100480 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:50176 req_id = 09b0c1d5-f8f1-43de-8e8e-c95f88197e01 response_code = 204 uri = /switch-ports
22602024-12-18T22:18:13.315ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61814
22612024-12-18T22:18:13.315ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 219 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50176 req_id = b02eb7c1-72cc-42b4-831c-8875eccbad39 response_code = 200 uri = /network-bootstore-config
22622024-12-18T22:18:13.315ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22632024-12-18T22:18:13.315ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 515 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41276 req_id = 27a67831-895d-4e4d-9c32-24ffd8d341a4 response_code = 204 uri = /vpc-routes
22642024-12-18T22:18:13.350ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33898
22652024-12-18T22:18:13.350ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33898 req_id = d3264a14-c406-49d0-b628-51b1dede9cea response_code = 200 uri = /v2p
22662024-12-18T22:18:13.355ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22672024-12-18T22:18:13.409ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93969 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:61814 req_id = 13f646c0-bbd9-43a5-8905-5689da144116 response_code = 204 uri = /switch-ports
22682024-12-18T22:18:13.409ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61814 req_id = 54aeaffc-a524-4cf6-8953-17bc604afba0 response_code = 200 uri = /network-bootstore-config
22692024-12-18T22:18:14.136ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61932
22702024-12-18T22:18:14.136ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61932 req_id = 8ac013c2-fb67-4c1c-9abd-69881492952f response_code = 200 uri = /vpc-routes
22712024-12-18T22:18:14.176ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 values = ExternalIpGatewayMap { mappings: {} }
22722024-12-18T22:18:14.176ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61932 req_id = 728d54f5-d8a8-44d8-8ba2-b8a7d0cd538f response_code = 204 uri = /eip-gateways
22732024-12-18T22:18:14.187ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61932 req_id = 92b1ad57-166e-483c-8ddb-6a4b229af524 response_code = 204 uri = /vpc-routes
22742024-12-18T22:18:14.294ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33194
22752024-12-18T22:18:14.294ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33194 req_id = de5026b9-0e37-4a2f-8c16-0e10f42acf1e response_code = 200 uri = /v2p
22762024-12-18T22:18:14.324ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58575
22772024-12-18T22:18:14.324ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22782024-12-18T22:18:14.361ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22792024-12-18T22:18:14.420ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95478 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:58575 req_id = 7eb6c92f-85b5-41c5-8aad-3434474a9b57 response_code = 204 uri = /switch-ports
22802024-12-18T22:18:14.420ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58575 req_id = da619bf0-0757-4e52-b211-f2128322fe4f response_code = 200 uri = /network-bootstore-config
22812024-12-18T22:18:16.852ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:52645
22822024-12-18T22:18:16.852ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:52645 req_id = 793c94bb-10a3-4992-9c3b-5fb8b5ae7ad8 response_code = 200 uri = /baseboard
22832024-12-18T22:18:41.639ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6504 local_addr = [fd00:1122:3344:101::1]:43671 method = GET remote_addr = [fd00:1122:3344:101::d]:59797 req_id = 3f1efcdb-f2ca-4744-bb5c-16f79f3bb012 response_code = 200 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 uri = /44b7e384-368a-4bb9-a5b4-e1c12506ebd3
22842024-12-18T22:18:42.935ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34874
22852024-12-18T22:18:42.936ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34874 req_id = 47f96a8b-1a3e-45dd-9246-f765437031e9 response_code = 200 uri = /vpc-routes
22862024-12-18T22:18:42.976ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37150
22872024-12-18T22:18:42.976ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 29 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37150 req_id = 4e8834a0-167a-406d-ba07-34e0a0c81ea1 response_code = 200 uri = /vpc-routes
22882024-12-18T22:18:42.991ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 values = ExternalIpGatewayMap { mappings: {} }
22892024-12-18T22:18:42.991ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34874 req_id = 9ceff192-94e0-4795-bedc-d434cf5a3bcb response_code = 204 uri = /eip-gateways
22902024-12-18T22:18:43.004ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43585
22912024-12-18T22:18:43.004ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43585 req_id = c5bcbaa2-30bf-478d-a8c3-004b2e281a92 response_code = 200 uri = /v2p
22922024-12-18T22:18:43.010ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51117
22932024-12-18T22:18:43.010ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51117 req_id = 2e1aa6c9-913e-4a9a-a16d-706549cfe085 response_code = 200 uri = /v2p
22942024-12-18T22:18:43.018ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 values = ExternalIpGatewayMap { mappings: {} }
22952024-12-18T22:18:43.018ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37150 req_id = 8026a54a-4876-4d15-ba7c-4cc2d1897659 response_code = 204 uri = /eip-gateways
22962024-12-18T22:18:43.021ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 240 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34874 req_id = e61611a8-e4d1-4792-889c-186698d2752d response_code = 204 uri = /vpc-routes
22972024-12-18T22:18:43.026ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37150 req_id = e31bfe49-f5ba-4636-8b3a-ec8c633ad57c response_code = 204 uri = /vpc-routes
22982024-12-18T22:18:43.033ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38494
22992024-12-18T22:18:43.033ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23002024-12-18T22:18:43.076ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23012024-12-18T22:18:43.134ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101133 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:38494 req_id = 56cace2c-cb09-4cfd-a068-78fc3745eba9 response_code = 204 uri = /switch-ports
23022024-12-18T22:18:43.134ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48698
23032024-12-18T22:18:43.134ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23042024-12-18T22:18:43.138ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3758 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38494 req_id = 59e752c6-9628-478e-8996-df73ef9bd052 response_code = 200 uri = /network-bootstore-config
23052024-12-18T22:18:43.169ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23062024-12-18T22:18:43.226ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92027 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48698 req_id = d99c616e-3eb2-4ddf-9a18-a2709fafed4d response_code = 204 uri = /switch-ports
23072024-12-18T22:18:43.227ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48698 req_id = e773c9e6-06e7-475b-a0c1-e15316ba3417 response_code = 200 uri = /network-bootstore-config
23082024-12-18T22:18:44.041ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49957
23092024-12-18T22:18:44.041ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49957 req_id = cc137f45-a7cd-4a0b-a9b6-cc54308bf36d response_code = 200 uri = /vpc-routes
23102024-12-18T22:18:44.081ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 values = ExternalIpGatewayMap { mappings: {} }
23112024-12-18T22:18:44.081ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49957 req_id = 5395f434-804e-4e29-b96b-5252a24a8c43 response_code = 204 uri = /eip-gateways
23122024-12-18T22:18:44.091ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 294 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49957 req_id = ec333b4b-1515-4448-86ca-96950b73391a response_code = 204 uri = /vpc-routes
23132024-12-18T22:18:44.114ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48394
23142024-12-18T22:18:44.114ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48394 req_id = ba91ab85-dceb-49f3-bc4e-fd1dfeaaebde response_code = 200 uri = /v2p
23152024-12-18T22:18:44.155ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42839
23162024-12-18T22:18:44.155ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23172024-12-18T22:18:44.193ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23182024-12-18T22:18:44.252ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96425 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:42839 req_id = ef1e7e7c-b0b1-4c9b-804e-e9b0bd97040d response_code = 204 uri = /switch-ports
23192024-12-18T22:18:44.252ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42839 req_id = 16bffdde-5d7b-453a-8932-7ab648888176 response_code = 200 uri = /network-bootstore-config
23202024-12-18T22:18:46.886ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45003
23212024-12-18T22:18:46.887ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45003 req_id = 05198407-9d0e-4bbc-9556-75e6aab5ca8a response_code = 200 uri = /baseboard
23222024-12-18T22:19:11.639ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6861 local_addr = [fd00:1122:3344:101::1]:43671 method = GET remote_addr = [fd00:1122:3344:101::d]:59797 req_id = 06eb0d98-fedb-433f-a7c0-a928e611237c response_code = 200 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 uri = /44b7e384-368a-4bb9-a5b4-e1c12506ebd3
23232024-12-18T22:19:13.106ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57154
23242024-12-18T22:19:13.106ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57154 req_id = 20318ec2-872b-4310-ad9e-1efad1b5c1e8 response_code = 200 uri = /vpc-routes
23252024-12-18T22:19:13.120ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 values = ExternalIpGatewayMap { mappings: {} }
23262024-12-18T22:19:13.120ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57154 req_id = bbfaa893-6666-4e89-b8cb-487403a6b4fb response_code = 204 uri = /eip-gateways
23272024-12-18T22:19:13.130ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 225 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57154 req_id = f6c181f5-58a4-4cc8-854d-1f5ee7b3322d response_code = 204 uri = /vpc-routes
23282024-12-18T22:19:13.191ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41182
23292024-12-18T22:19:13.191ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 30 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41182 req_id = 4cddbed1-f886-429f-81a6-5e5e8b9387fb response_code = 200 uri = /vpc-routes
23302024-12-18T22:19:13.207ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55313
23312024-12-18T22:19:13.207ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 104d2c5b-1a03-416e-83a1-9840a7797640, kind: Service { id: d0ef80fe-5a3c-4585-be47-819c465c7a37 }, name: Name("external-dns-d0ef80fe-5a3c-4585-be47-819c465c7a37"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 188, 248])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 607e1df6-370f-4c69-a01b-1dec075c60ae, kind: Service { id: 160de9b3-61fd-47fd-9883-78dcc7b014f0 }, name: Name("external-dns-160de9b3-61fd-47fd-9883-78dcc7b014f0"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 132, 76])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0bab2332-a525-46aa-9d7e-fb4af64f3c88, kind: Service { id: 9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395 }, name: Name("nexus-9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 211, 86])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: af14a7c6-4009-42e7-b00a-57c5ae0399bb, kind: Service { id: 175d3cc8-9a02-4cf3-970c-8ec76a875436 }, name: Name("nexus-175d3cc8-9a02-4cf3-970c-8ec76a875436"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 135, 206])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d048e606-7b77-4cdc-951d-7050040ab8d1, kind: Service { id: c0e3d114-075e-41a4-a4df-fa8131bbea97 }, name: Name("nexus-c0e3d114-075e-41a4-a4df-fa8131bbea97"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 155, 145])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
23322024-12-18T22:19:13.207ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23332024-12-18T22:19:13.207ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23342024-12-18T22:19:13.207ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
23352024-12-18T22:19:13.207ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23362024-12-18T22:19:13.207ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23372024-12-18T22:19:13.207ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23382024-12-18T22:19:13.207ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 339 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55313 req_id = 3ec393e0-940d-4e8a-b8a9-d3645a220ae1 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
23392024-12-18T22:19:13.214ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59382
23402024-12-18T22:19:13.214ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59382 req_id = 31c8ed1e-cea1-4333-90c9-fbf268da4680 response_code = 200 uri = /v2p
23412024-12-18T22:19:13.236ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 values = ExternalIpGatewayMap { mappings: {} }
23422024-12-18T22:19:13.236ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41182 req_id = 12cc85e7-0612-42ad-bc21-7bccdab2a5f3 response_code = 204 uri = /eip-gateways
23432024-12-18T22:19:13.247ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 212 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41182 req_id = 2434cd53-e968-44b9-b2f8-008edf90f87e response_code = 204 uri = /vpc-routes
23442024-12-18T22:19:13.259ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52709
23452024-12-18T22:19:13.260ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23462024-12-18T22:19:13.299ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23472024-12-18T22:19:13.354ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94454 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:52709 req_id = 0a879323-df1f-4a1c-b6ad-33e01e111e79 response_code = 204 uri = /switch-ports
23482024-12-18T22:19:13.354ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54459
23492024-12-18T22:19:13.354ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 206 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54459 req_id = 74479bfb-746a-4726-a4cf-7374211c5149 response_code = 200 uri = /v2p
23502024-12-18T22:19:13.354ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 228 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52709 req_id = 66be7a19-d057-4a50-9e36-76961e8ea81d response_code = 200 uri = /network-bootstore-config
23512024-12-18T22:19:13.374ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53337
23522024-12-18T22:19:13.374ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23532024-12-18T22:19:13.410ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23542024-12-18T22:19:13.473ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99506 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:53337 req_id = 1f6de283-7412-43ed-852b-a657d5bd2d46 response_code = 204 uri = /switch-ports
23552024-12-18T22:19:13.474ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53337 req_id = 1537023d-ab93-47ce-8f94-b88c14078679 response_code = 200 uri = /network-bootstore-config
23562024-12-18T22:19:13.488ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54785
23572024-12-18T22:19:13.488ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 104d2c5b-1a03-416e-83a1-9840a7797640, kind: Service { id: d0ef80fe-5a3c-4585-be47-819c465c7a37 }, name: Name("external-dns-d0ef80fe-5a3c-4585-be47-819c465c7a37"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 188, 248])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 607e1df6-370f-4c69-a01b-1dec075c60ae, kind: Service { id: 160de9b3-61fd-47fd-9883-78dcc7b014f0 }, name: Name("external-dns-160de9b3-61fd-47fd-9883-78dcc7b014f0"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 132, 76])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0bab2332-a525-46aa-9d7e-fb4af64f3c88, kind: Service { id: 9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395 }, name: Name("nexus-9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 211, 86])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: af14a7c6-4009-42e7-b00a-57c5ae0399bb, kind: Service { id: 175d3cc8-9a02-4cf3-970c-8ec76a875436 }, name: Name("nexus-175d3cc8-9a02-4cf3-970c-8ec76a875436"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 135, 206])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d048e606-7b77-4cdc-951d-7050040ab8d1, kind: Service { id: c0e3d114-075e-41a4-a4df-fa8131bbea97 }, name: Name("nexus-c0e3d114-075e-41a4-a4df-fa8131bbea97"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 155, 145])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
23582024-12-18T22:19:13.488ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23592024-12-18T22:19:13.488ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23602024-12-18T22:19:13.488ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
23612024-12-18T22:19:13.488ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23622024-12-18T22:19:13.488ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23632024-12-18T22:19:13.488ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23642024-12-18T22:19:13.488ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 336 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54785 req_id = 8b3cdd31-d2b3-4130-9e91-0acf9d9e40a0 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
23652024-12-18T22:19:14.129ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38594
23662024-12-18T22:19:14.129ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38594 req_id = 87341b54-8827-46d0-985a-5a22c3b8d482 response_code = 200 uri = /vpc-routes
23672024-12-18T22:19:14.145ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 values = ExternalIpGatewayMap { mappings: {} }
23682024-12-18T22:19:14.145ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38594 req_id = c7f9da1e-3161-42ad-8d17-0e71cd89c64c response_code = 204 uri = /eip-gateways
23692024-12-18T22:19:14.154ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38594 req_id = e8f8adbd-a7a4-4ad6-9e7f-f9d18cc6f554 response_code = 204 uri = /vpc-routes
23702024-12-18T22:19:14.304ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39893
23712024-12-18T22:19:14.304ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39893 req_id = 10d2b122-d3cd-4485-9b27-b4bb5aa6eb82 response_code = 200 uri = /v2p
23722024-12-18T22:19:14.476ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64485
23732024-12-18T22:19:14.476ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 104d2c5b-1a03-416e-83a1-9840a7797640, kind: Service { id: d0ef80fe-5a3c-4585-be47-819c465c7a37 }, name: Name("external-dns-d0ef80fe-5a3c-4585-be47-819c465c7a37"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 188, 248])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 607e1df6-370f-4c69-a01b-1dec075c60ae, kind: Service { id: 160de9b3-61fd-47fd-9883-78dcc7b014f0 }, name: Name("external-dns-160de9b3-61fd-47fd-9883-78dcc7b014f0"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 132, 76])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0bab2332-a525-46aa-9d7e-fb4af64f3c88, kind: Service { id: 9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395 }, name: Name("nexus-9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 211, 86])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: af14a7c6-4009-42e7-b00a-57c5ae0399bb, kind: Service { id: 175d3cc8-9a02-4cf3-970c-8ec76a875436 }, name: Name("nexus-175d3cc8-9a02-4cf3-970c-8ec76a875436"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 135, 206])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d048e606-7b77-4cdc-951d-7050040ab8d1, kind: Service { id: c0e3d114-075e-41a4-a4df-fa8131bbea97 }, name: Name("nexus-c0e3d114-075e-41a4-a4df-fa8131bbea97"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 155, 145])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
23742024-12-18T22:19:14.476ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23752024-12-18T22:19:14.476ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23762024-12-18T22:19:14.476ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
23772024-12-18T22:19:14.476ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23782024-12-18T22:19:14.476ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23792024-12-18T22:19:14.476ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23802024-12-18T22:19:14.476ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 270 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64485 req_id = 65b3e888-bd10-48cd-baa6-939ee76881fd response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
23812024-12-18T22:19:14.507ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50144
23822024-12-18T22:19:14.507ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23832024-12-18T22:19:14.542ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23842024-12-18T22:19:14.589ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81682 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:50144 req_id = 47e41153-41c2-4cc6-9f64-225862800fce response_code = 204 uri = /switch-ports
23852024-12-18T22:19:14.589ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50144 req_id = 7db30aa4-1e0f-47e0-8b69-da8cd37d2636 response_code = 200 uri = /network-bootstore-config
23862024-12-18T22:19:16.920ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:42093
23872024-12-18T22:19:16.920ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:42093 req_id = 340538f9-0ac9-4af7-81af-ed56045fedad response_code = 200 uri = /baseboard
23882024-12-18T22:19:41.638ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5867 local_addr = [fd00:1122:3344:101::1]:43671 method = GET remote_addr = [fd00:1122:3344:101::d]:59797 req_id = f14a4f86-a769-4b1d-be44-d1ba263eb9d4 response_code = 200 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 uri = /44b7e384-368a-4bb9-a5b4-e1c12506ebd3
23892024-12-18T22:19:42.876ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45830
23902024-12-18T22:19:42.876ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45830 req_id = 4d29a866-7aaf-4b66-a1fb-e578dff41692 response_code = 200 uri = /vpc-routes
23912024-12-18T22:19:42.927ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 values = ExternalIpGatewayMap { mappings: {} }
23922024-12-18T22:19:42.927ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45830 req_id = 5e69a7e8-f51b-4826-a0a8-74e0a620f8fe response_code = 204 uri = /eip-gateways
23932024-12-18T22:19:42.937ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 250 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45830 req_id = 90a8bdc2-f61e-4fba-9497-235ff18d8700 response_code = 204 uri = /vpc-routes
23942024-12-18T22:19:42.948ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50654
23952024-12-18T22:19:42.948ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50654 req_id = 9e1024ae-06c9-4c9c-9746-66abec5652f7 response_code = 200 uri = /vpc-routes
23962024-12-18T22:19:43.000ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 values = ExternalIpGatewayMap { mappings: {} }
23972024-12-18T22:19:43.000ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50654 req_id = ebb9febc-d5b9-4175-b375-39ead6af511e response_code = 204 uri = /eip-gateways
23982024-12-18T22:19:43.010ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50654 req_id = 50629181-8c33-4ead-be43-12915ff4cd31 response_code = 204 uri = /vpc-routes
23992024-12-18T22:19:43.043ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65456
24002024-12-18T22:19:43.043ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65456 req_id = d3cee131-6c4d-4c0f-967f-ac2f4b838eb5 response_code = 200 uri = /v2p
24012024-12-18T22:19:43.045ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47423
24022024-12-18T22:19:43.045ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24032024-12-18T22:19:43.085ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24042024-12-18T22:19:43.148ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102829 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:47423 req_id = 9597abae-e4aa-4e2e-974a-9153b2f064e2 response_code = 204 uri = /switch-ports
24052024-12-18T22:19:43.148ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60097
24062024-12-18T22:19:43.148ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58616
24072024-12-18T22:19:43.148ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24082024-12-18T22:19:43.148ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 190 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58616 req_id = 476a3e8a-5beb-4618-b5c6-356430fb8b38 response_code = 200 uri = /v2p
24092024-12-18T22:19:43.148ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 277 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47423 req_id = a49b4977-7568-413f-b060-993e24ab9a69 response_code = 200 uri = /network-bootstore-config
24102024-12-18T22:19:43.190ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24112024-12-18T22:19:43.248ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99910 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:60097 req_id = 5527b9f2-c1fb-4b40-85ec-0b80adee4333 response_code = 204 uri = /switch-ports
24122024-12-18T22:19:43.248ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60097 req_id = 42827436-34a8-452d-b77f-5eb0d3d7fd12 response_code = 200 uri = /network-bootstore-config
24132024-12-18T22:19:44.036ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37918
24142024-12-18T22:19:44.036ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37918 req_id = 62f9d0ed-4a8b-46de-b056-eeb0d3709489 response_code = 200 uri = /vpc-routes
24152024-12-18T22:19:44.060ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44044
24162024-12-18T22:19:44.061ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44044 req_id = e54f1560-c656-4a48-917e-f354930c965c response_code = 200 uri = /v2p
24172024-12-18T22:19:44.077ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 values = ExternalIpGatewayMap { mappings: {} }
24182024-12-18T22:19:44.077ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37918 req_id = f6ea932f-bcf7-49ce-9882-227bdb642729 response_code = 204 uri = /eip-gateways
24192024-12-18T22:19:44.086ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 237 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37918 req_id = 1d9abff5-a562-479c-9fd1-b11f40cabfeb response_code = 204 uri = /vpc-routes
24202024-12-18T22:19:44.108ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37566
24212024-12-18T22:19:44.108ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24222024-12-18T22:19:44.148ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24232024-12-18T22:19:44.206ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98109 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:37566 req_id = c97eccf8-8e60-479b-9a8c-b9200a8dcb36 response_code = 204 uri = /switch-ports
24242024-12-18T22:19:44.207ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37566 req_id = 775d16c5-b81d-4c96-85da-94e0e3a91864 response_code = 200 uri = /network-bootstore-config
24252024-12-18T22:19:46.953ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:63332
24262024-12-18T22:19:46.954ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:63332 req_id = 8ba1af18-6412-49ac-92b1-e758fa9d308e response_code = 200 uri = /baseboard
24272024-12-18T22:20:11.640ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6636 local_addr = [fd00:1122:3344:101::1]:43671 method = GET remote_addr = [fd00:1122:3344:101::d]:59797 req_id = 0fa71892-31d3-4aba-8fd3-bd7951b9824a response_code = 200 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 uri = /44b7e384-368a-4bb9-a5b4-e1c12506ebd3
24282024-12-18T22:20:13.117ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43679
24292024-12-18T22:20:13.117ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43679 req_id = e56d7621-f840-4f15-b9cc-bc4af7af8311 response_code = 200 uri = /vpc-routes
24302024-12-18T22:20:13.165ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 values = ExternalIpGatewayMap { mappings: {} }
24312024-12-18T22:20:13.165ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43679 req_id = fe170b13-c4be-44e9-93b9-eda229d8076a response_code = 204 uri = /eip-gateways
24322024-12-18T22:20:13.166ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44866
24332024-12-18T22:20:13.166ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44866 req_id = a0a90e4a-fc70-4bf4-913c-4ee36affb0f6 response_code = 200 uri = /vpc-routes
24342024-12-18T22:20:13.204ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37284
24352024-12-18T22:20:13.204ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37284 req_id = 8c9d231e-b943-4ebf-8631-d6cad0951f99 response_code = 200 uri = /v2p
24362024-12-18T22:20:13.217ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 values = ExternalIpGatewayMap { mappings: {} }
24372024-12-18T22:20:13.217ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44866 req_id = b7209443-9eea-4f7e-b2f0-35322a3cc020 response_code = 204 uri = /eip-gateways
24382024-12-18T22:20:13.226ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 245 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44866 req_id = 1d0362de-dd9b-4bea-ab9f-309cd8301902 response_code = 204 uri = /vpc-routes
24392024-12-18T22:20:13.279ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51291
24402024-12-18T22:20:13.279ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51291 req_id = 30c65f53-a301-4bc2-abb5-a79f36c68b51 response_code = 200 uri = /v2p
24412024-12-18T22:20:13.286ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64804
24422024-12-18T22:20:13.286ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24432024-12-18T22:20:13.328ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24442024-12-18T22:20:13.384ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97853 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:64804 req_id = c93d1d47-726c-48bf-ba8b-0ddaaccb2486 response_code = 204 uri = /switch-ports
24452024-12-18T22:20:13.384ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39059
24462024-12-18T22:20:13.384ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 438 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43679 req_id = 3738dbc9-3da1-40c4-9086-59b4f0348477 response_code = 204 uri = /vpc-routes
24472024-12-18T22:20:13.384ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24482024-12-18T22:20:13.409ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 172 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64804 req_id = b5193268-2c6a-41c7-ae43-531dfbdb1f0c response_code = 200 uri = /network-bootstore-config
24492024-12-18T22:20:13.425ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24502024-12-18T22:20:13.494ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109935 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:39059 req_id = ebefa486-60c2-4f2c-bb19-9c1d873c8094 response_code = 204 uri = /switch-ports
24512024-12-18T22:20:13.494ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39059 req_id = 5c1d8e57-5caa-4407-8840-966ad6f8f522 response_code = 200 uri = /network-bootstore-config
24522024-12-18T22:20:14.070ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64135
24532024-12-18T22:20:14.071ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64135 req_id = 25878c8a-d9d5-40e6-8a1b-0cd343984525 response_code = 200 uri = /vpc-routes
24542024-12-18T22:20:14.126ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 values = ExternalIpGatewayMap { mappings: {} }
24552024-12-18T22:20:14.126ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64135 req_id = 3ad33672-7bb7-4252-b32e-97e58a3babd2 response_code = 204 uri = /eip-gateways
24562024-12-18T22:20:14.136ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 267 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64135 req_id = 126f1489-7fba-47fb-a384-7b3490794bdf response_code = 204 uri = /vpc-routes
24572024-12-18T22:20:14.618ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46290
24582024-12-18T22:20:14.619ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46290 req_id = c1194688-a54b-4fbd-a5f9-956c592c64c7 response_code = 200 uri = /v2p
24592024-12-18T22:20:14.635ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56294
24602024-12-18T22:20:14.635ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24612024-12-18T22:20:14.674ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24622024-12-18T22:20:14.729ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93693 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:56294 req_id = 76bada31-2e3c-4588-aedd-ce87d971fbe3 response_code = 204 uri = /switch-ports
24632024-12-18T22:20:14.729ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56294 req_id = 6237152f-5882-40ee-af70-57c99da2f183 response_code = 200 uri = /network-bootstore-config
24642024-12-18T22:20:16.988ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:51428
24652024-12-18T22:20:16.988ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:51428 req_id = 0e7230eb-9f23-4c1f-8b1d-31d9262d9bed response_code = 200 uri = /baseboard
24662024-12-18T22:20:41.641ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6611 local_addr = [fd00:1122:3344:101::1]:43671 method = GET remote_addr = [fd00:1122:3344:101::d]:59797 req_id = 66b4f233-02c0-4378-9582-9f1b5de7686c response_code = 200 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 uri = /44b7e384-368a-4bb9-a5b4-e1c12506ebd3
24672024-12-18T22:20:42.971ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39606
24682024-12-18T22:20:42.971ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39606 req_id = b39140f5-cd31-44c1-82f9-c331b8d8c73b response_code = 200 uri = /vpc-routes
24692024-12-18T22:20:42.991ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41071
24702024-12-18T22:20:42.991ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41071 req_id = d4e5e68c-d52b-43ff-a3dc-5d3ea757dad3 response_code = 200 uri = /vpc-routes
24712024-12-18T22:20:43.026ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 values = ExternalIpGatewayMap { mappings: {} }
24722024-12-18T22:20:43.026ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39606 req_id = ba153a0d-419d-4897-9ce9-4f1998e8af05 response_code = 204 uri = /eip-gateways
24732024-12-18T22:20:43.035ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 values = ExternalIpGatewayMap { mappings: {} }
24742024-12-18T22:20:43.035ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 21 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41071 req_id = de41ee8d-ff5e-4a22-baed-79aefff06833 response_code = 204 uri = /eip-gateways
24752024-12-18T22:20:43.036ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 205 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39606 req_id = 1c60f922-536c-4acc-9bf9-3dc30fe902a3 response_code = 204 uri = /vpc-routes
24762024-12-18T22:20:43.044ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41071 req_id = a709d5f2-3b29-4bd3-8766-8543ea18c97c response_code = 204 uri = /vpc-routes
24772024-12-18T22:20:43.080ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57296
24782024-12-18T22:20:43.080ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57296 req_id = 739dbd40-b18c-436b-9c58-e1ffdbde2bd7 response_code = 200 uri = /v2p
24792024-12-18T22:20:43.094ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38454
24802024-12-18T22:20:43.094ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24812024-12-18T22:20:43.129ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24822024-12-18T22:20:43.186ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92071 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:38454 req_id = 7be79933-d4aa-4ed7-b98a-fd7ab14ee967 response_code = 204 uri = /switch-ports
24832024-12-18T22:20:43.186ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39433
24842024-12-18T22:20:43.186ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61384
24852024-12-18T22:20:43.187ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24862024-12-18T22:20:43.191ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3793 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39433 req_id = c769b330-8050-470d-858f-d6d461ae9288 response_code = 200 uri = /v2p
24872024-12-18T22:20:43.191ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3914 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38454 req_id = 2d62cf01-44a8-4696-b5db-36683c1fd338 response_code = 200 uri = /network-bootstore-config
24882024-12-18T22:20:43.222ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24892024-12-18T22:20:43.275ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88507 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:61384 req_id = 07359828-9afd-4407-9f25-48ea13ddb69f response_code = 204 uri = /switch-ports
24902024-12-18T22:20:43.275ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61384 req_id = 3bc33de5-1728-44be-879a-e47ca5e49278 response_code = 200 uri = /network-bootstore-config
24912024-12-18T22:20:44.100ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56620
24922024-12-18T22:20:44.100ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56620 req_id = 9ea32a34-28a9-43f3-953c-6792e9db5eb0 response_code = 200 uri = /vpc-routes
24932024-12-18T22:20:44.114ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 values = ExternalIpGatewayMap { mappings: {} }
24942024-12-18T22:20:44.114ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56620 req_id = ae21c314-03ef-4ebb-abcf-a1cffb5c73a7 response_code = 204 uri = /eip-gateways
24952024-12-18T22:20:44.123ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56620 req_id = c40a03a4-1304-4340-9a06-fb72be0ee905 response_code = 204 uri = /vpc-routes
24962024-12-18T22:20:44.183ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46941
24972024-12-18T22:20:44.183ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46941 req_id = caf2e6bd-4c08-42f7-9f0b-4e1af9ca9eec response_code = 200 uri = /v2p
24982024-12-18T22:20:44.185ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45862
24992024-12-18T22:20:44.185ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25002024-12-18T22:20:44.224ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25012024-12-18T22:20:44.277ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91735 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:45862 req_id = 11b736c7-e662-45ad-af34-a7a80e9292f5 response_code = 204 uri = /switch-ports
25022024-12-18T22:20:44.277ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45862 req_id = 4bab2a44-4e06-4d0b-a5ef-e472ada20d24 response_code = 200 uri = /network-bootstore-config
25032024-12-18T22:20:47.021ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:63523
25042024-12-18T22:20:47.022ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:63523 req_id = fa85b213-4358-48e2-8752-6f427845e707 response_code = 200 uri = /baseboard
25052024-12-18T22:20:55.954ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:197
25062024-12-18T22:20:55.954ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:608
25072024-12-18T22:20:55.986ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1946, tv_nsec: 606564091 } time_to_next_cleanup = 599.999997291s
25082024-12-18T22:21:09.789ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
25092024-12-18T22:21:11.641ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6246 local_addr = [fd00:1122:3344:101::1]:43671 method = GET remote_addr = [fd00:1122:3344:101::d]:59797 req_id = e6fac07a-c045-4766-bb04-99c9db22b2de response_code = 200 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 uri = /44b7e384-368a-4bb9-a5b4-e1c12506ebd3
25102024-12-18T22:21:13.057ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36552
25112024-12-18T22:21:13.057ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36552 req_id = 4764ce09-1077-4c03-a79a-187a26b8090b response_code = 200 uri = /vpc-routes
25122024-12-18T22:21:13.114ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 values = ExternalIpGatewayMap { mappings: {} }
25132024-12-18T22:21:13.114ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36552 req_id = 7c659fae-232b-4128-9efe-8e32839e9b08 response_code = 204 uri = /eip-gateways
25142024-12-18T22:21:13.208ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54498
25152024-12-18T22:21:13.208ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 30 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54498 req_id = 8f2552c3-7c19-4928-9f68-88f24550d6aa response_code = 200 uri = /vpc-routes
25162024-12-18T22:21:13.223ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63873
25172024-12-18T22:21:13.223ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63873 req_id = 1e716e58-53b9-46d7-9fef-721e38c1a408 response_code = 200 uri = /v2p
25182024-12-18T22:21:13.226ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 247 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36552 req_id = 72781f36-66e4-499a-ba4f-02f767880303 response_code = 204 uri = /vpc-routes
25192024-12-18T22:21:13.251ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 values = ExternalIpGatewayMap { mappings: {} }
25202024-12-18T22:21:13.251ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54498 req_id = e15a0ac9-acd8-4514-946c-a11a2e5b0d11 response_code = 204 uri = /eip-gateways
25212024-12-18T22:21:13.277ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59783
25222024-12-18T22:21:13.277ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59783 req_id = 7fece1e6-6852-4e33-a089-c9b25e41da65 response_code = 200 uri = /v2p
25232024-12-18T22:21:13.280ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 223 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54498 req_id = 08bab6f5-d802-4e14-9df7-5b29dd6f10f8 response_code = 204 uri = /vpc-routes
25242024-12-18T22:21:13.319ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35386
25252024-12-18T22:21:13.319ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25262024-12-18T22:21:13.358ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25272024-12-18T22:21:13.413ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93117 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:35386 req_id = 419469ac-9201-42ed-994c-2a7c84b69279 response_code = 204 uri = /switch-ports
25282024-12-18T22:21:13.413ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55006
25292024-12-18T22:21:13.413ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25302024-12-18T22:21:13.416ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3367 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35386 req_id = b9fa23a3-e2f4-43d0-8eb5-35be6b894ab2 response_code = 200 uri = /network-bootstore-config
25312024-12-18T22:21:13.450ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25322024-12-18T22:21:13.505ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92363 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:55006 req_id = 02139805-f7c4-4c93-afb6-d5c68667622a response_code = 204 uri = /switch-ports
25332024-12-18T22:21:13.506ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55006 req_id = 63ef9161-51ed-4d8c-bb86-bb66c0cd4667 response_code = 200 uri = /network-bootstore-config
25342024-12-18T22:21:14.099ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44310
25352024-12-18T22:21:14.099ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44310 req_id = 3ee201f6-9be9-40b8-aace-db2dc50ae15c response_code = 200 uri = /vpc-routes
25362024-12-18T22:21:14.116ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 values = ExternalIpGatewayMap { mappings: {} }
25372024-12-18T22:21:14.116ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44310 req_id = bc5b75d8-ba3e-45ee-859b-ce1cdc52f4a4 response_code = 204 uri = /eip-gateways
25382024-12-18T22:21:14.125ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 230 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44310 req_id = 61c5a6b3-b739-40b1-80c7-679b648d4ce7 response_code = 204 uri = /vpc-routes
25392024-12-18T22:21:14.270ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37199
25402024-12-18T22:21:14.270ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37199 req_id = ecdb154e-837d-4d67-bf9e-0ad9ad29f142 response_code = 200 uri = /v2p
25412024-12-18T22:21:14.337ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36000
25422024-12-18T22:21:14.338ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25432024-12-18T22:21:14.374ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25442024-12-18T22:21:14.434ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96484 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:36000 req_id = 4ae856f4-09b1-44c4-89c3-ab6e24315909 response_code = 204 uri = /switch-ports
25452024-12-18T22:21:14.434ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36000 req_id = 59a316b8-ff4e-4265-bdab-735799b11fae response_code = 200 uri = /network-bootstore-config
25462024-12-18T22:21:17.054ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:61340
25472024-12-18T22:21:17.054ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:61340 req_id = 62fe447b-ce2f-441c-9cbf-14300937bc1a response_code = 200 uri = /baseboard
25482024-12-18T22:21:41.641ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5967 local_addr = [fd00:1122:3344:101::1]:43671 method = GET remote_addr = [fd00:1122:3344:101::d]:59797 req_id = 8beaf83c-236c-4a82-8150-a2b6eaf2565d response_code = 200 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 uri = /44b7e384-368a-4bb9-a5b4-e1c12506ebd3
25492024-12-18T22:21:42.856ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61913
25502024-12-18T22:21:42.856ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61913 req_id = 4b98707c-9abc-47b6-84a3-6fcc0ebf6429 response_code = 200 uri = /vpc-routes
25512024-12-18T22:21:42.903ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 values = ExternalIpGatewayMap { mappings: {} }
25522024-12-18T22:21:42.903ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61913 req_id = fd327dbb-ee3f-4ce1-a1e1-e8acdf8f81ba response_code = 204 uri = /eip-gateways
25532024-12-18T22:21:42.910ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52095
25542024-12-18T22:21:42.910ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52095 req_id = bd9edb68-d965-4456-aff1-5593a0103ffd response_code = 200 uri = /vpc-routes
25552024-12-18T22:21:42.920ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 298 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61913 req_id = c75435df-2a47-4a1f-8f5a-58b1fea93ce2 response_code = 204 uri = /vpc-routes
25562024-12-18T22:21:42.925ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 values = ExternalIpGatewayMap { mappings: {} }
25572024-12-18T22:21:42.925ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52095 req_id = f9daba7f-f90c-4107-a7da-a010dd24d4d0 response_code = 204 uri = /eip-gateways
25582024-12-18T22:21:42.934ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 243 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52095 req_id = 00c0b0ce-dfa3-4408-a545-ca6d805d4b39 response_code = 204 uri = /vpc-routes
25592024-12-18T22:21:43.040ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36286
25602024-12-18T22:21:43.040ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36286 req_id = 6aed6672-c62b-4699-aa0e-7e6f96e55a75 response_code = 200 uri = /v2p
25612024-12-18T22:21:43.073ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61044
25622024-12-18T22:21:43.073ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61044 req_id = f74c91cd-dca0-4a12-81b8-ad9d16766dac response_code = 200 uri = /v2p
25632024-12-18T22:21:43.103ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39359
25642024-12-18T22:21:43.103ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25652024-12-18T22:21:43.143ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25662024-12-18T22:21:43.199ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96217 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:39359 req_id = 58d9ce4a-b2bc-40ec-83da-c3907096ca8c response_code = 204 uri = /switch-ports
25672024-12-18T22:21:43.199ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54247
25682024-12-18T22:21:43.199ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25692024-12-18T22:21:43.234ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25702024-12-18T22:21:43.290ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90890 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:54247 req_id = dc7f8c84-120a-426f-8544-7816fa0c260e response_code = 204 uri = /switch-ports
25712024-12-18T22:21:43.290ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39359 req_id = 5a2bf310-825b-41a3-a641-980b8929d351 response_code = 200 uri = /network-bootstore-config
25722024-12-18T22:21:43.291ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 173 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54247 req_id = d7331514-feb0-4a87-9699-900917b62a75 response_code = 200 uri = /network-bootstore-config
25732024-12-18T22:21:44.030ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43841
25742024-12-18T22:21:44.030ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43841 req_id = d3b83462-16ad-470e-97a6-275b633a26d8 response_code = 200 uri = /v2p
25752024-12-18T22:21:44.124ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34783
25762024-12-18T22:21:44.124ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 27 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34783 req_id = 27ae209e-6974-4628-9566-791f8d049a72 response_code = 200 uri = /vpc-routes
25772024-12-18T22:21:44.138ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 values = ExternalIpGatewayMap { mappings: {} }
25782024-12-18T22:21:44.138ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34783 req_id = 85efe175-0e1d-48ee-9846-66bbee1a2137 response_code = 204 uri = /eip-gateways
25792024-12-18T22:21:44.147ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34783 req_id = 6a7df603-85ca-47d7-aacb-aa275ef19e90 response_code = 204 uri = /vpc-routes
25802024-12-18T22:21:44.174ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62113
25812024-12-18T22:21:44.174ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25822024-12-18T22:21:44.212ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25832024-12-18T22:21:44.269ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94418 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:62113 req_id = b8743587-d981-40fb-96c0-78e280b0004f response_code = 204 uri = /switch-ports
25842024-12-18T22:21:44.269ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62113 req_id = b2c25fa2-b8fb-4d7a-bc5c-7d63de9eec28 response_code = 200 uri = /network-bootstore-config
25852024-12-18T22:21:47.087ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49826
25862024-12-18T22:21:47.087ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49826 req_id = f149312a-715d-4b33-839e-0ac9d4a65a56 response_code = 200 uri = /baseboard
25872024-12-18T22:22:11.640ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4903 local_addr = [fd00:1122:3344:101::1]:43671 method = GET remote_addr = [fd00:1122:3344:101::d]:59797 req_id = b4ba9182-970c-49aa-83ed-30fdde74c682 response_code = 200 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 uri = /44b7e384-368a-4bb9-a5b4-e1c12506ebd3
25882024-12-18T22:22:13.078ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51527
25892024-12-18T22:22:13.078ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51527 req_id = 20789241-6098-4f84-9fa6-80784e4abc3c response_code = 200 uri = /v2p
25902024-12-18T22:22:13.120ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47630
25912024-12-18T22:22:13.120ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47630 req_id = 784d154a-9b80-4424-979e-ec99a41b5f3b response_code = 200 uri = /vpc-routes
25922024-12-18T22:22:13.136ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 values = ExternalIpGatewayMap { mappings: {} }
25932024-12-18T22:22:13.136ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47630 req_id = 92da3b4b-2bad-41da-8baf-23e334ae9712 response_code = 204 uri = /eip-gateways
25942024-12-18T22:22:13.144ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 262 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47630 req_id = 984bbbb1-666d-40a0-a01c-e736877b39b1 response_code = 204 uri = /vpc-routes
25952024-12-18T22:22:13.210ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45189
25962024-12-18T22:22:13.210ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45189 req_id = 76d7c27c-2c0c-4e2b-a80c-a288889c5052 response_code = 200 uri = /v2p
25972024-12-18T22:22:13.271ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46194
25982024-12-18T22:22:13.271ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25992024-12-18T22:22:13.311ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26002024-12-18T22:22:13.369ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97787 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:46194 req_id = 4ec08f8a-195c-4b2c-b780-4f34470769a9 response_code = 204 uri = /switch-ports
26012024-12-18T22:22:13.369ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39905
26022024-12-18T22:22:13.369ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39905 req_id = 831c3b3f-e65c-45a9-afdd-38cffd577a88 response_code = 200 uri = /vpc-routes
26032024-12-18T22:22:13.369ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 230 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46194 req_id = 29d01fd3-3a58-4576-b3e5-ff12bbfcf202 response_code = 200 uri = /network-bootstore-config
26042024-12-18T22:22:13.390ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 values = ExternalIpGatewayMap { mappings: {} }
26052024-12-18T22:22:13.390ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39905 req_id = 22f76318-db4c-4921-a995-9aaa87d0e7cd response_code = 204 uri = /eip-gateways
26062024-12-18T22:22:13.399ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 252 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39905 req_id = 671ba825-010c-4752-9157-2c4bfda99d75 response_code = 204 uri = /vpc-routes
26072024-12-18T22:22:13.471ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49773
26082024-12-18T22:22:13.471ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26092024-12-18T22:22:13.508ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26102024-12-18T22:22:13.563ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91432 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:49773 req_id = dab6339c-1dda-4a5a-b8aa-0bf375a667d8 response_code = 204 uri = /switch-ports
26112024-12-18T22:22:13.563ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49773 req_id = 6e2e1e4c-ec9e-4ebb-bf46-636fdefcd538 response_code = 200 uri = /network-bootstore-config
26122024-12-18T22:22:14.198ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45968
26132024-12-18T22:22:14.198ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45968 req_id = 4e7b83f7-b913-4a37-8f7f-7a98abdb66e9 response_code = 200 uri = /vpc-routes
26142024-12-18T22:22:14.225ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62237
26152024-12-18T22:22:14.225ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62237 req_id = 590b0a04-dd7e-4aba-b1dc-c0d639aed68d response_code = 200 uri = /v2p
26162024-12-18T22:22:14.239ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 values = ExternalIpGatewayMap { mappings: {} }
26172024-12-18T22:22:14.239ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45968 req_id = f9ac3aae-e1d5-459c-baaf-873b89453f76 response_code = 204 uri = /eip-gateways
26182024-12-18T22:22:14.251ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 231 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45968 req_id = 6f7579c8-7d76-4844-9e85-55b0b380654a response_code = 204 uri = /vpc-routes
26192024-12-18T22:22:14.568ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50736
26202024-12-18T22:22:14.568ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26212024-12-18T22:22:14.608ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26222024-12-18T22:22:14.666ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97500 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:50736 req_id = 689f2c5b-8052-4990-90f3-fddebff26e38 response_code = 204 uri = /switch-ports
26232024-12-18T22:22:14.666ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50736 req_id = e532fe93-a241-4c43-ae4a-48fa4aa6c5f8 response_code = 200 uri = /network-bootstore-config
26242024-12-18T22:22:17.125ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:60900
26252024-12-18T22:22:17.125ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:60900 req_id = 7b8faffb-702b-43d5-b9d8-50304abd79ef response_code = 200 uri = /baseboard
26262024-12-18T22:22:41.642ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5718 local_addr = [fd00:1122:3344:101::1]:43671 method = GET remote_addr = [fd00:1122:3344:101::d]:59797 req_id = fb4d2a7b-958f-47ef-913a-5492ab272a3e response_code = 200 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 uri = /44b7e384-368a-4bb9-a5b4-e1c12506ebd3
26272024-12-18T22:22:42.965ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46533
26282024-12-18T22:22:42.965ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46533 req_id = 1006b5fc-f8a4-4858-80e7-e568c0616d38 response_code = 200 uri = /vpc-routes
26292024-12-18T22:22:43.008ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 values = ExternalIpGatewayMap { mappings: {} }
26302024-12-18T22:22:43.008ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46533 req_id = 17d3e713-9d95-4e87-a704-422fe122608e response_code = 204 uri = /eip-gateways
26312024-12-18T22:22:43.019ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 242 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46533 req_id = e91bab2a-c0c3-44bd-a09f-c748fac7f2d9 response_code = 204 uri = /vpc-routes
26322024-12-18T22:22:43.031ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39752
26332024-12-18T22:22:43.031ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 20 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39752 req_id = 2645062d-7434-4916-b5cd-82d69bb0f63e response_code = 200 uri = /vpc-routes
26342024-12-18T22:22:43.045ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57987
26352024-12-18T22:22:43.045ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26362024-12-18T22:22:43.089ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26372024-12-18T22:22:43.148ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103716 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:57987 req_id = 49064ce7-7ee4-4204-a66a-45e7d374c86a response_code = 204 uri = /switch-ports
26382024-12-18T22:22:43.149ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48314
26392024-12-18T22:22:43.149ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 values = ExternalIpGatewayMap { mappings: {} }
26402024-12-18T22:22:43.149ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39752 req_id = 338650ef-3127-4499-91f2-b9c949dff85c response_code = 204 uri = /eip-gateways
26412024-12-18T22:22:43.149ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 221 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57987 req_id = 293664ff-0b76-4f8f-950c-28441b5485d5 response_code = 200 uri = /network-bootstore-config
26422024-12-18T22:22:43.149ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 192 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48314 req_id = bad15a50-4022-4b73-8a5c-1cf62bd557b1 response_code = 200 uri = /v2p
26432024-12-18T22:22:43.160ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 265 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39752 req_id = 6cf16317-5764-4c68-aee4-283bb1e51b48 response_code = 204 uri = /vpc-routes
26442024-12-18T22:22:43.160ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64244
26452024-12-18T22:22:43.160ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26462024-12-18T22:22:43.194ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26472024-12-18T22:22:43.252ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92225 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:64244 req_id = ee85050a-09c2-4a1d-af4b-203b8a52f107 response_code = 204 uri = /switch-ports
26482024-12-18T22:22:43.252ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45353
26492024-12-18T22:22:43.253ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 190 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45353 req_id = a7d79370-1817-4d92-bab7-83d50f9ee7f0 response_code = 200 uri = /v2p
26502024-12-18T22:22:43.253ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 200 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64244 req_id = 174e7add-cb57-4b42-8ade-685e18039296 response_code = 200 uri = /network-bootstore-config
26512024-12-18T22:22:44.011ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47232
26522024-12-18T22:22:44.011ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47232 req_id = 6a10627a-b397-462c-b8b9-4e96ef2fd9d9 response_code = 200 uri = /vpc-routes
26532024-12-18T22:22:44.052ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 values = ExternalIpGatewayMap { mappings: {} }
26542024-12-18T22:22:44.052ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47232 req_id = 72865174-ac7a-447d-9e6f-fb80b41ffff1 response_code = 204 uri = /eip-gateways
26552024-12-18T22:22:44.062ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47232 req_id = 416fdcdc-99ab-4a41-abaa-edb505e476ad response_code = 204 uri = /vpc-routes
26562024-12-18T22:22:44.069ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49276
26572024-12-18T22:22:44.069ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26582024-12-18T22:22:44.107ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26592024-12-18T22:22:44.164ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95390 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:49276 req_id = d17e5f8d-6cbe-4f23-91d3-80dd62cca8da response_code = 204 uri = /switch-ports
26602024-12-18T22:22:44.164ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37703
26612024-12-18T22:22:44.164ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 213 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37703 req_id = 59a43186-01df-433a-9b47-37f88a405ed9 response_code = 200 uri = /v2p
26622024-12-18T22:22:44.165ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 239 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49276 req_id = 40d82c9c-2c7f-411f-9baf-59d5754bf9ce response_code = 200 uri = /network-bootstore-config
26632024-12-18T22:22:47.159ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:33948
26642024-12-18T22:22:47.159ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:33948 req_id = 2ea58670-85cf-4735-9c44-1a5df85d17f7 response_code = 200 uri = /baseboard
26652024-12-18T22:23:11.643ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6345 local_addr = [fd00:1122:3344:101::1]:43671 method = GET remote_addr = [fd00:1122:3344:101::d]:59797 req_id = 06a309b9-ea26-4b23-b591-ab6f3e6fbb82 response_code = 200 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 uri = /44b7e384-368a-4bb9-a5b4-e1c12506ebd3
26662024-12-18T22:23:13.079ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43685
26672024-12-18T22:23:13.079ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43685 req_id = e31b912a-73e6-46c2-9447-bb552f37105c response_code = 200 uri = /vpc-routes
26682024-12-18T22:23:13.139ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 values = ExternalIpGatewayMap { mappings: {} }
26692024-12-18T22:23:13.139ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43685 req_id = 6b24ca73-5040-4203-a0ab-d6459ceac14f response_code = 204 uri = /eip-gateways
26702024-12-18T22:23:13.147ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58171
26712024-12-18T22:23:13.147ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58171 req_id = 859bd712-1931-4351-8c0d-946ffbe9f1a2 response_code = 200 uri = /vpc-routes
26722024-12-18T22:23:13.150ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 247 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43685 req_id = 000ac76a-76b9-49d6-8402-904524e8d84c response_code = 204 uri = /vpc-routes
26732024-12-18T22:23:13.165ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 values = ExternalIpGatewayMap { mappings: {} }
26742024-12-18T22:23:13.165ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58171 req_id = 13b7454c-d88a-4925-ad53-3940fc644710 response_code = 204 uri = /eip-gateways
26752024-12-18T22:23:13.176ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58171 req_id = 8bd14551-d921-499b-b690-59c2f99089eb response_code = 204 uri = /vpc-routes
26762024-12-18T22:23:13.207ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62931
26772024-12-18T22:23:13.207ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62931 req_id = ce20feb4-8a54-4260-8267-8d7ef74cbf7f response_code = 200 uri = /v2p
26782024-12-18T22:23:13.225ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50653
26792024-12-18T22:23:13.225ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26802024-12-18T22:23:13.280ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26812024-12-18T22:23:13.360ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 135421 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:50653 req_id = 6a82ea12-54b4-41de-b091-302a5fe57e1d response_code = 204 uri = /switch-ports
26822024-12-18T22:23:13.361ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65487
26832024-12-18T22:23:13.361ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 269 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50653 req_id = 55e26be7-ac93-45b5-83cb-6e0e14782f92 response_code = 200 uri = /network-bootstore-config
26842024-12-18T22:23:13.361ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 235 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65487 req_id = 63c07eed-539e-4ce6-b802-c61917e1aa49 response_code = 200 uri = /v2p
26852024-12-18T22:23:13.373ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46464
26862024-12-18T22:23:13.373ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26872024-12-18T22:23:13.411ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26882024-12-18T22:23:13.475ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101905 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:46464 req_id = 02fe1cf5-00f7-43fb-8664-d14ca1e8c6df response_code = 204 uri = /switch-ports
26892024-12-18T22:23:13.475ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 288 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46464 req_id = bd0991f4-7817-49c2-917c-5b7a5cd05477 response_code = 200 uri = /network-bootstore-config
26902024-12-18T22:23:14.112ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56619
26912024-12-18T22:23:14.112ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56619 req_id = 4fa137fa-5702-456e-9bd7-5b01921639b3 response_code = 200 uri = /v2p
26922024-12-18T22:23:14.278ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45133
26932024-12-18T22:23:14.278ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 27 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45133 req_id = c8fbff8e-f707-471e-aed9-005ad37cde33 response_code = 200 uri = /vpc-routes
26942024-12-18T22:23:14.292ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 values = ExternalIpGatewayMap { mappings: {} }
26952024-12-18T22:23:14.292ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45133 req_id = 87878fbe-327f-4e8a-a1cb-b2b7321876bc response_code = 204 uri = /eip-gateways
26962024-12-18T22:23:14.301ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 219 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45133 req_id = 6a89f0d8-64f8-4adc-ac70-934c7ebf5541 response_code = 204 uri = /vpc-routes
26972024-12-18T22:23:14.380ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42862
26982024-12-18T22:23:14.381ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26992024-12-18T22:23:14.420ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27002024-12-18T22:23:14.478ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97248 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:42862 req_id = ff5546ce-a64b-426b-aa2a-8805f6347e2b response_code = 204 uri = /switch-ports
27012024-12-18T22:23:14.478ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42862 req_id = 790aaba1-7f37-419f-9748-f151fedb1560 response_code = 200 uri = /network-bootstore-config
27022024-12-18T22:23:17.193ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:32932
27032024-12-18T22:23:17.193ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:32932 req_id = 467f7d67-aae9-457e-ab91-b8a3e85c8287 response_code = 200 uri = /baseboard
27042024-12-18T22:23:41.643ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5803 local_addr = [fd00:1122:3344:101::1]:43671 method = GET remote_addr = [fd00:1122:3344:101::d]:59797 req_id = 7db2fbec-c433-400a-a7e1-68247e600f51 response_code = 200 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 uri = /44b7e384-368a-4bb9-a5b4-e1c12506ebd3
27052024-12-18T22:23:42.992ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34231
27062024-12-18T22:23:42.993ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34231 req_id = 3de75a17-e3a7-4e11-9ecc-bc837ed64d5c response_code = 200 uri = /vpc-routes
27072024-12-18T22:23:43.038ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43895
27082024-12-18T22:23:43.039ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 26 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43895 req_id = 5d24aba8-70ba-47f5-a79c-285edde8ccc4 response_code = 200 uri = /vpc-routes
27092024-12-18T22:23:43.053ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 values = ExternalIpGatewayMap { mappings: {} }
27102024-12-18T22:23:43.053ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43895 req_id = 12dd1fce-b9c3-4fb1-a8d3-4c6c008cd4fa response_code = 204 uri = /eip-gateways
27112024-12-18T22:23:43.060ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41620
27122024-12-18T22:23:43.060ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41620 req_id = 5ec28936-50e9-4e74-b550-dfd73ff521c0 response_code = 200 uri = /v2p
27132024-12-18T22:23:43.110ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 values = ExternalIpGatewayMap { mappings: {} }
27142024-12-18T22:23:43.110ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34231 req_id = 0ad1f90c-e13d-4224-b447-6fb57283bb53 response_code = 204 uri = /eip-gateways
27152024-12-18T22:23:43.116ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57524
27162024-12-18T22:23:43.116ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27172024-12-18T22:23:43.154ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27182024-12-18T22:23:43.220ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103855 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:57524 req_id = d4b76400-bfe1-4d08-ae56-c4d9d18b06e6 response_code = 204 uri = /switch-ports
27192024-12-18T22:23:43.220ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55839
27202024-12-18T22:23:43.220ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38289
27212024-12-18T22:23:43.221ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 340 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57524 req_id = 88c0311f-e2a9-412f-8036-6eae25b86704 response_code = 200 uri = /network-bootstore-config
27222024-12-18T22:23:43.221ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27232024-12-18T22:23:43.226ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5618 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43895 req_id = 39a344ef-6260-48ac-a08f-b6e106fc14b3 response_code = 204 uri = /vpc-routes
27242024-12-18T22:23:43.226ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5641 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34231 req_id = 7313899e-6404-4938-a5b7-661787350ddf response_code = 204 uri = /vpc-routes
27252024-12-18T22:23:43.226ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5416 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55839 req_id = e80911a9-6af0-4558-867e-22d94081bb3b response_code = 200 uri = /v2p
27262024-12-18T22:23:43.258ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27272024-12-18T22:23:43.308ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87342 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:38289 req_id = 8c557d85-8b3c-4946-b2e2-b394facf506d response_code = 204 uri = /switch-ports
27282024-12-18T22:23:43.310ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38289 req_id = 959ed152-5ffa-41d7-a17f-673ebb7bfea1 response_code = 200 uri = /network-bootstore-config
27292024-12-18T22:23:43.930ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39482
27302024-12-18T22:23:43.930ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39482 req_id = d807099f-4ca2-43d7-b4cc-eaf7724f61d0 response_code = 200 uri = /vpc-routes
27312024-12-18T22:23:43.974ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 values = ExternalIpGatewayMap { mappings: {} }
27322024-12-18T22:23:43.974ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39482 req_id = 3e77e014-0030-487b-8291-572e6839688b response_code = 204 uri = /eip-gateways
27332024-12-18T22:23:43.986ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 277 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39482 req_id = 86bb2962-2930-412b-b524-881617bfbbd6 response_code = 204 uri = /vpc-routes
27342024-12-18T22:23:44.108ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57928
27352024-12-18T22:23:44.108ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57928 req_id = db93a437-3794-4def-902e-e7031c4cbd13 response_code = 200 uri = /v2p
27362024-12-18T22:23:44.158ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57655
27372024-12-18T22:23:44.158ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27382024-12-18T22:23:44.197ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27392024-12-18T22:23:44.252ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94361 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:57655 req_id = 812a993e-c314-4509-86ed-3c05da7a1bd8 response_code = 204 uri = /switch-ports
27402024-12-18T22:23:44.253ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57655 req_id = 284f354e-5e37-48ff-b85b-3084ff0e5d44 response_code = 200 uri = /network-bootstore-config
27412024-12-18T22:23:47.227ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36151
27422024-12-18T22:23:47.228ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36151 req_id = d450b27b-8af5-4705-a281-08f208338449 response_code = 200 uri = /baseboard
27432024-12-18T22:24:11.648ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 12167 local_addr = [fd00:1122:3344:101::1]:43671 method = GET remote_addr = [fd00:1122:3344:101::d]:59797 req_id = 3dff786a-7756-47c9-af32-84d5b87dc322 response_code = 200 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 uri = /44b7e384-368a-4bb9-a5b4-e1c12506ebd3
27442024-12-18T22:24:13.087ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63942
27452024-12-18T22:24:13.088ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63942 req_id = 73e95620-794e-468c-9167-bdec03b62a12 response_code = 200 uri = /vpc-routes
27462024-12-18T22:24:13.123ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61900
27472024-12-18T22:24:13.123ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61900 req_id = 757b97b8-1c8b-48cc-bbe0-1c40aba1cc1f response_code = 200 uri = /vpc-routes
27482024-12-18T22:24:13.138ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 values = ExternalIpGatewayMap { mappings: {} }
27492024-12-18T22:24:13.138ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63942 req_id = 09c2cf29-e924-428b-b7d4-4bb285a890ea response_code = 204 uri = /eip-gateways
27502024-12-18T22:24:13.146ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 values = ExternalIpGatewayMap { mappings: {} }
27512024-12-18T22:24:13.146ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61900 req_id = e1a6358e-1e3d-4f77-9279-b2aa3f44acf9 response_code = 204 uri = /eip-gateways
27522024-12-18T22:24:13.148ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 300 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63942 req_id = 66a1f67f-9d3a-4395-bd19-ba74e5cb14c2 response_code = 204 uri = /vpc-routes
27532024-12-18T22:24:13.221ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40681
27542024-12-18T22:24:13.221ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:608
27552024-12-18T22:24:13.221ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:608
27562024-12-18T22:24:13.222ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/f4e49932-892e-4e15-afe7-919d71bd3012/config/omicron-zones.json file = common/src/ledger.rs:177
27572024-12-18T22:24:13.222ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/de0dd618-e464-453d-9394-6cb21d5dbefa/config/omicron-zones.json file = common/src/ledger.rs:177
27582024-12-18T22:24:13.237ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7527a580-440a-4d33-b9e5-9f4ac1126696 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:608
27592024-12-18T22:24:13.237ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1119 request = datasets_list zpool = oxp_7527a580-440a-4d33-b9e5-9f4ac1126696
27602024-12-18T22:24:13.264ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8d122e51-f03c-4659-8af4-3a5baca809c5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:608
27612024-12-18T22:24:13.264ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1119 request = datasets_list zpool = oxp_8d122e51-f03c-4659-8af4-3a5baca809c5
27622024-12-18T22:24:13.273ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59332
27632024-12-18T22:24:13.273ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 180 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59332 req_id = 51d4df5a-8d07-410a-990a-17acc179b8f0 response_code = 200 uri = /v2p
27642024-12-18T22:24:13.283ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1172 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61900 req_id = d0b2cfc2-e412-4ff8-99b6-8cb1539000f8 response_code = 204 uri = /vpc-routes
27652024-12-18T22:24:13.283ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50591
27662024-12-18T22:24:13.285ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50591 req_id = 2edf27f4-3c68-4f79-8544-83d947e13d9d response_code = 200 uri = /v2p
27672024-12-18T22:24:13.290ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62786
27682024-12-18T22:24:13.290ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27692024-12-18T22:24:13.294ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ebfff57f-9cb4-47bd-acd3-b83eb13e21b5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:608
27702024-12-18T22:24:13.294ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1119 request = datasets_list zpool = oxp_ebfff57f-9cb4-47bd-acd3-b83eb13e21b5
27712024-12-18T22:24:13.327ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d7b58ec6-9f7e-464f-b0dc-a0d484ac88ac (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:608
27722024-12-18T22:24:13.327ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1119 request = datasets_list zpool = oxp_d7b58ec6-9f7e-464f-b0dc-a0d484ac88ac
27732024-12-18T22:24:13.334ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27742024-12-18T22:24:13.348ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61424
27752024-12-18T22:24:13.356ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ad207096-a29a-4bc7-b04f-7cf8a526e7ae (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:608
27762024-12-18T22:24:13.356ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1119 request = datasets_list zpool = oxp_ad207096-a29a-4bc7-b04f-7cf8a526e7ae
27772024-12-18T22:24:13.363ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57425
27782024-12-18T22:24:13.372ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:608
27792024-12-18T22:24:13.372ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:608
27802024-12-18T22:24:13.372ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/f4e49932-892e-4e15-afe7-919d71bd3012/config/omicron-zones.json file = common/src/ledger.rs:177
27812024-12-18T22:24:13.377ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/de0dd618-e464-453d-9394-6cb21d5dbefa/config/omicron-zones.json file = common/src/ledger.rs:177
27822024-12-18T22:24:13.388ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a952a3c4-f4b2-4c9a-a310-fb464cba0cce (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:608
27832024-12-18T22:24:13.388ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1119 request = datasets_list zpool = oxp_a952a3c4-f4b2-4c9a-a310-fb464cba0cce
27842024-12-18T22:24:13.403ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7527a580-440a-4d33-b9e5-9f4ac1126696 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:608
27852024-12-18T22:24:13.403ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1119 request = datasets_list zpool = oxp_7527a580-440a-4d33-b9e5-9f4ac1126696
27862024-12-18T22:24:13.412ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27872024-12-18T22:24:13.412ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122271 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:62786 req_id = 0e33bc69-20ee-4008-9d8b-7caad438017a response_code = 204 uri = /switch-ports
27882024-12-18T22:24:13.418ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5950 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62786 req_id = 04d6d8b1-a6d8-4d22-90e4-72d8dc79470c response_code = 200 uri = /network-bootstore-config
27892024-12-18T22:24:13.433ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8d122e51-f03c-4659-8af4-3a5baca809c5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:608
27902024-12-18T22:24:13.434ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1119 request = datasets_list zpool = oxp_8d122e51-f03c-4659-8af4-3a5baca809c5
27912024-12-18T22:24:13.448ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45747
27922024-12-18T22:24:13.448ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 104d2c5b-1a03-416e-83a1-9840a7797640, kind: Service { id: d0ef80fe-5a3c-4585-be47-819c465c7a37 }, name: Name("external-dns-d0ef80fe-5a3c-4585-be47-819c465c7a37"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 188, 248])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 607e1df6-370f-4c69-a01b-1dec075c60ae, kind: Service { id: 160de9b3-61fd-47fd-9883-78dcc7b014f0 }, name: Name("external-dns-160de9b3-61fd-47fd-9883-78dcc7b014f0"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 132, 76])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0bab2332-a525-46aa-9d7e-fb4af64f3c88, kind: Service { id: 9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395 }, name: Name("nexus-9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 211, 86])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: af14a7c6-4009-42e7-b00a-57c5ae0399bb, kind: Service { id: 175d3cc8-9a02-4cf3-970c-8ec76a875436 }, name: Name("nexus-175d3cc8-9a02-4cf3-970c-8ec76a875436"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 135, 206])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d048e606-7b77-4cdc-951d-7050040ab8d1, kind: Service { id: c0e3d114-075e-41a4-a4df-fa8131bbea97 }, name: Name("nexus-c0e3d114-075e-41a4-a4df-fa8131bbea97"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 155, 145])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
27932024-12-18T22:24:13.448ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27942024-12-18T22:24:13.449ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27952024-12-18T22:24:13.449ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
27962024-12-18T22:24:13.449ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27972024-12-18T22:24:13.449ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27982024-12-18T22:24:13.449ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27992024-12-18T22:24:13.449ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1148 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45747 req_id = 0c119fd6-2db1-4c5f-9a7b-a48991bdaff5 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
28002024-12-18T22:24:13.449ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 45dbe21c-5eaa-4707-b822-d1348b4d8afc (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:608
28012024-12-18T22:24:13.449ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1119 request = datasets_list zpool = oxp_45dbe21c-5eaa-4707-b822-d1348b4d8afc
28022024-12-18T22:24:13.458ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
28032024-12-18T22:24:13.470ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ebfff57f-9cb4-47bd-acd3-b83eb13e21b5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:608
28042024-12-18T22:24:13.470ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1119 request = datasets_list zpool = oxp_ebfff57f-9cb4-47bd-acd3-b83eb13e21b5
28052024-12-18T22:24:13.486ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 378b1d3c-0145-41bf-ab1f-16bc3c7930e7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:608
28062024-12-18T22:24:13.486ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1119 request = datasets_list zpool = oxp_378b1d3c-0145-41bf-ab1f-16bc3c7930e7
28072024-12-18T22:24:13.511ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4bf1df73-f4b5-4c23-85b8-9b365d6ea8ae (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:608
28082024-12-18T22:24:13.511ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1119 request = datasets_list zpool = oxp_4bf1df73-f4b5-4c23-85b8-9b365d6ea8ae
28092024-12-18T22:24:13.524ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d7b58ec6-9f7e-464f-b0dc-a0d484ac88ac (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:608
28102024-12-18T22:24:13.524ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1119 request = datasets_list zpool = oxp_d7b58ec6-9f7e-464f-b0dc-a0d484ac88ac
28112024-12-18T22:24:13.530ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 308383 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40681 req_id = b29dea49-3621-4499-81cd-d90da630cf3c response_code = 200 uri = /inventory
28122024-12-18T22:24:13.530ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 181838 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:61424 req_id = 4027044f-5972-4d1b-b896-f3917f68edba response_code = 204 uri = /switch-ports
28132024-12-18T22:24:13.530ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61424 req_id = 01ccf409-4efd-402c-8ecd-edd7dc3ea692 response_code = 200 uri = /network-bootstore-config
28142024-12-18T22:24:13.549ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ad207096-a29a-4bc7-b04f-7cf8a526e7ae (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:608
28152024-12-18T22:24:13.549ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1119 request = datasets_list zpool = oxp_ad207096-a29a-4bc7-b04f-7cf8a526e7ae
28162024-12-18T22:24:13.563ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63959
28172024-12-18T22:24:13.564ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 104d2c5b-1a03-416e-83a1-9840a7797640, kind: Service { id: d0ef80fe-5a3c-4585-be47-819c465c7a37 }, name: Name("external-dns-d0ef80fe-5a3c-4585-be47-819c465c7a37"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 188, 248])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 607e1df6-370f-4c69-a01b-1dec075c60ae, kind: Service { id: 160de9b3-61fd-47fd-9883-78dcc7b014f0 }, name: Name("external-dns-160de9b3-61fd-47fd-9883-78dcc7b014f0"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 132, 76])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0bab2332-a525-46aa-9d7e-fb4af64f3c88, kind: Service { id: 9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395 }, name: Name("nexus-9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 211, 86])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: af14a7c6-4009-42e7-b00a-57c5ae0399bb, kind: Service { id: 175d3cc8-9a02-4cf3-970c-8ec76a875436 }, name: Name("nexus-175d3cc8-9a02-4cf3-970c-8ec76a875436"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 135, 206])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d048e606-7b77-4cdc-951d-7050040ab8d1, kind: Service { id: c0e3d114-075e-41a4-a4df-fa8131bbea97 }, name: Name("nexus-c0e3d114-075e-41a4-a4df-fa8131bbea97"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 155, 145])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
28182024-12-18T22:24:13.564ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28192024-12-18T22:24:13.564ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28202024-12-18T22:24:13.564ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
28212024-12-18T22:24:13.564ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28222024-12-18T22:24:13.564ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28232024-12-18T22:24:13.564ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28242024-12-18T22:24:13.564ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 675 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63959 req_id = 5e76c900-a58b-4ee2-98c4-f7a707c050e0 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
28252024-12-18T22:24:13.569ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a952a3c4-f4b2-4c9a-a310-fb464cba0cce (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:608
28262024-12-18T22:24:13.569ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1119 request = datasets_list zpool = oxp_a952a3c4-f4b2-4c9a-a310-fb464cba0cce
28272024-12-18T22:24:13.587ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 45dbe21c-5eaa-4707-b822-d1348b4d8afc (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:608
28282024-12-18T22:24:13.587ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1119 request = datasets_list zpool = oxp_45dbe21c-5eaa-4707-b822-d1348b4d8afc
28292024-12-18T22:24:13.605ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 378b1d3c-0145-41bf-ab1f-16bc3c7930e7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:608
28302024-12-18T22:24:13.605ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1119 request = datasets_list zpool = oxp_378b1d3c-0145-41bf-ab1f-16bc3c7930e7
28312024-12-18T22:24:13.629ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4bf1df73-f4b5-4c23-85b8-9b365d6ea8ae (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:608
28322024-12-18T22:24:13.629ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1119 request = datasets_list zpool = oxp_4bf1df73-f4b5-4c23-85b8-9b365d6ea8ae
28332024-12-18T22:24:13.643ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 280097 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57425 req_id = 47a01c0b-f850-4005-8cda-a517bb715275 response_code = 200 uri = /inventory
28342024-12-18T22:24:14.077ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44760
28352024-12-18T22:24:14.077ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44760 req_id = da19b422-ab95-4bfa-8703-c40e7d37d073 response_code = 200 uri = /vpc-routes
28362024-12-18T22:24:14.140ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 values = ExternalIpGatewayMap { mappings: {} }
28372024-12-18T22:24:14.140ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44760 req_id = 78a8258d-845e-4275-9cb5-37ac10eff8bb response_code = 204 uri = /eip-gateways
28382024-12-18T22:24:14.149ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 236 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44760 req_id = cad276ab-8d92-4f22-a476-ec22e48da40b response_code = 204 uri = /vpc-routes
28392024-12-18T22:24:14.243ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57778
28402024-12-18T22:24:14.243ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57778 req_id = 61fb47b8-c881-4384-8d4e-416070b33a3a response_code = 200 uri = /v2p
28412024-12-18T22:24:14.304ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37023
28422024-12-18T22:24:14.304ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
28432024-12-18T22:24:14.344ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
28442024-12-18T22:24:14.401ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96785 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:37023 req_id = 2549f09b-0c54-460e-a206-da11c9aa5f02 response_code = 204 uri = /switch-ports
28452024-12-18T22:24:14.401ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37023 req_id = 32977298-aa62-42d0-9631-7bca4ff5c809 response_code = 200 uri = /network-bootstore-config
28462024-12-18T22:24:14.416ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45613
28472024-12-18T22:24:14.416ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:608
28482024-12-18T22:24:14.416ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:608
28492024-12-18T22:24:14.417ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/f4e49932-892e-4e15-afe7-919d71bd3012/config/omicron-zones.json file = common/src/ledger.rs:177
28502024-12-18T22:24:14.417ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/de0dd618-e464-453d-9394-6cb21d5dbefa/config/omicron-zones.json file = common/src/ledger.rs:177
28512024-12-18T22:24:14.430ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7527a580-440a-4d33-b9e5-9f4ac1126696 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:608
28522024-12-18T22:24:14.430ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1119 request = datasets_list zpool = oxp_7527a580-440a-4d33-b9e5-9f4ac1126696
28532024-12-18T22:24:14.439ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38431
28542024-12-18T22:24:14.439ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 104d2c5b-1a03-416e-83a1-9840a7797640, kind: Service { id: d0ef80fe-5a3c-4585-be47-819c465c7a37 }, name: Name("external-dns-d0ef80fe-5a3c-4585-be47-819c465c7a37"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 188, 248])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 607e1df6-370f-4c69-a01b-1dec075c60ae, kind: Service { id: 160de9b3-61fd-47fd-9883-78dcc7b014f0 }, name: Name("external-dns-160de9b3-61fd-47fd-9883-78dcc7b014f0"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 132, 76])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0bab2332-a525-46aa-9d7e-fb4af64f3c88, kind: Service { id: 9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395 }, name: Name("nexus-9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 211, 86])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: af14a7c6-4009-42e7-b00a-57c5ae0399bb, kind: Service { id: 175d3cc8-9a02-4cf3-970c-8ec76a875436 }, name: Name("nexus-175d3cc8-9a02-4cf3-970c-8ec76a875436"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 135, 206])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d048e606-7b77-4cdc-951d-7050040ab8d1, kind: Service { id: c0e3d114-075e-41a4-a4df-fa8131bbea97 }, name: Name("nexus-c0e3d114-075e-41a4-a4df-fa8131bbea97"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 155, 145])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
28552024-12-18T22:24:14.439ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28562024-12-18T22:24:14.439ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28572024-12-18T22:24:14.439ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
28582024-12-18T22:24:14.439ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28592024-12-18T22:24:14.439ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28602024-12-18T22:24:14.439ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28612024-12-18T22:24:14.439ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 376 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38431 req_id = 7a170015-8cab-4070-866b-a2184fe3e988 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
28622024-12-18T22:24:14.456ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8d122e51-f03c-4659-8af4-3a5baca809c5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:608
28632024-12-18T22:24:14.456ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1119 request = datasets_list zpool = oxp_8d122e51-f03c-4659-8af4-3a5baca809c5
28642024-12-18T22:24:14.477ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ebfff57f-9cb4-47bd-acd3-b83eb13e21b5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:608
28652024-12-18T22:24:14.477ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1119 request = datasets_list zpool = oxp_ebfff57f-9cb4-47bd-acd3-b83eb13e21b5
28662024-12-18T22:24:14.500ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d7b58ec6-9f7e-464f-b0dc-a0d484ac88ac (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:608
28672024-12-18T22:24:14.500ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1119 request = datasets_list zpool = oxp_d7b58ec6-9f7e-464f-b0dc-a0d484ac88ac
28682024-12-18T22:24:14.521ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ad207096-a29a-4bc7-b04f-7cf8a526e7ae (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:608
28692024-12-18T22:24:14.521ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1119 request = datasets_list zpool = oxp_ad207096-a29a-4bc7-b04f-7cf8a526e7ae
28702024-12-18T22:24:14.541ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a952a3c4-f4b2-4c9a-a310-fb464cba0cce (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:608
28712024-12-18T22:24:14.541ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1119 request = datasets_list zpool = oxp_a952a3c4-f4b2-4c9a-a310-fb464cba0cce
28722024-12-18T22:24:14.561ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 45dbe21c-5eaa-4707-b822-d1348b4d8afc (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:608
28732024-12-18T22:24:14.561ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1119 request = datasets_list zpool = oxp_45dbe21c-5eaa-4707-b822-d1348b4d8afc
28742024-12-18T22:24:14.581ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 378b1d3c-0145-41bf-ab1f-16bc3c7930e7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:608
28752024-12-18T22:24:14.581ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1119 request = datasets_list zpool = oxp_378b1d3c-0145-41bf-ab1f-16bc3c7930e7
28762024-12-18T22:24:14.601ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4bf1df73-f4b5-4c23-85b8-9b365d6ea8ae (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:608
28772024-12-18T22:24:14.601ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1119 request = datasets_list zpool = oxp_4bf1df73-f4b5-4c23-85b8-9b365d6ea8ae
28782024-12-18T22:24:14.613ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 196066 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45613 req_id = 72caa426-6c45-46eb-81b8-74be680a4bce response_code = 200 uri = /inventory
28792024-12-18T22:24:17.261ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:37442
28802024-12-18T22:24:17.261ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:37442 req_id = 54c4b67e-cbd9-40b7-946c-2bf6a67725da response_code = 200 uri = /baseboard
28812024-12-18T22:24:41.641ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4507 local_addr = [fd00:1122:3344:101::1]:43671 method = GET remote_addr = [fd00:1122:3344:101::d]:59797 req_id = 7b960b3d-9cee-4bac-8b00-564814f34c68 response_code = 200 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 uri = /44b7e384-368a-4bb9-a5b4-e1c12506ebd3
28822024-12-18T22:24:42.966ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57417
28832024-12-18T22:24:42.966ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57417 req_id = 225a24f6-985b-4b99-a2c8-31d6f772dfb1 response_code = 200 uri = /vpc-routes
28842024-12-18T22:24:42.993ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50011
28852024-12-18T22:24:42.993ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50011 req_id = a491f0e4-9cf4-42e2-86ec-07870616cf1e response_code = 200 uri = /vpc-routes
28862024-12-18T22:24:43.008ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 values = ExternalIpGatewayMap { mappings: {} }
28872024-12-18T22:24:43.008ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50011 req_id = dee13676-6628-47c2-b510-c44e01b0f4c6 response_code = 204 uri = /eip-gateways
28882024-12-18T22:24:43.017ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 356 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50011 req_id = 374baa71-6509-4afd-a598-f8f5ba3818eb response_code = 204 uri = /vpc-routes
28892024-12-18T22:24:43.020ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58353
28902024-12-18T22:24:43.020ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58353 req_id = ad269410-6be5-4c13-92ec-72384fee3ba9 response_code = 200 uri = /v2p
28912024-12-18T22:24:43.062ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 values = ExternalIpGatewayMap { mappings: {} }
28922024-12-18T22:24:43.062ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57417 req_id = 90f4509e-623a-4722-b2da-7256891fcd70 response_code = 204 uri = /eip-gateways
28932024-12-18T22:24:43.065ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63099
28942024-12-18T22:24:43.065ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
28952024-12-18T22:24:43.108ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
28962024-12-18T22:24:43.166ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101069 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:63099 req_id = 7619edeb-1623-4635-b5a2-aa6ce6dc327f response_code = 204 uri = /switch-ports
28972024-12-18T22:24:43.166ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45551
28982024-12-18T22:24:43.166ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46823
28992024-12-18T22:24:43.166ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 221 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45551 req_id = 5e5908c2-7ff9-49c4-a246-fd6626b74a1c response_code = 200 uri = /v2p
29002024-12-18T22:24:43.166ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 346 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63099 req_id = 50decf88-2314-4f66-b45d-617340e23d35 response_code = 200 uri = /network-bootstore-config
29012024-12-18T22:24:43.166ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
29022024-12-18T22:24:43.172ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5589 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57417 req_id = 8f7efe65-f5e1-4dc7-a1d1-fd535e7c441a response_code = 204 uri = /vpc-routes
29032024-12-18T22:24:43.205ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
29042024-12-18T22:24:43.260ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93873 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:46823 req_id = 74ad89fd-470a-4ffd-958f-c987cb6e43f7 response_code = 204 uri = /switch-ports
29052024-12-18T22:24:43.261ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46823 req_id = e62e9149-e226-4a7c-a18b-639160373bfb response_code = 200 uri = /network-bootstore-config
29062024-12-18T22:24:44.012ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47335
29072024-12-18T22:24:44.012ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47335 req_id = 6b4066e7-233a-4c87-84d0-cc717b13e96c response_code = 200 uri = /vpc-routes
29082024-12-18T22:24:44.044ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35235
29092024-12-18T22:24:44.044ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35235 req_id = 3e2a6396-e5f8-4ee9-a34a-229d34cee9bb response_code = 200 uri = /v2p
29102024-12-18T22:24:44.053ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 values = ExternalIpGatewayMap { mappings: {} }
29112024-12-18T22:24:44.053ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47335 req_id = 4f71697a-856c-4720-b13e-563e5a07d39f response_code = 204 uri = /eip-gateways
29122024-12-18T22:24:44.062ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47335 req_id = e1bfbdf2-65f7-4eb2-a359-8530f6b4fa86 response_code = 204 uri = /vpc-routes
29132024-12-18T22:24:44.142ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44265
29142024-12-18T22:24:44.142ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
29152024-12-18T22:24:44.182ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
29162024-12-18T22:24:44.238ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96038 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:44265 req_id = c8a705ff-c48e-483d-999f-f4ca89fec2ed response_code = 204 uri = /switch-ports
29172024-12-18T22:24:44.238ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44265 req_id = 67f75c96-3885-4337-b070-0c1379056c9f response_code = 200 uri = /network-bootstore-config
29182024-12-18T22:24:47.293ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:65034
29192024-12-18T22:24:47.294ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:65034 req_id = 6ce5e5ed-b088-4f57-9635-9b8ad3b5c0d8 response_code = 200 uri = /baseboard
29202024-12-18T22:25:11.643ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6387 local_addr = [fd00:1122:3344:101::1]:43671 method = GET remote_addr = [fd00:1122:3344:101::d]:59797 req_id = 008875f8-680e-4503-9e15-942298c33d87 response_code = 200 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 uri = /44b7e384-368a-4bb9-a5b4-e1c12506ebd3
29212024-12-18T22:25:13.070ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49409
29222024-12-18T22:25:13.070ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49409 req_id = 60b1855b-d054-46ad-b595-f7658f7110dc response_code = 200 uri = /vpc-routes
29232024-12-18T22:25:13.144ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 values = ExternalIpGatewayMap { mappings: {} }
29242024-12-18T22:25:13.144ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49409 req_id = f5576c7b-6638-4554-8d1d-43c3317619e0 response_code = 204 uri = /eip-gateways
29252024-12-18T22:25:13.156ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 314 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49409 req_id = ad82e3d5-3d4a-40f5-9e09-48f70c0deded response_code = 204 uri = /vpc-routes
29262024-12-18T22:25:13.178ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43731
29272024-12-18T22:25:13.178ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43731 req_id = 7c1c7078-f45e-4c1f-9169-8db995767821 response_code = 200 uri = /vpc-routes
29282024-12-18T22:25:13.249ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 values = ExternalIpGatewayMap { mappings: {} }
29292024-12-18T22:25:13.249ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43731 req_id = 9bcb57b5-5e1a-4113-8504-666bcb458c62 response_code = 204 uri = /eip-gateways
29302024-12-18T22:25:13.343ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 383 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43731 req_id = a749ff1e-16a2-4e04-9bd4-5de270cf7935 response_code = 204 uri = /vpc-routes
29312024-12-18T22:25:13.385ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51253
29322024-12-18T22:25:13.385ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
29332024-12-18T22:25:13.422ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
29342024-12-18T22:25:13.487ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101883 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:51253 req_id = 1014f964-8f1b-4d9c-ab83-8210f4122c41 response_code = 204 uri = /switch-ports
29352024-12-18T22:25:13.487ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46425
29362024-12-18T22:25:13.488ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 361 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51253 req_id = 8af5422c-0cb4-4eb3-a584-42754a668e69 response_code = 200 uri = /network-bootstore-config
29372024-12-18T22:25:13.488ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 303 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46425 req_id = 928dfebe-170b-4a25-b7b9-73b8414efbdb response_code = 200 uri = /v2p
29382024-12-18T22:25:13.499ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39714
29392024-12-18T22:25:13.499ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
29402024-12-18T22:25:13.537ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
29412024-12-18T22:25:13.597ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98473 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:39714 req_id = efcb91ce-30e2-4050-b0d2-a271164c0590 response_code = 204 uri = /switch-ports
29422024-12-18T22:25:13.598ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39714 req_id = 50c7980f-f5a0-4296-8f97-9144fc6d1879 response_code = 200 uri = /network-bootstore-config
29432024-12-18T22:25:13.611ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46131
29442024-12-18T22:25:13.611ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46131 req_id = 18640e81-61e2-4d4e-839d-9f3ad565161d response_code = 200 uri = /v2p
29452024-12-18T22:25:14.060ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53728
29462024-12-18T22:25:14.060ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53728 req_id = 18049f69-21b0-4fc1-b32e-366537590cde response_code = 200 uri = /v2p
29472024-12-18T22:25:14.109ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50312
29482024-12-18T22:25:14.109ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50312 req_id = 297c632e-4d9a-4a48-a610-cdeac2bd146e response_code = 200 uri = /vpc-routes
29492024-12-18T22:25:14.150ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 values = ExternalIpGatewayMap { mappings: {} }
29502024-12-18T22:25:14.150ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50312 req_id = a9923756-7ba0-4a59-8454-41c7d0c881e8 response_code = 204 uri = /eip-gateways
29512024-12-18T22:25:14.160ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50312 req_id = d0997a99-aa01-416e-81bd-edbe7695b40b response_code = 204 uri = /vpc-routes
29522024-12-18T22:25:14.382ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42355
29532024-12-18T22:25:14.382ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
29542024-12-18T22:25:14.420ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
29552024-12-18T22:25:14.482ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100009 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:42355 req_id = cc3f7b17-8ca9-46a9-9231-9408acad8bfe response_code = 204 uri = /switch-ports
29562024-12-18T22:25:14.482ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42355 req_id = a2fa05a8-6731-4bde-8db7-b91fc498e86a response_code = 200 uri = /network-bootstore-config
29572024-12-18T22:25:17.326ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:38031
29582024-12-18T22:25:17.327ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:38031 req_id = a4171876-1c3c-4e34-9320-7c232eee0888 response_code = 200 uri = /baseboard
29592024-12-18T22:25:26.420ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57507
29602024-12-18T22:25:26.421ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57507 req_id = 655b86dc-2d84-4b58-a64b-05ed8aac3a77 response_code = 200 uri = /v2p
29612024-12-18T22:25:26.428ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:874 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(4492759) }
29622024-12-18T22:25:26.428ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6781 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57507 req_id = 29d3d4f5-8bd1-45fc-828b-443a3cc043d8 response_code = 204 uri = /v2p
29632024-12-18T22:25:26.537ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37811
29642024-12-18T22:25:26.551ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:555 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: c0b27ea6-4800-45ac-a9d3-91c04e2d8f33, kind: Instance { id: 861b1718-78dd-4ee4-9019-f03d9609c535 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(4492759), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: c0b27ea6-4800-45ac-a9d3-91c04e2d8f33, kind: Instance { id: 861b1718-78dd-4ee4-9019-f03d9609c535 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(4492759), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: c0b27ea6-4800-45ac-a9d3-91c04e2d8f33, kind: Instance { id: 861b1718-78dd-4ee4-9019-f03d9609c535 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(4492759), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(4492759))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: c0b27ea6-4800-45ac-a9d3-91c04e2d8f33, kind: Instance { id: 861b1718-78dd-4ee4-9019-f03d9609c535 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(4492759), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-1008ccd5323", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 2edeceb3-78af-42f8-9110-f6e5b693ff69, read_only_parent: Some(Volume { block_size: 512, id: 716a3b12-57b4-49b3-9c6d-cb462e96e023, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: a7693bc3-827d-4e31-86ef-ee23d75c468f, key: Some("jCQCLv4rK/ItE3ZFEUewrT3PY4ei0BAzcWBf8sRV7wQ="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::18]:19002", "[fd00:1122:3344:101::12]:19001", "[fd00:1122:3344:101::16]:19002"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 2edeceb3-78af-42f8-9110-f6e5b693ff69, key: Some("wcSzirPGGMP2JR5BRNPXKs3PEs1xjoc3fkpFh6eRw2g="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::15]:19000", "[fd00:1122:3344:101::19]:19000", "[fd00:1122:3344:101::1a]:19000"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-1008ccd5323" }] }), cloud_init_bytes: Some(..) } instance_id = 861b1718-78dd-4ee4-9019-f03d9609c535 metadata = InstanceMetadata { silo_id: 76b3a5a9-e9ba-496d-bfb7-72898689a859, project_id: e61455aa-73bb-4c25-99fb-db083d755787 } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = 23cacdc9-61c5-437c-b8c1-d2c8e002a6eb vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-12-18T22:25:26.536765284Z }
29652024-12-18T22:25:26.551ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:588 instance_id = 861b1718-78dd-4ee4-9019-f03d9609c535 migration_id = None propolis_id = 23cacdc9-61c5-437c-b8c1-d2c8e002a6eb
29662024-12-18T22:25:26.551ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1281 instance_id = 861b1718-78dd-4ee4-9019-f03d9609c535 migration_id = None propolis_id = 23cacdc9-61c5-437c-b8c1-d2c8e002a6eb state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: c0b27ea6-4800-45ac-a9d3-91c04e2d8f33, kind: Instance { id: 861b1718-78dd-4ee4-9019-f03d9609c535 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(4492759), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: c0b27ea6-4800-45ac-a9d3-91c04e2d8f33, kind: Instance { id: 861b1718-78dd-4ee4-9019-f03d9609c535 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(4492759), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: c0b27ea6-4800-45ac-a9d3-91c04e2d8f33, kind: Instance { id: 861b1718-78dd-4ee4-9019-f03d9609c535 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(4492759), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(4492759))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: c0b27ea6-4800-45ac-a9d3-91c04e2d8f33, kind: Instance { id: 861b1718-78dd-4ee4-9019-f03d9609c535 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(4492759), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-1008ccd5323", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 2edeceb3-78af-42f8-9110-f6e5b693ff69, read_only_parent: Some(Volume { block_size: 512, id: 716a3b12-57b4-49b3-9c6d-cb462e96e023, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: a7693bc3-827d-4e31-86ef-ee23d75c468f, key: Some("jCQCLv4rK/ItE3ZFEUewrT3PY4ei0BAzcWBf8sRV7wQ="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::18]:19002", "[fd00:1122:3344:101::12]:19001", "[fd00:1122:3344:101::16]:19002"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 2edeceb3-78af-42f8-9110-f6e5b693ff69, key: Some("wcSzirPGGMP2JR5BRNPXKs3PEs1xjoc3fkpFh6eRw2g="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::15]:19000", "[fd00:1122:3344:101::19]:19000", "[fd00:1122:3344:101::1a]:19000"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-1008ccd5323" }] }), cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-12-18T22:25:26.536765284Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
29672024-12-18T22:25:26.552ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 15549 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37811 req_id = e84e0a87-6497-493a-a096-61f41f881e87 response_code = 200 uri = /vmms/23cacdc9-61c5-437c-b8c1-d2c8e002a6eb
29682024-12-18T22:25:26.688ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34318
29692024-12-18T22:25:26.697ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8964 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34318 req_id = 2485ccd9-11f9-43f5-a726-16c8e5e429c7 response_code = 200 uri = /vmms/23cacdc9-61c5-437c-b8c1-d2c8e002a6eb/state
29702024-12-18T22:25:26.700ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 4492759 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
29712024-12-18T22:25:26.700ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:608
29722024-12-18T22:25:26.741ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_23cacdc9-61c5-437c-b8c1-d2c8e002a6eb file = illumos-utils/src/zone.rs:325 instance_id = 861b1718-78dd-4ee4-9019-f03d9609c535 propolis_id = 23cacdc9-61c5-437c-b8c1-d2c8e002a6eb
29732024-12-18T22:25:26.765ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_23cacdc9-61c5-437c-b8c1-d2c8e002a6eb file = illumos-utils/src/zone.rs:363 instance_id = 861b1718-78dd-4ee4-9019-f03d9609c535 propolis_id = 23cacdc9-61c5-437c-b8c1-d2c8e002a6eb
29742024-12-18T22:25:26.854ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58248
29752024-12-18T22:25:26.854ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58248 req_id = 89e2dfca-51d9-4a04-97a5-00febc954fed response_code = 200 uri = /vpc-routes
29762024-12-18T22:25:26.878ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 values = ExternalIpGatewayMap { mappings: {c0b27ea6-4800-45ac-a9d3-91c04e2d8f33: {10.151.1.175: {8369c734-9ef6-4b82-9d5f-140f0929f1cf}, 10.151.1.176: {8369c734-9ef6-4b82-9d5f-140f0929f1cf}}} }
29772024-12-18T22:25:28.422ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_23cacdc9-61c5-437c-b8c1-d2c8e002a6eb: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = 861b1718-78dd-4ee4-9019-f03d9609c535 propolis_id = 23cacdc9-61c5-437c-b8c1-d2c8e002a6eb
29782024-12-18T22:25:28.422ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_23cacdc9-61c5-437c-b8c1-d2c8e002a6eb zone file = illumos-utils/src/running_zone.rs:488 instance_id = 861b1718-78dd-4ee4-9019-f03d9609c535 propolis_id = 23cacdc9-61c5-437c-b8c1-d2c8e002a6eb zone = oxz_propolis-server_23cacdc9-61c5-437c-b8c1-d2c8e002a6eb
29792024-12-18T22:25:28.601ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_23cacdc9-61c5-437c-b8c1-d2c8e002a6eb") failed: Property not found. retry in 58.839362ms file = illumos-utils/src/svc.rs:36 instance_id = 861b1718-78dd-4ee4-9019-f03d9609c535 propolis_id = 23cacdc9-61c5-437c-b8c1-d2c8e002a6eb zone = oxz_propolis-server_23cacdc9-61c5-437c-b8c1-d2c8e002a6eb
29802024-12-18T22:25:28.675ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_23cacdc9-61c5-437c-b8c1-d2c8e002a6eb") failed: Property not found. retry in 120.37617ms file = illumos-utils/src/svc.rs:36 instance_id = 861b1718-78dd-4ee4-9019-f03d9609c535 propolis_id = 23cacdc9-61c5-437c-b8c1-d2c8e002a6eb zone = oxz_propolis-server_23cacdc9-61c5-437c-b8c1-d2c8e002a6eb
29812024-12-18T22:25:28.819ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_23cacdc9-61c5-437c-b8c1-d2c8e002a6eb") failed: Property not found. retry in 198.660214ms file = illumos-utils/src/svc.rs:36 instance_id = 861b1718-78dd-4ee4-9019-f03d9609c535 propolis_id = 23cacdc9-61c5-437c-b8c1-d2c8e002a6eb zone = oxz_propolis-server_23cacdc9-61c5-437c-b8c1-d2c8e002a6eb
29822024-12-18T22:25:29.034ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_23cacdc9-61c5-437c-b8c1-d2c8e002a6eb") failed: Property not found. retry in 369.376201ms file = illumos-utils/src/svc.rs:36 instance_id = 861b1718-78dd-4ee4-9019-f03d9609c535 propolis_id = 23cacdc9-61c5-437c-b8c1-d2c8e002a6eb zone = oxz_propolis-server_23cacdc9-61c5-437c-b8c1-d2c8e002a6eb
29832024-12-18T22:25:29.414ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_23cacdc9-61c5-437c-b8c1-d2c8e002a6eb") failed: Property not found. retry in 548.121873ms file = illumos-utils/src/svc.rs:36 instance_id = 861b1718-78dd-4ee4-9019-f03d9609c535 propolis_id = 23cacdc9-61c5-437c-b8c1-d2c8e002a6eb zone = oxz_propolis-server_23cacdc9-61c5-437c-b8c1-d2c8e002a6eb
29842024-12-18T22:25:29.975ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_23cacdc9-61c5-437c-b8c1-d2c8e002a6eb") failed: Property not found. retry in 1.146808985s file = illumos-utils/src/svc.rs:36 instance_id = 861b1718-78dd-4ee4-9019-f03d9609c535 propolis_id = 23cacdc9-61c5-437c-b8c1-d2c8e002a6eb zone = oxz_propolis-server_23cacdc9-61c5-437c-b8c1-d2c8e002a6eb
29852024-12-18T22:25:31.134ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_23cacdc9-61c5-437c-b8c1-d2c8e002a6eb") failed: Property not found. retry in 1.343438979s file = illumos-utils/src/svc.rs:36 instance_id = 861b1718-78dd-4ee4-9019-f03d9609c535 propolis_id = 23cacdc9-61c5-437c-b8c1-d2c8e002a6eb zone = oxz_propolis-server_23cacdc9-61c5-437c-b8c1-d2c8e002a6eb
29862024-12-18T22:25:32.489ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_23cacdc9-61c5-437c-b8c1-d2c8e002a6eb") failed: Property not found. retry in 951.384664ms file = illumos-utils/src/svc.rs:36 instance_id = 861b1718-78dd-4ee4-9019-f03d9609c535 propolis_id = 23cacdc9-61c5-437c-b8c1-d2c8e002a6eb zone = oxz_propolis-server_23cacdc9-61c5-437c-b8c1-d2c8e002a6eb
29872024-12-18T22:25:33.452ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_23cacdc9-61c5-437c-b8c1-d2c8e002a6eb") failed: Property not found. retry in 801.899409ms file = illumos-utils/src/svc.rs:36 instance_id = 861b1718-78dd-4ee4-9019-f03d9609c535 propolis_id = 23cacdc9-61c5-437c-b8c1-d2c8e002a6eb zone = oxz_propolis-server_23cacdc9-61c5-437c-b8c1-d2c8e002a6eb
29882024-12-18T22:25:34.283ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_23cacdc9-61c5-437c-b8c1-d2c8e002a6eb file = sled-agent/src/instance.rs:1786 instance_id = 861b1718-78dd-4ee4-9019-f03d9609c535 propolis_id = 23cacdc9-61c5-437c-b8c1-d2c8e002a6eb
29892024-12-18T22:25:34.292ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_23cacdc9-61c5-437c-b8c1-d2c8e002a6eb") failed: Property not found. retry in 30.284041ms file = illumos-utils/src/svc.rs:36 instance_id = 861b1718-78dd-4ee4-9019-f03d9609c535 propolis_id = 23cacdc9-61c5-437c-b8c1-d2c8e002a6eb
29902024-12-18T22:25:34.331ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_23cacdc9-61c5-437c-b8c1-d2c8e002a6eb") failed: Property not found. retry in 103.085645ms file = illumos-utils/src/svc.rs:36 instance_id = 861b1718-78dd-4ee4-9019-f03d9609c535 propolis_id = 23cacdc9-61c5-437c-b8c1-d2c8e002a6eb
29912024-12-18T22:25:34.443ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_23cacdc9-61c5-437c-b8c1-d2c8e002a6eb") failed: Property not found. retry in 229.835902ms file = illumos-utils/src/svc.rs:36 instance_id = 861b1718-78dd-4ee4-9019-f03d9609c535 propolis_id = 23cacdc9-61c5-437c-b8c1-d2c8e002a6eb
29922024-12-18T22:25:34.686ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:1795 instance_id = 861b1718-78dd-4ee4-9019-f03d9609c535 propolis_id = 23cacdc9-61c5-437c-b8c1-d2c8e002a6eb
29932024-12-18T22:25:34.742ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:1819 instance_id = 861b1718-78dd-4ee4-9019-f03d9609c535 propolis_id = 23cacdc9-61c5-437c-b8c1-d2c8e002a6eb
29942024-12-18T22:25:34.887ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:932 instance_id = 861b1718-78dd-4ee4-9019-f03d9609c535 propolis_id = 23cacdc9-61c5-437c-b8c1-d2c8e002a6eb
29952024-12-18T22:25:34.888ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1240 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
29962024-12-18T22:25:34.889ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8011781 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58248 req_id = 7bfc45d4-70b3-4faa-aa6d-4b8a0c18608c response_code = 204 uri = /eip-gateways
29972024-12-18T22:25:34.890ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2024-12-18T22:25:34.889376071Z } file = sled-agent/src/instance.rs:780 instance_id = 861b1718-78dd-4ee4-9019-f03d9609c535 propolis_id = 23cacdc9-61c5-437c-b8c1-d2c8e002a6eb
29982024-12-18T22:25:34.890ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 861b1718-78dd-4ee4-9019-f03d9609c535 new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-12-18T22:25:34.889376071Z } propolis_id = 23cacdc9-61c5-437c-b8c1-d2c8e002a6eb
29992024-12-18T22:25:34.890ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 861b1718-78dd-4ee4-9019-f03d9609c535 propolis_id = 23cacdc9-61c5-437c-b8c1-d2c8e002a6eb state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-12-18T22:25:34.889376071Z }, migration_in: None, migration_out: None }
30002024-12-18T22:25:34.957ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2024-12-18T22:25:34.957505808Z } file = sled-agent/src/instance.rs:780 instance_id = 861b1718-78dd-4ee4-9019-f03d9609c535 propolis_id = 23cacdc9-61c5-437c-b8c1-d2c8e002a6eb
30012024-12-18T22:25:34.957ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 861b1718-78dd-4ee4-9019-f03d9609c535 new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-12-18T22:25:34.957505808Z } propolis_id = 23cacdc9-61c5-437c-b8c1-d2c8e002a6eb
30022024-12-18T22:25:34.957ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 861b1718-78dd-4ee4-9019-f03d9609c535 propolis_id = 23cacdc9-61c5-437c-b8c1-d2c8e002a6eb state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-12-18T22:25:34.957505808Z }, migration_in: None, migration_out: None }
30032024-12-18T22:25:34.968ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 278 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58248 req_id = ea485cf9-644e-41db-8f2a-41ae1ab116e5 response_code = 204 uri = /vpc-routes
30042024-12-18T22:25:41.644ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7019 local_addr = [fd00:1122:3344:101::1]:43671 method = GET remote_addr = [fd00:1122:3344:101::d]:59797 req_id = d9fd8133-6d93-403c-96d8-f52af5e81d58 response_code = 200 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 uri = /44b7e384-368a-4bb9-a5b4-e1c12506ebd3
30052024-12-18T22:25:42.938ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60331
30062024-12-18T22:25:42.939ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 796 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60331 req_id = 4cd19cab-f460-4aaf-8fe9-a910f2be3b49 response_code = 200 uri = /vmms/23cacdc9-61c5-437c-b8c1-d2c8e002a6eb/state
30072024-12-18T22:25:42.997ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51075
30082024-12-18T22:25:42.997ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51075 req_id = 9c84b618-83e8-41d7-8704-6fe31857f254 response_code = 200 uri = /vmms/23cacdc9-61c5-437c-b8c1-d2c8e002a6eb/state
30092024-12-18T22:25:43.000ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61088
30102024-12-18T22:25:43.000ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61088 req_id = 44618328-4ef4-4989-8f7f-b75f20c699f9 response_code = 200 uri = /vpc-routes
30112024-12-18T22:25:43.021ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60770
30122024-12-18T22:25:43.021ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60770 req_id = 235e0b90-dfa3-46b8-8e77-9c7efefe4864 response_code = 200 uri = /vpc-routes
30132024-12-18T22:25:43.037ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 values = ExternalIpGatewayMap { mappings: {c0b27ea6-4800-45ac-a9d3-91c04e2d8f33: {10.151.1.176: {8369c734-9ef6-4b82-9d5f-140f0929f1cf}, 10.151.1.175: {8369c734-9ef6-4b82-9d5f-140f0929f1cf}}} }
30142024-12-18T22:25:43.037ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60770 req_id = cfbb7cd7-a5a7-49c2-ac39-9f8759807f71 response_code = 204 uri = /eip-gateways
30152024-12-18T22:25:43.045ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 values = ExternalIpGatewayMap { mappings: {c0b27ea6-4800-45ac-a9d3-91c04e2d8f33: {10.151.1.175: {8369c734-9ef6-4b82-9d5f-140f0929f1cf}, 10.151.1.176: {8369c734-9ef6-4b82-9d5f-140f0929f1cf}}} }
30162024-12-18T22:25:43.045ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61088 req_id = 8515bcd6-d31f-4ec9-b487-670f93b0eb98 response_code = 204 uri = /eip-gateways
30172024-12-18T22:25:43.063ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 283 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61088 req_id = 5e2c282c-dffa-418b-9e34-be3b5f624471 response_code = 204 uri = /vpc-routes
30182024-12-18T22:25:43.091ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63649
30192024-12-18T22:25:43.091ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63649 req_id = da4fa9f9-c9d1-415d-bdcf-3b0aee724c03 response_code = 200 uri = /v2p
30202024-12-18T22:25:43.094ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59583
30212024-12-18T22:25:43.094ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
30222024-12-18T22:25:43.139ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
30232024-12-18T22:25:43.202ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107926 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:59583 req_id = 8809c6cb-8618-4339-88b0-b798313f5f07 response_code = 204 uri = /switch-ports
30242024-12-18T22:25:43.202ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55893
30252024-12-18T22:25:43.202ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48901
30262024-12-18T22:25:43.202ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 210 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55893 req_id = 055a397f-45b7-43eb-a8c0-563a8586fd61 response_code = 200 uri = /v2p
30272024-12-18T22:25:43.202ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 321 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59583 req_id = 45700f3c-9e57-4f08-a13a-1e1f937db1f6 response_code = 200 uri = /network-bootstore-config
30282024-12-18T22:25:43.202ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
30292024-12-18T22:25:43.202ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 433 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60770 req_id = 9da33a9e-0e7a-44dc-8027-435a1380eeda response_code = 204 uri = /vpc-routes
30302024-12-18T22:25:43.242ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
30312024-12-18T22:25:43.301ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98584 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48901 req_id = b3a9dd69-f5d1-4fcd-9d47-e7e318431023 response_code = 204 uri = /switch-ports
30322024-12-18T22:25:43.301ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 160 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48901 req_id = 8ed12527-45ba-41e3-9a32-fc3ce0f6701f response_code = 200 uri = /network-bootstore-config
30332024-12-18T22:25:43.954ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62053
30342024-12-18T22:25:43.954ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62053 req_id = d5340eea-540b-4219-adcf-d445a98685ed response_code = 200 uri = /vpc-routes
30352024-12-18T22:25:43.958ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58539
30362024-12-18T22:25:43.958ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58539 req_id = e8a4b64c-f089-42cf-ba84-b12ee6abc47c response_code = 200 uri = /vmms/23cacdc9-61c5-437c-b8c1-d2c8e002a6eb/state
30372024-12-18T22:25:44.050ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57088
30382024-12-18T22:25:44.050ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57088 req_id = db3da2b8-abd6-4a56-a3d9-09c25ee37b4d response_code = 200 uri = /v2p
30392024-12-18T22:25:44.088ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 values = ExternalIpGatewayMap { mappings: {c0b27ea6-4800-45ac-a9d3-91c04e2d8f33: {10.151.1.175: {8369c734-9ef6-4b82-9d5f-140f0929f1cf}, 10.151.1.176: {8369c734-9ef6-4b82-9d5f-140f0929f1cf}}} }
30402024-12-18T22:25:44.088ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62053 req_id = 83fd12f1-6d04-4e5f-b8c5-42e8df6a8fd3 response_code = 204 uri = /eip-gateways
30412024-12-18T22:25:44.103ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 346 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62053 req_id = d4d02985-ad34-4cfb-8aa8-46b9b5ab29c5 response_code = 204 uri = /vpc-routes
30422024-12-18T22:25:44.137ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60388
30432024-12-18T22:25:44.138ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
30442024-12-18T22:25:44.176ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
30452024-12-18T22:25:44.231ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93009 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:60388 req_id = 689139e7-6b4e-4f90-b5b5-26e2665487b8 response_code = 204 uri = /switch-ports
30462024-12-18T22:25:44.231ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60388 req_id = e02190ab-5002-4202-a3d6-a3e524945c07 response_code = 200 uri = /network-bootstore-config
30472024-12-18T22:25:44.720ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43842
30482024-12-18T22:25:44.721ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 538 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43842 req_id = 7409ed5a-263e-451c-b10a-62e966e6ccf4 response_code = 200 uri = /vmms/23cacdc9-61c5-437c-b8c1-d2c8e002a6eb/state
30492024-12-18T22:25:44.721ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2024-12-18T22:25:44.721499046Z } file = sled-agent/src/instance.rs:780 instance_id = 861b1718-78dd-4ee4-9019-f03d9609c535 propolis_id = 23cacdc9-61c5-437c-b8c1-d2c8e002a6eb
30502024-12-18T22:25:44.721ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 861b1718-78dd-4ee4-9019-f03d9609c535 new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-12-18T22:25:44.721499046Z } propolis_id = 23cacdc9-61c5-437c-b8c1-d2c8e002a6eb
30512024-12-18T22:25:44.721ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 861b1718-78dd-4ee4-9019-f03d9609c535 propolis_id = 23cacdc9-61c5-437c-b8c1-d2c8e002a6eb state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-12-18T22:25:44.721499046Z }, migration_in: None, migration_out: None }
30522024-12-18T22:25:44.761ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2024-12-18T22:25:44.761897148Z } file = sled-agent/src/instance.rs:780 instance_id = 861b1718-78dd-4ee4-9019-f03d9609c535 propolis_id = 23cacdc9-61c5-437c-b8c1-d2c8e002a6eb
30532024-12-18T22:25:44.761ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 861b1718-78dd-4ee4-9019-f03d9609c535 new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-12-18T22:25:44.761897148Z } propolis_id = 23cacdc9-61c5-437c-b8c1-d2c8e002a6eb
30542024-12-18T22:25:44.761ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:816 instance_id = 861b1718-78dd-4ee4-9019-f03d9609c535 propolis_id = 23cacdc9-61c5-437c-b8c1-d2c8e002a6eb
30552024-12-18T22:25:44.761ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:608
30562024-12-18T22:25:44.762ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 14668665422784228329 n_samples = 6 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
30572024-12-18T22:25:44.762ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:608
30582024-12-18T22:25:44.762ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/de0dd618-e464-453d-9394-6cb21d5dbefa/debug/bundle/zone", "/pool/int/f4e49932-892e-4e15-afe7-919d71bd3012/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/7527a580-440a-4d33-b9e5-9f4ac1126696/crypt/debug", "/pool/ext/8d122e51-f03c-4659-8af4-3a5baca809c5/crypt/debug", "/pool/ext/ebfff57f-9cb4-47bd-acd3-b83eb13e21b5/crypt/debug", "/pool/ext/d7b58ec6-9f7e-464f-b0dc-a0d484ac88ac/crypt/debug", "/pool/ext/ad207096-a29a-4bc7-b04f-7cf8a526e7ae/crypt/debug", "/pool/ext/a952a3c4-f4b2-4c9a-a310-fb464cba0cce/crypt/debug", "/pool/ext/45dbe21c-5eaa-4707-b822-d1348b4d8afc/crypt/debug", "/pool/ext/378b1d3c-0145-41bf-ab1f-16bc3c7930e7/crypt/debug", "/pool/ext/4bf1df73-f4b5-4c23-85b8-9b365d6ea8ae/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_23cacdc9-61c5-437c-b8c1-d2c8e002a6eb
30592024-12-18T22:25:44.762ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 866511705708655722 n_samples = 6 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
30602024-12-18T22:25:45.405ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1142 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_23cacdc9-61c5-437c-b8c1-d2c8e002a6eb", bundle_id: 6a228645-aae9-4087-b899-80fc4d6c5482 }, time_created: 2024-12-18T22:25:44.763044181Z, version: 0, cause: TerminatedInstance }
30612024-12-18T22:25:45.406ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_23cacdc9-61c5-437c-b8c1-d2c8e002a6eb file = sled-agent/src/instance.rs:1032 instance_id = 861b1718-78dd-4ee4-9019-f03d9609c535 propolis_id = 23cacdc9-61c5-437c-b8c1-d2c8e002a6eb
30622024-12-18T22:25:47.180ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:279 instance_id = 861b1718-78dd-4ee4-9019-f03d9609c535 propolis_id = 23cacdc9-61c5-437c-b8c1-d2c8e002a6eb
30632024-12-18T22:25:47.196ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(4492759), kind: System }
30642024-12-18T22:25:47.196ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(4492759), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
30652024-12-18T22:25:47.196ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 861b1718-78dd-4ee4-9019-f03d9609c535 propolis_id = 23cacdc9-61c5-437c-b8c1-d2c8e002a6eb state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-18T22:25:47.196381843Z }, migration_in: None, migration_out: None }
30662024-12-18T22:25:47.298ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 861b1718-78dd-4ee4-9019-f03d9609c535 propolis_id = 23cacdc9-61c5-437c-b8c1-d2c8e002a6eb state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-18T22:25:47.196381843Z }, migration_in: None, migration_out: None }
30672024-12-18T22:25:47.311ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:969 instance_id = 861b1718-78dd-4ee4-9019-f03d9609c535 propolis_id = 23cacdc9-61c5-437c-b8c1-d2c8e002a6eb
30682024-12-18T22:25:47.361ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:57021
30692024-12-18T22:25:47.361ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:57021 req_id = bbaca346-1394-4cc0-a04e-8bd2dd2762e5 response_code = 200 uri = /baseboard
30702024-12-18T22:25:47.911ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46353
30712024-12-18T22:25:47.911ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46353 req_id = 3eabd8f9-c547-4946-af97-9ca74e8829e0 response_code = 200 uri = /vpc-routes
30722024-12-18T22:25:47.960ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 values = ExternalIpGatewayMap { mappings: {} }
30732024-12-18T22:25:47.960ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1240 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3
30742024-12-18T22:25:47.960ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 180 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46353 req_id = 2dd7803c-7dd4-41c0-952e-eca2b6aaf337 response_code = 204 uri = /eip-gateways
30752024-12-18T22:25:47.969ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46353 req_id = 62199d18-d8e9-47b9-a4f1-a27b24cccb48 response_code = 204 uri = /vpc-routes
30762024-12-18T22:25:48.030ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35409
30772024-12-18T22:25:48.030ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35409 req_id = 15928868-ecd6-4200-9d82-4aab7d0a2e2b response_code = 200 uri = /v2p
30782024-12-18T22:25:48.241ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54395
30792024-12-18T22:25:48.241ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54395 req_id = 66f83536-e887-49dd-8abc-16191c4c7b31 response_code = 200 uri = /v2p
30802024-12-18T22:25:48.300ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64500
30812024-12-18T22:25:48.300ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64500 req_id = ae978dba-1b97-4df8-8777-ddcb291c006a response_code = 200 uri = /vpc-routes
30822024-12-18T22:25:48.313ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 values = ExternalIpGatewayMap { mappings: {} }
30832024-12-18T22:25:48.313ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64500 req_id = 964c0b5b-12f6-4cca-b15e-1a528bed0868 response_code = 204 uri = /eip-gateways
30842024-12-18T22:25:48.322ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64500 req_id = 1a6ddd40-deb8-4b87-990c-e993670bd687 response_code = 204 uri = /vpc-routes
30852024-12-18T22:25:49.087ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33121
30862024-12-18T22:25:49.087ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33121 req_id = 9fdaa3e6-67ac-43fd-ade3-c58012378aad response_code = 200 uri = /vpc-routes
30872024-12-18T22:25:49.132ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 values = ExternalIpGatewayMap { mappings: {} }
30882024-12-18T22:25:49.132ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33121 req_id = c11e0ab8-32f4-4b51-88e4-761fdb28c62b response_code = 204 uri = /eip-gateways
30892024-12-18T22:25:49.140ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 199 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33121 req_id = 88777e92-4cc0-4f04-878f-e1a6180578f7 response_code = 204 uri = /vpc-routes