Max level shown:
1 [ Dec 19 05:48:55 Enabled. ]
2 [ Dec 19 05:48:55 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Dec 19 05:48:55 Method "start" exited with status 0. ]
4 [ Dec 19 05:48:55 Rereading configuration. ]
5 [ Dec 19 05:48:55 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72024-12-19T05:48:55.389ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:113
82024-12-19T05:48:55.389ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92024-12-19T05:48:55.441ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102024-12-19T05:48:55.441ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112024-12-19T05:48:55.553ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122024-12-19T05:48:55.562ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132024-12-19T05:48:55.571ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142024-12-19T05:48:56.171ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:9fb2::, width: 64 }
152024-12-19T05:48:56.311ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
162024-12-19T05:48:56.311ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
172024-12-19T05:48:56.311ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
182024-12-19T05:48:56.311ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192024-12-19T05:48:56.312ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:520
202024-12-19T05:48:56.312ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:717
212024-12-19T05:48:56.315ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "buskin", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:624
222024-12-19T05:48:56.315ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:766
232024-12-19T05:48:56.315ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
242024-12-19T05:48:56.315ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:825
252024-12-19T05:48:56.315ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
262024-12-19T05:48:56.315ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272024-12-19T05:48:56.315ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
282024-12-19T05:48:56.315ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292024-12-19T05:48:56.315ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302024-12-19T05:48:56.328ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:367
312024-12-19T05:48:56.328ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = e0de026f-6896-43b8-9686-b840d0967c1e (zpool)
322024-12-19T05:48:56.425ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: e0de026f-6896-43b8-9686-b840d0967c1e (zpool), kind: Internal }
332024-12-19T05:48:56.906ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:603
342024-12-19T05:48:56.906ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
352024-12-19T05:48:56.906ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362024-12-19T05:48:56.906ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372024-12-19T05:48:56.906ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
382024-12-19T05:48:56.906ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392024-12-19T05:48:56.906ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402024-12-19T05:48:56.914ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:367
412024-12-19T05:48:56.914ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = d2802dae-55e1-4039-8308-ca231b2dc40c (zpool)
422024-12-19T05:48:57.004ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: d2802dae-55e1-4039-8308-ca231b2dc40c (zpool), kind: Internal }
432024-12-19T05:48:57.485ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
442024-12-19T05:48:57.485ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e0de026f-6896-43b8-9686-b840d0967c1e (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d2802dae-55e1-4039-8308-ca231b2dc40c (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
452024-12-19T05:48:57.485ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
462024-12-19T05:48:57.485ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
472024-12-19T05:48:57.485ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
482024-12-19T05:48:57.485ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
492024-12-19T05:48:57.485ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
502024-12-19T05:48:57.485ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e0de026f-6896-43b8-9686-b840d0967c1e (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d2802dae-55e1-4039-8308-ca231b2dc40c (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
512024-12-19T05:48:57.485ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
522024-12-19T05:48:57.485ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
532024-12-19T05:48:57.485ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
542024-12-19T05:48:57.485ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
552024-12-19T05:48:57.485ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
562024-12-19T05:48:57.485ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e0de026f-6896-43b8-9686-b840d0967c1e (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d2802dae-55e1-4039-8308-ca231b2dc40c (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
572024-12-19T05:48:57.485ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
582024-12-19T05:48:57.485ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
592024-12-19T05:48:57.485ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
602024-12-19T05:48:57.485ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
612024-12-19T05:48:57.485ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
622024-12-19T05:48:57.485ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
632024-12-19T05:48:57.485ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
642024-12-19T05:48:57.485ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e0de026f-6896-43b8-9686-b840d0967c1e (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d2802dae-55e1-4039-8308-ca231b2dc40c (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
652024-12-19T05:48:57.485ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
662024-12-19T05:48:57.485ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
672024-12-19T05:48:57.485ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
682024-12-19T05:48:57.485ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
692024-12-19T05:48:57.485ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
702024-12-19T05:48:57.485ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e0de026f-6896-43b8-9686-b840d0967c1e (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d2802dae-55e1-4039-8308-ca231b2dc40c (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
712024-12-19T05:48:57.485ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
722024-12-19T05:48:57.485ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
732024-12-19T05:48:57.485ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
742024-12-19T05:48:57.485ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e0de026f-6896-43b8-9686-b840d0967c1e (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d2802dae-55e1-4039-8308-ca231b2dc40c (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
752024-12-19T05:48:57.485ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
762024-12-19T05:48:57.485ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
772024-12-19T05:48:57.485ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
782024-12-19T05:48:57.485ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
792024-12-19T05:48:57.485ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
802024-12-19T05:48:57.485ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e0de026f-6896-43b8-9686-b840d0967c1e (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d2802dae-55e1-4039-8308-ca231b2dc40c (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
812024-12-19T05:48:57.485ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
822024-12-19T05:48:57.485ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
832024-12-19T05:48:57.485ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
842024-12-19T05:48:57.485ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
852024-12-19T05:48:57.485ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
862024-12-19T05:48:57.485ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
872024-12-19T05:48:57.485ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
882024-12-19T05:48:57.485ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e0de026f-6896-43b8-9686-b840d0967c1e (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d2802dae-55e1-4039-8308-ca231b2dc40c (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
892024-12-19T05:48:57.485ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
902024-12-19T05:48:57.485ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
912024-12-19T05:48:57.485ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
922024-12-19T05:48:57.485ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
932024-12-19T05:48:57.485ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e0de026f-6896-43b8-9686-b840d0967c1e (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d2802dae-55e1-4039-8308-ca231b2dc40c (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
942024-12-19T05:48:57.486ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
952024-12-19T05:48:57.486ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
962024-12-19T05:48:57.486ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
972024-12-19T05:48:57.486ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
982024-12-19T05:48:57.486ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
992024-12-19T05:48:57.486ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e0de026f-6896-43b8-9686-b840d0967c1e (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d2802dae-55e1-4039-8308-ca231b2dc40c (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
1002024-12-19T05:48:57.486ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
1012024-12-19T05:48:57.486ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1022024-12-19T05:48:57.486ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1032024-12-19T05:48:57.486ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1042024-12-19T05:48:57.486ZINFOSledAgent (bootstore): No ledger in /pool/int/e0de026f-6896-43b8-9686-b840d0967c1e/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1052024-12-19T05:48:57.486ZINFOSledAgent (bootstore): No ledger in /pool/int/d2802dae-55e1-4039-8308-ca231b2dc40c/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1062024-12-19T05:48:57.486ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-buskin-i86pc
1072024-12-19T05:48:57.486ZINFOSledAgent (bootstore): No ledger in /pool/int/e0de026f-6896-43b8-9686-b840d0967c1e/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1082024-12-19T05:48:57.486ZINFOSledAgent (bootstore): No ledger in /pool/int/d2802dae-55e1-4039-8308-ca231b2dc40c/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1092024-12-19T05:48:57.486ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-buskin-i86pc
1102024-12-19T05:48:57.486ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1112024-12-19T05:48:57.486ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1122024-12-19T05:48:57.497ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:736
1132024-12-19T05:48:57.497ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1339, tv_nsec: 527255084 } time_to_next_cleanup = 599.999920198s
1142024-12-19T05:48:57.497ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3947
1152024-12-19T05:48:57.497ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1162024-12-19T05:48:57.500ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/e0de026f-6896-43b8-9686-b840d0967c1e/config/sled-agent-request.json file = common/src/ledger.rs:188
1172024-12-19T05:48:57.500ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/d2802dae-55e1-4039-8308-ca231b2dc40c/config/sled-agent-request.json file = common/src/ledger.rs:188
1182024-12-19T05:48:57.500ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80
1192024-12-19T05:48:57.502ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:9fb2::1]:12346
1202024-12-19T05:48:57.502ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.1.164, last: 10.151.1.173, }, ), ], external_dns_ips: [ 10.151.1.164, 10.151.1.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1203
1212024-12-19T05:48:57.502ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1222024-12-19T05:48:57.503ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1232024-12-19T05:48:57.503ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1242024-12-19T05:48:57.503ZINFOSledAgent (RSS): No ledger in /pool/int/e0de026f-6896-43b8-9686-b840d0967c1e/config/rss-started.marker file = common/src/ledger.rs:188
1252024-12-19T05:48:57.503ZINFOSledAgent (RSS): No ledger in /pool/int/d2802dae-55e1-4039-8308-ca231b2dc40c/config/rss-started.marker file = common/src/ledger.rs:188
1262024-12-19T05:48:57.503ZINFOSledAgent (RSS): No ledger in /pool/int/e0de026f-6896-43b8-9686-b840d0967c1e/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1272024-12-19T05:48:57.503ZINFOSledAgent (RSS): No ledger in /pool/int/d2802dae-55e1-4039-8308-ca231b2dc40c/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1282024-12-19T05:48:57.503ZINFOSledAgent (RSS): RSS not previously run. Creating plans. file = sled-agent/src/rack_setup/service.rs:1252
1292024-12-19T05:48:57.503ZINFOSledAgent (RSS): Writing ledger to /pool/int/e0de026f-6896-43b8-9686-b840d0967c1e/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1302024-12-19T05:48:57.503ZINFOSledAgent (RSS): Writing ledger to /pool/int/d2802dae-55e1-4039-8308-ca231b2dc40c/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1312024-12-19T05:48:57.503ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1284
1322024-12-19T05:48:57.503ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:66
1332024-12-19T05:48:57.503ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:9fb2::1 file = sled-agent/src/rack_setup/plan/sled.rs:39
1342024-12-19T05:48:57.503ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1316
1352024-12-19T05:48:57.503ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
1362024-12-19T05:48:57.503ZINFOSledAgent (bootstore): Writing ledger to /pool/int/e0de026f-6896-43b8-9686-b840d0967c1e/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
1372024-12-19T05:48:57.503ZINFOSledAgent (bootstore): Writing ledger to /pool/int/d2802dae-55e1-4039-8308-ca231b2dc40c/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
1382024-12-19T05:48:57.503ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
1392024-12-19T05:48:57.503ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: a9851483-adb5-4271-9f27-41db71133b55 (sled), rack_id: 0a0969bd-a4d0-497b-839e-e0d088b15b4e, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
1402024-12-19T05:48:57.504ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4244
1412024-12-19T05:48:57.504ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4644
1422024-12-19T05:48:57.508ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/client.rs:50
1432024-12-19T05:48:57.514ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1442024-12-19T05:48:57.515ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1452024-12-19T05:48:57.519ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1462024-12-19T05:48:57.519ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1472024-12-19T05:48:57.519ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:42368
1482024-12-19T05:48:57.519ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: a9851483-adb5-4271-9f27-41db71133b55 (sled), rack_id: 0a0969bd-a4d0-497b-839e-e0d088b15b4e, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:362
1492024-12-19T05:48:57.519ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:377
1502024-12-19T05:48:57.519ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1512024-12-19T05:48:57.519ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1522024-12-19T05:48:57.519ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:603
1532024-12-19T05:48:57.519ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:809
1542024-12-19T05:48:57.519ZINFOSledAgent (StorageManager): No ledger in /pool/int/e0de026f-6896-43b8-9686-b840d0967c1e/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1552024-12-19T05:48:57.519ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1562024-12-19T05:48:57.519ZINFOSledAgent (StorageManager): No ledger in /pool/int/d2802dae-55e1-4039-8308-ca231b2dc40c/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1572024-12-19T05:48:57.519ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:798
1582024-12-19T05:48:57.519ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:826
1592024-12-19T05:48:57.519ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:592
1602024-12-19T05:48:57.519ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1612024-12-19T05:48:57.519ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:697 result = DisksManagementResult { status: [] }
1622024-12-19T05:48:57.535ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1632024-12-19T05:48:57.555ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:325
1642024-12-19T05:48:57.572ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:363
1652024-12-19T05:48:57.597ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:415 sled_id = a9851483-adb5-4271-9f27-41db71133b55
1662024-12-19T05:48:57.597ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1672024-12-19T05:48:57.597ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:427 sled_id = a9851483-adb5-4271-9f27-41db71133b55
1682024-12-19T05:48:57.597ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1692024-12-19T05:48:57.599ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 120.094176ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "8e7a7491-2875-4850-96c4-1ed709214aa8", "content-length": "124", "date": "Thu, 19 Dec 2024 05:48:57 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "8e7a7491-2875-4850-96c4-1ed709214aa8" } file = clients/ddm-admin-client/src/lib.rs:177
1702024-12-19T05:48:57.609ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_e0de026f-6896-43b8-9686-b840d0967c1e/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1712024-12-19T05:48:57.633ZINFOSledAgent: successfully created encrypted zvol: name="oxi_e0de026f-6896-43b8-9686-b840d0967c1e/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1722024-12-19T05:48:57.633ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_e0de026f-6896-43b8-9686-b840d0967c1e/swap" file = sled-agent/src/swap_device.rs:96
1732024-12-19T05:48:57.638ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:442 sled_id = a9851483-adb5-4271-9f27-41db71133b55
1742024-12-19T05:48:57.638ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:128
1752024-12-19T05:48:57.638ZINFOSledAgent (BackingFs): Ensuring dataset oxi_e0de026f-6896-43b8-9686-b840d0967c1e/backing/fmd file = sled-agent/src/backing_fs.rs:138
1762024-12-19T05:48:57.720ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1772024-12-19T05:48:57.724ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 164.187483ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "0a4a1c8c-0741-4854-a2a9-a46d258d75ac", "content-length": "124", "date": "Thu, 19 Dec 2024 05:48:57 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "0a4a1c8c-0741-4854-a2a9-a46d258d75ac" } file = clients/ddm-admin-client/src/lib.rs:177
1782024-12-19T05:48:57.728ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:173
1792024-12-19T05:48:57.889ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1802024-12-19T05:48:57.890ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 183.543371ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "a16ea0ac-b94d-447e-bdd9-ed0563d88da7", "content-length": "124", "date": "Thu, 19 Dec 2024 05:48:57 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "a16ea0ac-b94d-447e-bdd9-ed0563d88da7" } file = clients/ddm-admin-client/src/lib.rs:177
1812024-12-19T05:48:57.946ZINFOSledAgent (BackingFs): Mounting oxi_e0de026f-6896-43b8-9686-b840d0967c1e/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:181
1822024-12-19T05:48:57.959ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:189
1832024-12-19T05:48:57.959ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:189
1842024-12-19T05:48:57.959ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:189
1852024-12-19T05:48:57.959ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:195
1862024-12-19T05:48:58.075ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1872024-12-19T05:48:58.076ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 217.606968ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "8a9f741c-f7c2-459a-9297-a994e1420762", "content-length": "124", "date": "Thu, 19 Dec 2024 05:48:57 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "8a9f741c-f7c2-459a-9297-a994e1420762" } file = clients/ddm-admin-client/src/lib.rs:177
1882024-12-19T05:48:58.295ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1892024-12-19T05:48:58.295ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 193.22385ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "713e6f7f-0f96-4ddc-aebb-a79f4688a159", "content-length": "124", "date": "Thu, 19 Dec 2024 05:48:57 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "713e6f7f-0f96-4ddc-aebb-a79f4688a159" } file = clients/ddm-admin-client/src/lib.rs:177
1902024-12-19T05:48:58.490ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1912024-12-19T05:48:58.490ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 256.553385ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "8163487e-8aa3-4895-a817-39df98202eb0", "content-length": "124", "date": "Thu, 19 Dec 2024 05:48:57 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "8163487e-8aa3-4895-a817-39df98202eb0" } file = clients/ddm-admin-client/src/lib.rs:177
1922024-12-19T05:48:58.694ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:93 sled_id = a9851483-adb5-4271-9f27-41db71133b55
1932024-12-19T05:48:58.700ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:34192 sled_id = a9851483-adb5-4271-9f27-41db71133b55
1942024-12-19T05:48:58.700ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111 sled_id = a9851483-adb5-4271-9f27-41db71133b55
1952024-12-19T05:48:58.700ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:34192 file = oximeter/producer/src/lib.rs:279 interval = 30s producer_id = a9851483-adb5-4271-9f27-41db71133b55 sled_id = a9851483-adb5-4271-9f27-41db71133b55
1962024-12-19T05:48:58.701ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 136.412637ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = a9851483-adb5-4271-9f27-41db71133b55
1972024-12-19T05:48:58.702ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = a9851483-adb5-4271-9f27-41db71133b55
1982024-12-19T05:48:58.702ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = a9851483-adb5-4271-9f27-41db71133b55
1992024-12-19T05:48:58.702ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:920 underlay_address = fd00:1122:3344:101::1
2002024-12-19T05:48:58.702ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
2012024-12-19T05:48:58.747ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
2022024-12-19T05:48:58.840ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 484.709786ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = a9851483-adb5-4271-9f27-41db71133b55
2032024-12-19T05:48:59.326ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.360369307s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = a9851483-adb5-4271-9f27-41db71133b55
2042024-12-19T05:49:00.689ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.306936959s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = a9851483-adb5-4271-9f27-41db71133b55
2052024-12-19T05:49:01.251ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2668
2062024-12-19T05:49:01.251ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2913
2072024-12-19T05:49:01.251ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2538
2082024-12-19T05:49:01.251ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2585
2092024-12-19T05:49:01.251ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:2994
2102024-12-19T05:49:01.251ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3039
2112024-12-19T05:49:01.253ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2838
2122024-12-19T05:49:01.255ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2579
2132024-12-19T05:49:01.255ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='1f809358-47f3-4bc6-9997-89b7fadf6477'/> <propval type="astring" name="rack_id" value='0a0969bd-a4d0-497b-839e-e0d088b15b4e'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:9fb2::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:fe54:2ac9'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:9fb2::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"buskin","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="rack_id" value='0a0969bd-a4d0-497b-839e-e0d088b15b4e'/> <propval type="astring" name="sled_id" value='a9851483-adb5-4271-9f27-41db71133b55'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='buskin'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="host" value='[::1]'/> <propval type="astring" name="port" value='12224'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='buskin'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='a9851483-adb5-4271-9f27-41db71133b55'/> <propval type="astring" name="rack_uuid" value='0a0969bd-a4d0-497b-839e-e0d088b15b4e'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='a9851483-adb5-4271-9f27-41db71133b55'/> <propval type="astring" name="rack_uuid" value='0a0969bd-a4d0-497b-839e-e0d088b15b4e'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2142024-12-19T05:49:01.255ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_switch
2152024-12-19T05:49:01.669ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 41.32822ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2162024-12-19T05:49:01.866ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 54.917211ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2172024-12-19T05:49:02.078ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 114.596825ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2182024-12-19T05:49:02.079ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 2.213070014s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = a9851483-adb5-4271-9f27-41db71133b55
2192024-12-19T05:49:02.277ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 386.130707ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2202024-12-19T05:49:02.685ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 852.791356ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2212024-12-19T05:49:03.548ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 649.785082ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2222024-12-19T05:49:04.357ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.300643407s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2232024-12-19T05:49:04.358ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 11.403360979s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = a9851483-adb5-4271-9f27-41db71133b55
2242024-12-19T05:49:05.817ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 857.24868ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2252024-12-19T05:49:06.690ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.020196152s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2262024-12-19T05:49:08.092ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/a9851483-adb5-4271-9f27-41db71133b55) file = sled-agent/src/nexus.rs:527 sled_id = a9851483-adb5-4271-9f27-41db71133b55
2272024-12-19T05:49:08.122ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2282024-12-19T05:49:08.122ZINFOSledAgent (dropshot (Repo Depot)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12348 sled_id = a9851483-adb5-4271-9f27-41db71133b55
2292024-12-19T05:49:08.123ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12345
2302024-12-19T05:49:08.123ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:432
2312024-12-19T05:49:08.123ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2322024-12-19T05:49:08.123ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/e0de026f-6896-43b8-9686-b840d0967c1e/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2332024-12-19T05:49:08.124ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/d2802dae-55e1-4039-8308-ca231b2dc40c/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2342024-12-19T05:49:08.124ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2352024-12-19T05:49:08.124ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some(None), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None }], bgp: [], bfd: [] })))
2362024-12-19T05:49:08.124ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3947
2372024-12-19T05:49:08.124ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:42368
2382024-12-19T05:49:08.327ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:9fb2::1]:12346
2392024-12-19T05:49:08.327ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
2402024-12-19T05:49:08.332ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4268 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2412024-12-19T05:49:08.332ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:4284
2422024-12-19T05:49:08.332ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:534 zone = oxz_switch
2432024-12-19T05:49:08.601ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62556
2442024-12-19T05:49:08.602ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2452024-12-19T05:49:08.602ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2462024-12-19T05:49:08.602ZINFOSledAgent (ServiceManager): No ledger in /pool/int/e0de026f-6896-43b8-9686-b840d0967c1e/config/omicron-zones.json file = common/src/ledger.rs:188
2472024-12-19T05:49:08.602ZINFOSledAgent (ServiceManager): No ledger in /pool/int/d2802dae-55e1-4039-8308-ca231b2dc40c/config/omicron-zones.json file = common/src/ledger.rs:188
2482024-12-19T05:49:08.602ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 440 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:62556 req_id = d72817f7-d2ee-41d4-b5b5-0cbe93450300 response_code = 200 uri = /inventory
2492024-12-19T05:49:08.632ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48424
2502024-12-19T05:49:08.632ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:48424 req_id = c4161410-984d-4d3b-a90e-99796660df51 response_code = 200 uri = /sled-role
2512024-12-19T05:49:08.662ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: e2754090-6a87-4c79-ac54-ef7079bb85c9 (physical_disk), pool_id: f1c83160-c846-4e0a-a537-6a326722ac5a (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 0e28385d-60a5-449d-b642-c57110f23454 (physical_disk), pool_id: 436ef9e1-c612-46c3-866b-9e48c044fdf2 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: eee1155d-b072-4c22-b5c7-5463a5275cfb (physical_disk), pool_id: defcb6a1-2bbe-47a6-a426-436ed60fd6fc (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 7ec6ab04-964d-4ba2-925e-4539b455da63 (physical_disk), pool_id: a0552d97-e3e6-4586-a789-e6bcdec66672 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 561a7829-db0f-43a7-839e-f5146273fec6 (physical_disk), pool_id: 0cdd8476-a0d8-44ca-a74b-0704c56ede98 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: ec693b08-ba16-409b-bca3-ce41680bedc8 (physical_disk), pool_id: 0686bda3-5eb8-4859-ac7b-e5a6ceb8616d (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: b679a9f9-0492-460a-ab92-bc6df3110538 (physical_disk), pool_id: 1fd2ac0f-93a9-44e1-a6b3-7ccfcdc6b252 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 836b2a78-ec3f-4804-8128-91898e5258ca (physical_disk), pool_id: b5578c06-5ed8-4225-9470-d661174b141e (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 3f629669-4f10-41ab-bc84-2ffc29f744c0 (physical_disk), pool_id: c12c68d5-6ddb-4829-80b0-49f80baef150 (zpool) }] } file = sled-agent/src/rack_setup/service.rs:385 sled_address = [fd00:1122:3344:101::1]:12345
2522024-12-19T05:49:08.662ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42624
2532024-12-19T05:49:08.662ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:896 sled_id = a9851483-adb5-4271-9f27-41db71133b55
2542024-12-19T05:49:08.662ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: e2754090-6a87-4c79-ac54-ef7079bb85c9 (physical_disk), pool_id: f1c83160-c846-4e0a-a537-6a326722ac5a (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 0e28385d-60a5-449d-b642-c57110f23454 (physical_disk), pool_id: 436ef9e1-c612-46c3-866b-9e48c044fdf2 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: eee1155d-b072-4c22-b5c7-5463a5275cfb (physical_disk), pool_id: defcb6a1-2bbe-47a6-a426-436ed60fd6fc (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 7ec6ab04-964d-4ba2-925e-4539b455da63 (physical_disk), pool_id: a0552d97-e3e6-4586-a789-e6bcdec66672 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 561a7829-db0f-43a7-839e-f5146273fec6 (physical_disk), pool_id: 0cdd8476-a0d8-44ca-a74b-0704c56ede98 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: ec693b08-ba16-409b-bca3-ce41680bedc8 (physical_disk), pool_id: 0686bda3-5eb8-4859-ac7b-e5a6ceb8616d (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: b679a9f9-0492-460a-ab92-bc6df3110538 (physical_disk), pool_id: 1fd2ac0f-93a9-44e1-a6b3-7ccfcdc6b252 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 836b2a78-ec3f-4804-8128-91898e5258ca (physical_disk), pool_id: b5578c06-5ed8-4225-9470-d661174b141e (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 3f629669-4f10-41ab-bc84-2ffc29f744c0 (physical_disk), pool_id: c12c68d5-6ddb-4829-80b0-49f80baef150 (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:603
2552024-12-19T05:49:08.662ZINFOSledAgent (StorageManager): No ledger in /pool/int/e0de026f-6896-43b8-9686-b840d0967c1e/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2562024-12-19T05:49:08.662ZINFOSledAgent (StorageManager): No ledger in /pool/int/d2802dae-55e1-4039-8308-ca231b2dc40c/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2572024-12-19T05:49:08.662ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:1171 request = omicron_physical_disks_ensure
2582024-12-19T05:49:08.662ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2592024-12-19T05:49:08.662ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2602024-12-19T05:49:08.662ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2612024-12-19T05:49:08.662ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2622024-12-19T05:49:08.794ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5534721212470721226 sled_id = a9851483-adb5-4271-9f27-41db71133b55
2632024-12-19T05:49:08.794ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7823616040735775052 sled_id = a9851483-adb5-4271-9f27-41db71133b55
2642024-12-19T05:49:08.801ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:367
2652024-12-19T05:49:08.801ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = f1c83160-c846-4e0a-a537-6a326722ac5a (zpool)
2662024-12-19T05:49:09.003ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = a9851483-adb5-4271-9f27-41db71133b55
2672024-12-19T05:49:09.097ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: f1c83160-c846-4e0a-a537-6a326722ac5a (zpool), kind: External }
2682024-12-19T05:49:09.106ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:240
2692024-12-19T05:49:09.106ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:242
2702024-12-19T05:49:09.106ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:246
2712024-12-19T05:49:09.106ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:248
2722024-12-19T05:49:09.106ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2732024-12-19T05:49:09.106ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2742024-12-19T05:49:09.106ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
2752024-12-19T05:49:09.125ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/a9851483-adb5-4271-9f27-41db71133b55) file = sled-agent/src/probe_manager.rs:231 sled_id = a9851483-adb5-4271-9f27-41db71133b55
2762024-12-19T05:49:09.142ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2772024-12-19T05:49:09.150ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_f1c83160-c846-4e0a-a537-6a326722ac5a/crypt/zone file = sled-storage/src/dataset.rs:303
2782024-12-19T05:49:09.319ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_f1c83160-c846-4e0a-a537-6a326722ac5a file = sled-storage/src/dataset.rs:389
2792024-12-19T05:49:09.327ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
2802024-12-19T05:49:09.327ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
2812024-12-19T05:49:09.327ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
2822024-12-19T05:49:09.327ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2832024-12-19T05:49:09.327ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2842024-12-19T05:49:09.337ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:367
2852024-12-19T05:49:09.337ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 436ef9e1-c612-46c3-866b-9e48c044fdf2 (zpool)
2862024-12-19T05:49:09.427ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 436ef9e1-c612-46c3-866b-9e48c044fdf2 (zpool), kind: External }
2872024-12-19T05:49:09.435ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:240
2882024-12-19T05:49:09.435ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:242
2892024-12-19T05:49:09.435ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:246
2902024-12-19T05:49:09.435ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:248
2912024-12-19T05:49:09.435ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2922024-12-19T05:49:09.435ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2932024-12-19T05:49:09.435ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
2942024-12-19T05:49:09.469ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2952024-12-19T05:49:09.477ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_436ef9e1-c612-46c3-866b-9e48c044fdf2/crypt/zone file = sled-storage/src/dataset.rs:303
2962024-12-19T05:49:09.649ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_436ef9e1-c612-46c3-866b-9e48c044fdf2 file = sled-storage/src/dataset.rs:389
2972024-12-19T05:49:09.657ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
2982024-12-19T05:49:09.657ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
2992024-12-19T05:49:09.657ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
3002024-12-19T05:49:09.657ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3012024-12-19T05:49:09.657ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3022024-12-19T05:49:09.666ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:367
3032024-12-19T05:49:09.666ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = defcb6a1-2bbe-47a6-a426-436ed60fd6fc (zpool)
3042024-12-19T05:49:09.758ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: defcb6a1-2bbe-47a6-a426-436ed60fd6fc (zpool), kind: External }
3052024-12-19T05:49:09.766ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:240
3062024-12-19T05:49:09.766ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:242
3072024-12-19T05:49:09.766ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:246
3082024-12-19T05:49:09.766ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:248
3092024-12-19T05:49:09.766ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3102024-12-19T05:49:09.766ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3112024-12-19T05:49:09.766ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3122024-12-19T05:49:09.800ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3132024-12-19T05:49:09.807ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_defcb6a1-2bbe-47a6-a426-436ed60fd6fc/crypt/zone file = sled-storage/src/dataset.rs:303
3142024-12-19T05:49:09.980ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_defcb6a1-2bbe-47a6-a426-436ed60fd6fc file = sled-storage/src/dataset.rs:389
3152024-12-19T05:49:09.988ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3162024-12-19T05:49:09.988ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3172024-12-19T05:49:09.988ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3182024-12-19T05:49:09.988ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3192024-12-19T05:49:09.988ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3202024-12-19T05:49:09.999ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:367
3212024-12-19T05:49:09.999ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = a0552d97-e3e6-4586-a789-e6bcdec66672 (zpool)
3222024-12-19T05:49:10.092ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: a0552d97-e3e6-4586-a789-e6bcdec66672 (zpool), kind: External }
3232024-12-19T05:49:10.099ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:240
3242024-12-19T05:49:10.100ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:242
3252024-12-19T05:49:10.100ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:246
3262024-12-19T05:49:10.100ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:248
3272024-12-19T05:49:10.100ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3282024-12-19T05:49:10.100ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3292024-12-19T05:49:10.100ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3302024-12-19T05:49:10.131ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/a9851483-adb5-4271-9f27-41db71133b55) file = sled-agent/src/probe_manager.rs:231 sled_id = a9851483-adb5-4271-9f27-41db71133b55
3312024-12-19T05:49:10.133ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3322024-12-19T05:49:10.142ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_a0552d97-e3e6-4586-a789-e6bcdec66672/crypt/zone file = sled-storage/src/dataset.rs:303
3332024-12-19T05:49:10.315ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_a0552d97-e3e6-4586-a789-e6bcdec66672 file = sled-storage/src/dataset.rs:389
3342024-12-19T05:49:10.323ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3352024-12-19T05:49:10.323ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3362024-12-19T05:49:10.323ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3372024-12-19T05:49:10.323ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3382024-12-19T05:49:10.323ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3392024-12-19T05:49:10.334ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:367
3402024-12-19T05:49:10.334ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 0cdd8476-a0d8-44ca-a74b-0704c56ede98 (zpool)
3412024-12-19T05:49:10.428ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 0cdd8476-a0d8-44ca-a74b-0704c56ede98 (zpool), kind: External }
3422024-12-19T05:49:10.435ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:240
3432024-12-19T05:49:10.435ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:242
3442024-12-19T05:49:10.435ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:246
3452024-12-19T05:49:10.435ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:248
3462024-12-19T05:49:10.435ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3472024-12-19T05:49:10.436ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3482024-12-19T05:49:10.436ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3492024-12-19T05:49:10.472ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3502024-12-19T05:49:10.480ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_0cdd8476-a0d8-44ca-a74b-0704c56ede98/crypt/zone file = sled-storage/src/dataset.rs:303
3512024-12-19T05:49:10.652ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_0cdd8476-a0d8-44ca-a74b-0704c56ede98 file = sled-storage/src/dataset.rs:389
3522024-12-19T05:49:10.659ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3532024-12-19T05:49:10.659ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3542024-12-19T05:49:10.659ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3552024-12-19T05:49:10.659ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3562024-12-19T05:49:10.659ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3572024-12-19T05:49:10.668ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:367
3582024-12-19T05:49:10.668ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 0686bda3-5eb8-4859-ac7b-e5a6ceb8616d (zpool)
3592024-12-19T05:49:10.762ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 0686bda3-5eb8-4859-ac7b-e5a6ceb8616d (zpool), kind: External }
3602024-12-19T05:49:10.770ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:240
3612024-12-19T05:49:10.770ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:242
3622024-12-19T05:49:10.770ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:246
3632024-12-19T05:49:10.770ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:248
3642024-12-19T05:49:10.770ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3652024-12-19T05:49:10.770ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3662024-12-19T05:49:10.770ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3672024-12-19T05:49:10.804ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3682024-12-19T05:49:10.811ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_0686bda3-5eb8-4859-ac7b-e5a6ceb8616d/crypt/zone file = sled-storage/src/dataset.rs:303
3692024-12-19T05:49:10.981ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_0686bda3-5eb8-4859-ac7b-e5a6ceb8616d file = sled-storage/src/dataset.rs:389
3702024-12-19T05:49:10.989ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3712024-12-19T05:49:10.989ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3722024-12-19T05:49:10.989ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3732024-12-19T05:49:10.989ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3742024-12-19T05:49:10.989ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3752024-12-19T05:49:10.999ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:367
3762024-12-19T05:49:10.999ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 1fd2ac0f-93a9-44e1-a6b3-7ccfcdc6b252 (zpool)
3772024-12-19T05:49:11.091ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 1fd2ac0f-93a9-44e1-a6b3-7ccfcdc6b252 (zpool), kind: External }
3782024-12-19T05:49:11.100ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:240
3792024-12-19T05:49:11.100ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:242
3802024-12-19T05:49:11.100ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:246
3812024-12-19T05:49:11.100ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:248
3822024-12-19T05:49:11.100ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3832024-12-19T05:49:11.100ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3842024-12-19T05:49:11.100ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3852024-12-19T05:49:11.132ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/a9851483-adb5-4271-9f27-41db71133b55) file = sled-agent/src/probe_manager.rs:231 sled_id = a9851483-adb5-4271-9f27-41db71133b55
3862024-12-19T05:49:11.140ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3872024-12-19T05:49:11.148ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_1fd2ac0f-93a9-44e1-a6b3-7ccfcdc6b252/crypt/zone file = sled-storage/src/dataset.rs:303
3882024-12-19T05:49:11.329ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_1fd2ac0f-93a9-44e1-a6b3-7ccfcdc6b252 file = sled-storage/src/dataset.rs:389
3892024-12-19T05:49:11.337ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
3902024-12-19T05:49:11.337ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
3912024-12-19T05:49:11.337ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
3922024-12-19T05:49:11.337ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3932024-12-19T05:49:11.337ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
3942024-12-19T05:49:11.347ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:367
3952024-12-19T05:49:11.347ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = b5578c06-5ed8-4225-9470-d661174b141e (zpool)
3962024-12-19T05:49:11.448ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: b5578c06-5ed8-4225-9470-d661174b141e (zpool), kind: External }
3972024-12-19T05:49:11.456ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:240
3982024-12-19T05:49:11.456ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:242
3992024-12-19T05:49:11.456ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:246
4002024-12-19T05:49:11.456ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:248
4012024-12-19T05:49:11.457ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4022024-12-19T05:49:11.457ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4032024-12-19T05:49:11.457ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
4042024-12-19T05:49:11.494ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4052024-12-19T05:49:11.504ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_b5578c06-5ed8-4225-9470-d661174b141e/crypt/zone file = sled-storage/src/dataset.rs:303
4062024-12-19T05:49:11.673ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_b5578c06-5ed8-4225-9470-d661174b141e file = sled-storage/src/dataset.rs:389
4072024-12-19T05:49:11.680ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
4082024-12-19T05:49:11.680ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4092024-12-19T05:49:11.680ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4102024-12-19T05:49:11.680ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4112024-12-19T05:49:11.680ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4122024-12-19T05:49:11.690ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:367
4132024-12-19T05:49:11.690ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = c12c68d5-6ddb-4829-80b0-49f80baef150 (zpool)
4142024-12-19T05:49:11.788ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: c12c68d5-6ddb-4829-80b0-49f80baef150 (zpool), kind: External }
4152024-12-19T05:49:11.796ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:240
4162024-12-19T05:49:11.796ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:242
4172024-12-19T05:49:11.796ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:246
4182024-12-19T05:49:11.796ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:248
4192024-12-19T05:49:11.796ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4202024-12-19T05:49:11.796ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4212024-12-19T05:49:11.796ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
4222024-12-19T05:49:11.832ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4232024-12-19T05:49:11.841ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_c12c68d5-6ddb-4829-80b0-49f80baef150/crypt/zone file = sled-storage/src/dataset.rs:303
4242024-12-19T05:49:12.014ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_c12c68d5-6ddb-4829-80b0-49f80baef150 file = sled-storage/src/dataset.rs:389
4252024-12-19T05:49:12.022ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4262024-12-19T05:49:12.022ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4272024-12-19T05:49:12.022ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/e0de026f-6896-43b8-9686-b840d0967c1e/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4282024-12-19T05:49:12.022ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(2), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e0de026f-6896-43b8-9686-b840d0967c1e (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d2802dae-55e1-4039-8308-ca231b2dc40c (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f1c83160-c846-4e0a-a537-6a326722ac5a (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 436ef9e1-c612-46c3-866b-9e48c044fdf2 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: defcb6a1-2bbe-47a6-a426-436ed60fd6fc (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a0552d97-e3e6-4586-a789-e6bcdec66672 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 0cdd8476-a0d8-44ca-a74b-0704c56ede98 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 0686bda3-5eb8-4859-ac7b-e5a6ceb8616d (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 1fd2ac0f-93a9-44e1-a6b3-7ccfcdc6b252 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b5578c06-5ed8-4225-9470-d661174b141e (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: c12c68d5-6ddb-4829-80b0-49f80baef150 (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4292024-12-19T05:49:12.022ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
4302024-12-19T05:49:12.022ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
4312024-12-19T05:49:12.022ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/d2802dae-55e1-4039-8308-ca231b2dc40c/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4322024-12-19T05:49:12.023ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:900 sled_id = a9851483-adb5-4271-9f27-41db71133b55
4332024-12-19T05:49:12.023ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
4342024-12-19T05:49:12.023ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:926 generation = Generation(2) sled_id = a9851483-adb5-4271-9f27-41db71133b55
4352024-12-19T05:49:12.023ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:931 sled_id = a9851483-adb5-4271-9f27-41db71133b55
4362024-12-19T05:49:12.023ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:936 sled_id = a9851483-adb5-4271-9f27-41db71133b55
4372024-12-19T05:49:12.023ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:122 gen = Generation(2) sled_id = a9851483-adb5-4271-9f27-41db71133b55
4382024-12-19T05:49:12.023ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:942 sled_id = a9851483-adb5-4271-9f27-41db71133b55
4392024-12-19T05:49:12.023ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(2)
4402024-12-19T05:49:12.023ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:947 sled_id = a9851483-adb5-4271-9f27-41db71133b55
4412024-12-19T05:49:12.023ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3360574 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:42624 req_id = f3810251-9839-4038-86d2-4ddd69413d04 response_code = 200 uri = /omicron-physical-disks
4422024-12-19T05:49:12.055ZINFOSledAgent (RSS): attempting to set up sled's datasets: DatasetsConfig { generation: Generation(1), datasets: {009c0092-bf7a-4a44-9c73-d36e24159157 (dataset): DatasetConfig { id: 009c0092-bf7a-4a44-9c73-d36e24159157 (dataset), name: DatasetName { pool_name: ZpoolName { id: defcb6a1-2bbe-47a6-a426-436ed60fd6fc (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 02a79886-6111-4347-9026-936ff4b6de5f (dataset): DatasetConfig { id: 02a79886-6111-4347-9026-936ff4b6de5f (dataset), name: DatasetName { pool_name: ZpoolName { id: 436ef9e1-c612-46c3-866b-9e48c044fdf2 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 049b11d4-4f38-4654-8e4d-eaba7d82fffa (dataset): DatasetConfig { id: 049b11d4-4f38-4654-8e4d-eaba7d82fffa (dataset), name: DatasetName { pool_name: ZpoolName { id: defcb6a1-2bbe-47a6-a426-436ed60fd6fc (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_33158fa9-57db-43e4-a282-d8c6f236773d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0976d54c-0ab6-4cee-92bc-3da03a5cb1d4 (dataset): DatasetConfig { id: 0976d54c-0ab6-4cee-92bc-3da03a5cb1d4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 436ef9e1-c612-46c3-866b-9e48c044fdf2 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_a059e970-dce9-484b-9af7-85f00f24e142" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 16e4b754-a39d-46a3-850a-ea0cc4c699b0 (dataset): DatasetConfig { id: 16e4b754-a39d-46a3-850a-ea0cc4c699b0 (dataset), name: DatasetName { pool_name: ZpoolName { id: defcb6a1-2bbe-47a6-a426-436ed60fd6fc (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_ecedc0eb-6c7d-4958-9fee-747c67187e55" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1819585a-33c7-4f89-86fa-535891bc4637 (dataset): DatasetConfig { id: 1819585a-33c7-4f89-86fa-535891bc4637 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1fd2ac0f-93a9-44e1-a6b3-7ccfcdc6b252 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_5aa1584b-558f-482f-872a-fff1fa879759" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1923f07e-5b8a-471a-96b9-51383f831e52 (dataset): DatasetConfig { id: 1923f07e-5b8a-471a-96b9-51383f831e52 (dataset), name: DatasetName { pool_name: ZpoolName { id: f1c83160-c846-4e0a-a537-6a326722ac5a (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 23cd0d59-9f14-4249-9b60-6aa71ba79a7f (dataset): DatasetConfig { id: 23cd0d59-9f14-4249-9b60-6aa71ba79a7f (dataset), name: DatasetName { pool_name: ZpoolName { id: 0686bda3-5eb8-4859-ac7b-e5a6ceb8616d (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 241ab4c8-dde5-47cf-bc8f-bfe2fe0a0d05 (dataset): DatasetConfig { id: 241ab4c8-dde5-47cf-bc8f-bfe2fe0a0d05 (dataset), name: DatasetName { pool_name: ZpoolName { id: 436ef9e1-c612-46c3-866b-9e48c044fdf2 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_75a56219-191b-4e5c-8eb1-d0e62e0c42f9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2522409a-b487-42dd-890a-d37eb6f0d972 (dataset): DatasetConfig { id: 2522409a-b487-42dd-890a-d37eb6f0d972 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0cdd8476-a0d8-44ca-a74b-0704c56ede98 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_a70a1db1-4ed4-460d-a7ae-0e54347df152" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 25b99aee-7ce6-43e0-9525-6157d6d912b0 (dataset): DatasetConfig { id: 25b99aee-7ce6-43e0-9525-6157d6d912b0 (dataset), name: DatasetName { pool_name: ZpoolName { id: b5578c06-5ed8-4225-9470-d661174b141e (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2a9ea8fd-fa2d-4232-9a22-240dc33c2803 (dataset): DatasetConfig { id: 2a9ea8fd-fa2d-4232-9a22-240dc33c2803 (dataset), name: DatasetName { pool_name: ZpoolName { id: f1c83160-c846-4e0a-a537-6a326722ac5a (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_bb4845ab-0600-4d61-a9f2-eb93a7cc0896" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3173e31c-4688-4f24-b5fb-92ea5684c2c1 (dataset): DatasetConfig { id: 3173e31c-4688-4f24-b5fb-92ea5684c2c1 (dataset), name: DatasetName { pool_name: ZpoolName { id: f1c83160-c846-4e0a-a537-6a326722ac5a (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_58ae657f-f744-4b0b-a838-01074a6743ed" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 36e3b320-cea6-464b-95e5-ba6a5b3f27b0 (dataset): DatasetConfig { id: 36e3b320-cea6-464b-95e5-ba6a5b3f27b0 (dataset), name: DatasetName { pool_name: ZpoolName { id: f1c83160-c846-4e0a-a537-6a326722ac5a (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_f6dcc1d5-458d-4c06-aac2-ae852ccaf5f0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 38833cc3-4373-4d0d-99fa-31d36614eea5 (dataset): DatasetConfig { id: 38833cc3-4373-4d0d-99fa-31d36614eea5 (dataset), name: DatasetName { pool_name: ZpoolName { id: defcb6a1-2bbe-47a6-a426-436ed60fd6fc (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_503e10f4-0146-46a7-bcc4-a71beb2225b2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3cbe7367-5357-4e3e-95b0-523911bfa4b6 (dataset): DatasetConfig { id: 3cbe7367-5357-4e3e-95b0-523911bfa4b6 (dataset), name: DatasetName { pool_name: ZpoolName { id: c12c68d5-6ddb-4829-80b0-49f80baef150 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3d4a35fd-3b48-4567-834c-fbd2bee549d5 (dataset): DatasetConfig { id: 3d4a35fd-3b48-4567-834c-fbd2bee549d5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 436ef9e1-c612-46c3-866b-9e48c044fdf2 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_1e0292d6-c327-472e-85e6-622aab78d10f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 45b816bb-3465-4cea-a1a4-1416be12d7ab (dataset): DatasetConfig { id: 45b816bb-3465-4cea-a1a4-1416be12d7ab (dataset), name: DatasetName { pool_name: ZpoolName { id: a0552d97-e3e6-4586-a789-e6bcdec66672 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_f534ccb4-1884-4b0c-b250-92aa7d3370a6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 488cc320-b1dd-480a-b9c9-7192cc65cb64 (dataset): DatasetConfig { id: 488cc320-b1dd-480a-b9c9-7192cc65cb64 (dataset), name: DatasetName { pool_name: ZpoolName { id: defcb6a1-2bbe-47a6-a426-436ed60fd6fc (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 498f4bbe-4e06-42bc-8235-3cc842a3352e (dataset): DatasetConfig { id: 498f4bbe-4e06-42bc-8235-3cc842a3352e (dataset), name: DatasetName { pool_name: ZpoolName { id: c12c68d5-6ddb-4829-80b0-49f80baef150 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_7701880a-5341-4c52-93af-e0d5f29a4650" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 504ddbbe-1210-422f-ba84-ae1bff393cab (dataset): DatasetConfig { id: 504ddbbe-1210-422f-ba84-ae1bff393cab (dataset), name: DatasetName { pool_name: ZpoolName { id: 0cdd8476-a0d8-44ca-a74b-0704c56ede98 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 54ef8803-54b7-470b-b7f3-f3b293ea5b38 (dataset): DatasetConfig { id: 54ef8803-54b7-470b-b7f3-f3b293ea5b38 (dataset), name: DatasetName { pool_name: ZpoolName { id: f1c83160-c846-4e0a-a537-6a326722ac5a (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 585a4e9e-51b0-455c-b412-43aa56f3cc9e (dataset): DatasetConfig { id: 585a4e9e-51b0-455c-b412-43aa56f3cc9e (dataset), name: DatasetName { pool_name: ZpoolName { id: 436ef9e1-c612-46c3-866b-9e48c044fdf2 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5b8f378f-a2bb-4e9f-a477-cb2f2e0d67a3 (dataset): DatasetConfig { id: 5b8f378f-a2bb-4e9f-a477-cb2f2e0d67a3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0686bda3-5eb8-4859-ac7b-e5a6ceb8616d (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5cbf83da-8f96-49cb-a292-3562d906d750 (dataset): DatasetConfig { id: 5cbf83da-8f96-49cb-a292-3562d906d750 (dataset), name: DatasetName { pool_name: ZpoolName { id: a0552d97-e3e6-4586-a789-e6bcdec66672 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 68a19795-865b-4f27-8962-e27da377b6e8 (dataset): DatasetConfig { id: 68a19795-865b-4f27-8962-e27da377b6e8 (dataset), name: DatasetName { pool_name: ZpoolName { id: f1c83160-c846-4e0a-a537-6a326722ac5a (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 6fa52b37-3bed-4a77-b2ca-8312b126b2fa (dataset): DatasetConfig { id: 6fa52b37-3bed-4a77-b2ca-8312b126b2fa (dataset), name: DatasetName { pool_name: ZpoolName { id: f1c83160-c846-4e0a-a537-6a326722ac5a (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_c32c373d-ccc1-45e0-bb27-49a4415e7fca" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7443ad79-71dd-40c6-9399-e4f65e12b4d2 (dataset): DatasetConfig { id: 7443ad79-71dd-40c6-9399-e4f65e12b4d2 (dataset), name: DatasetName { pool_name: ZpoolName { id: c12c68d5-6ddb-4829-80b0-49f80baef150 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7a1a5625-44d8-4b40-a491-b0d9896dfed3 (dataset): DatasetConfig { id: 7a1a5625-44d8-4b40-a491-b0d9896dfed3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 436ef9e1-c612-46c3-866b-9e48c044fdf2 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7cd70c72-2283-42d4-bfef-e2ead4978427 (dataset): DatasetConfig { id: 7cd70c72-2283-42d4-bfef-e2ead4978427 (dataset), name: DatasetName { pool_name: ZpoolName { id: a0552d97-e3e6-4586-a789-e6bcdec66672 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_1b5a99e2-3552-4a7c-bf7a-59d1fd251d45" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7da40331-fe53-491a-91cc-38e76ba5ae76 (dataset): DatasetConfig { id: 7da40331-fe53-491a-91cc-38e76ba5ae76 (dataset), name: DatasetName { pool_name: ZpoolName { id: c12c68d5-6ddb-4829-80b0-49f80baef150 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 7f7ad38b-20f9-4bfb-b9d0-b4e0d2d4f26a (dataset): DatasetConfig { id: 7f7ad38b-20f9-4bfb-b9d0-b4e0d2d4f26a (dataset), name: DatasetName { pool_name: ZpoolName { id: f1c83160-c846-4e0a-a537-6a326722ac5a (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_e31fad89-c82a-4b5e-8dad-c806db878c58" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7fa01183-cfd7-48fe-b1b3-6ee7bb13e656 (dataset): DatasetConfig { id: 7fa01183-cfd7-48fe-b1b3-6ee7bb13e656 (dataset), name: DatasetName { pool_name: ZpoolName { id: 436ef9e1-c612-46c3-866b-9e48c044fdf2 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 80a1f92b-9d54-4ed8-81da-c99325560288 (dataset): DatasetConfig { id: 80a1f92b-9d54-4ed8-81da-c99325560288 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1fd2ac0f-93a9-44e1-a6b3-7ccfcdc6b252 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_831f544f-98b3-466d-855d-ee48ae395f0b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 815ef5f9-4d67-4500-ac8c-cd81efa30edc (dataset): DatasetConfig { id: 815ef5f9-4d67-4500-ac8c-cd81efa30edc (dataset), name: DatasetName { pool_name: ZpoolName { id: 436ef9e1-c612-46c3-866b-9e48c044fdf2 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_e6d0c6fc-9f27-4b59-8b64-52d8f20ddfd9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 81f19680-4d33-42e7-9ba9-6778fa4adcd0 (dataset): DatasetConfig { id: 81f19680-4d33-42e7-9ba9-6778fa4adcd0 (dataset), name: DatasetName { pool_name: ZpoolName { id: b5578c06-5ed8-4225-9470-d661174b141e (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_6ae04bea-989b-4227-a44b-60ac3e1e9aa6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 88c1b824-d09b-4743-926c-b5a722bc4c74 (dataset): DatasetConfig { id: 88c1b824-d09b-4743-926c-b5a722bc4c74 (dataset), name: DatasetName { pool_name: ZpoolName { id: defcb6a1-2bbe-47a6-a426-436ed60fd6fc (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 8c383d1d-4d8a-4d3d-8db2-c5ca93ef898a (dataset): DatasetConfig { id: 8c383d1d-4d8a-4d3d-8db2-c5ca93ef898a (dataset), name: DatasetName { pool_name: ZpoolName { id: 0cdd8476-a0d8-44ca-a74b-0704c56ede98 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 95ee9daa-2e85-4e17-a536-69f934318c5c (dataset): DatasetConfig { id: 95ee9daa-2e85-4e17-a536-69f934318c5c (dataset), name: DatasetName { pool_name: ZpoolName { id: defcb6a1-2bbe-47a6-a426-436ed60fd6fc (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 98b6090d-5f1b-4aba-b3c8-bb2f3b25788a (dataset): DatasetConfig { id: 98b6090d-5f1b-4aba-b3c8-bb2f3b25788a (dataset), name: DatasetName { pool_name: ZpoolName { id: b5578c06-5ed8-4225-9470-d661174b141e (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_1b05e3ee-34fc-4615-91df-a477e1a37258" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9f4cad0e-d32a-4ee1-97dc-89c9a1f25d21 (dataset): DatasetConfig { id: 9f4cad0e-d32a-4ee1-97dc-89c9a1f25d21 (dataset), name: DatasetName { pool_name: ZpoolName { id: 436ef9e1-c612-46c3-866b-9e48c044fdf2 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_f28b01fa-a622-4300-b098-26693361bed2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a056ec7a-666f-499b-9501-9b8eefc55d9a (dataset): DatasetConfig { id: a056ec7a-666f-499b-9501-9b8eefc55d9a (dataset), name: DatasetName { pool_name: ZpoolName { id: f1c83160-c846-4e0a-a537-6a326722ac5a (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, af2b178e-a991-4b41-8bc8-0f120eec5682 (dataset): DatasetConfig { id: af2b178e-a991-4b41-8bc8-0f120eec5682 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0686bda3-5eb8-4859-ac7b-e5a6ceb8616d (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_bf630637-78f3-4e20-a86d-c4f19712ebb4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b0516ab1-1867-4602-9076-c1e24f937943 (dataset): DatasetConfig { id: b0516ab1-1867-4602-9076-c1e24f937943 (dataset), name: DatasetName { pool_name: ZpoolName { id: defcb6a1-2bbe-47a6-a426-436ed60fd6fc (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b54f59a6-4bf1-4c58-9e7c-f3f84a1ef468 (dataset): DatasetConfig { id: b54f59a6-4bf1-4c58-9e7c-f3f84a1ef468 (dataset), name: DatasetName { pool_name: ZpoolName { id: f1c83160-c846-4e0a-a537-6a326722ac5a (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_32bd82c5-9132-4cc5-bc52-bbcbaeb63c0a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b5f40b83-b35a-4ab6-b4cb-488ff3816481 (dataset): DatasetConfig { id: b5f40b83-b35a-4ab6-b4cb-488ff3816481 (dataset), name: DatasetName { pool_name: ZpoolName { id: 436ef9e1-c612-46c3-866b-9e48c044fdf2 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, b8cbafed-cb3a-4eb2-b894-5d93db32ac99 (dataset): DatasetConfig { id: b8cbafed-cb3a-4eb2-b894-5d93db32ac99 (dataset), name: DatasetName { pool_name: ZpoolName { id: a0552d97-e3e6-4586-a789-e6bcdec66672 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b97905b7-3b20-482b-b338-41c4f5090cf9 (dataset): DatasetConfig { id: b97905b7-3b20-482b-b338-41c4f5090cf9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1fd2ac0f-93a9-44e1-a6b3-7ccfcdc6b252 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c36b0860-fdaf-49de-adba-b8e8d66ca7d7 (dataset): DatasetConfig { id: c36b0860-fdaf-49de-adba-b8e8d66ca7d7 (dataset), name: DatasetName { pool_name: ZpoolName { id: b5578c06-5ed8-4225-9470-d661174b141e (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c68ce133-f93c-4486-bf67-229ceb776c6d (dataset): DatasetConfig { id: c68ce133-f93c-4486-bf67-229ceb776c6d (dataset), name: DatasetName { pool_name: ZpoolName { id: f1c83160-c846-4e0a-a537-6a326722ac5a (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ccb7134d-8ece-4331-aeb1-5a366e32e1c5 (dataset): DatasetConfig { id: ccb7134d-8ece-4331-aeb1-5a366e32e1c5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0cdd8476-a0d8-44ca-a74b-0704c56ede98 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, d2889ded-ce08-4cfc-b3f3-f4defb718a8b (dataset): DatasetConfig { id: d2889ded-ce08-4cfc-b3f3-f4defb718a8b (dataset), name: DatasetName { pool_name: ZpoolName { id: defcb6a1-2bbe-47a6-a426-436ed60fd6fc (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_b10d7d14-e913-49db-8411-992e06a1f1e2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d72a89b5-a1ca-42d5-8bd1-0460335c3598 (dataset): DatasetConfig { id: d72a89b5-a1ca-42d5-8bd1-0460335c3598 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0686bda3-5eb8-4859-ac7b-e5a6ceb8616d (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, df331b4c-5bd4-4405-bdf9-4cf7c9231c3a (dataset): DatasetConfig { id: df331b4c-5bd4-4405-bdf9-4cf7c9231c3a (dataset), name: DatasetName { pool_name: ZpoolName { id: 436ef9e1-c612-46c3-866b-9e48c044fdf2 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_94497aa9-1336-4df1-af83-5ca2d4a43909" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e12461f6-5852-41bc-b77b-bcf5d56552d3 (dataset): DatasetConfig { id: e12461f6-5852-41bc-b77b-bcf5d56552d3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1fd2ac0f-93a9-44e1-a6b3-7ccfcdc6b252 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, eb3cedf2-e7a6-4046-a37d-2f96f9c94b02 (dataset): DatasetConfig { id: eb3cedf2-e7a6-4046-a37d-2f96f9c94b02 (dataset), name: DatasetName { pool_name: ZpoolName { id: a0552d97-e3e6-4586-a789-e6bcdec66672 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ecf79bda-6082-4e55-9287-c662da4a1f31 (dataset): DatasetConfig { id: ecf79bda-6082-4e55-9287-c662da4a1f31 (dataset), name: DatasetName { pool_name: ZpoolName { id: c12c68d5-6ddb-4829-80b0-49f80baef150 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_4a60288a-de85-4cc2-97ae-0e9800cf70c5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ee24fa6c-b087-406a-beed-6b0b74f7cdc7 (dataset): DatasetConfig { id: ee24fa6c-b087-406a-beed-6b0b74f7cdc7 (dataset), name: DatasetName { pool_name: ZpoolName { id: f1c83160-c846-4e0a-a537-6a326722ac5a (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, eefb7f1d-6a07-461a-bcaf-c512734569b7 (dataset): DatasetConfig { id: eefb7f1d-6a07-461a-bcaf-c512734569b7 (dataset), name: DatasetName { pool_name: ZpoolName { id: f1c83160-c846-4e0a-a537-6a326722ac5a (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f48cfb5f-0628-4bbc-9bfd-247dbcdafa63 (dataset): DatasetConfig { id: f48cfb5f-0628-4bbc-9bfd-247dbcdafa63 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1fd2ac0f-93a9-44e1-a6b3-7ccfcdc6b252 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, f52c8d2b-727e-4097-9fe6-adaf6977ba01 (dataset): DatasetConfig { id: f52c8d2b-727e-4097-9fe6-adaf6977ba01 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0cdd8476-a0d8-44ca-a74b-0704c56ede98 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f5634269-f78d-4a9a-acc9-cb0cc92363e4 (dataset): DatasetConfig { id: f5634269-f78d-4a9a-acc9-cb0cc92363e4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 436ef9e1-c612-46c3-866b-9e48c044fdf2 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fc1e72e3-ddc2-4c1f-acbd-846f9cfaedf9 (dataset): DatasetConfig { id: fc1e72e3-ddc2-4c1f-acbd-846f9cfaedf9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0cdd8476-a0d8-44ca-a74b-0704c56ede98 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_e027a9c4-2388-40aa-8459-5f776f88554d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fc4556df-222b-41f5-b9af-1c1ee4a4c514 (dataset): DatasetConfig { id: fc4556df-222b-41f5-b9af-1c1ee4a4c514 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0686bda3-5eb8-4859-ac7b-e5a6ceb8616d (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_fa00fdf3-10e6-4350-898d-2ec64b75259e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ff7038db-85c7-4249-b1c2-5fd84d51472c (dataset): DatasetConfig { id: ff7038db-85c7-4249-b1c2-5fd84d51472c (dataset), name: DatasetName { pool_name: ZpoolName { id: b5578c06-5ed8-4225-9470-d661174b141e (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, ff94ff53-cc57-4a24-b9bd-ddf2b8714bbc (dataset): DatasetConfig { id: ff94ff53-cc57-4a24-b9bd-ddf2b8714bbc (dataset), name: DatasetName { pool_name: ZpoolName { id: a0552d97-e3e6-4586-a789-e6bcdec66672 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} } file = sled-agent/src/rack_setup/service.rs:460 sled_address = [fd00:1122:3344:101::1]:12345
4432024-12-19T05:49:12.055ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60628
4442024-12-19T05:49:12.055ZINFOSledAgent: datasets ensure file = sled-agent/src/sled_agent.rs:862 sled_id = a9851483-adb5-4271-9f27-41db71133b55
4452024-12-19T05:49:12.058ZINFOSledAgent (StorageManager): Received DatasetsEnsure { config: DatasetsConfig { generation: Generation(1), datasets: {009c0092-bf7a-4a44-9c73-d36e24159157 (dataset): DatasetConfig { id: 009c0092-bf7a-4a44-9c73-d36e24159157 (dataset), name: DatasetName { pool_name: ZpoolName { id: defcb6a1-2bbe-47a6-a426-436ed60fd6fc (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 02a79886-6111-4347-9026-936ff4b6de5f (dataset): DatasetConfig { id: 02a79886-6111-4347-9026-936ff4b6de5f (dataset), name: DatasetName { pool_name: ZpoolName { id: 436ef9e1-c612-46c3-866b-9e48c044fdf2 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 049b11d4-4f38-4654-8e4d-eaba7d82fffa (dataset): DatasetConfig { id: 049b11d4-4f38-4654-8e4d-eaba7d82fffa (dataset), name: DatasetName { pool_name: ZpoolName { id: defcb6a1-2bbe-47a6-a426-436ed60fd6fc (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_33158fa9-57db-43e4-a282-d8c6f236773d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0976d54c-0ab6-4cee-92bc-3da03a5cb1d4 (dataset): DatasetConfig { id: 0976d54c-0ab6-4cee-92bc-3da03a5cb1d4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 436ef9e1-c612-46c3-866b-9e48c044fdf2 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_a059e970-dce9-484b-9af7-85f00f24e142" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 16e4b754-a39d-46a3-850a-ea0cc4c699b0 (dataset): DatasetConfig { id: 16e4b754-a39d-46a3-850a-ea0cc4c699b0 (dataset), name: DatasetName { pool_name: ZpoolName { id: defcb6a1-2bbe-47a6-a426-436ed60fd6fc (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_ecedc0eb-6c7d-4958-9fee-747c67187e55" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1819585a-33c7-4f89-86fa-535891bc4637 (dataset): DatasetConfig { id: 1819585a-33c7-4f89-86fa-535891bc4637 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1fd2ac0f-93a9-44e1-a6b3-7ccfcdc6b252 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_5aa1584b-558f-482f-872a-fff1fa879759" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1923f07e-5b8a-471a-96b9-51383f831e52 (dataset): DatasetConfig { id: 1923f07e-5b8a-471a-96b9-51383f831e52 (dataset), name: DatasetName { pool_name: ZpoolName { id: f1c83160-c846-4e0a-a537-6a326722ac5a (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 23cd0d59-9f14-4249-9b60-6aa71ba79a7f (dataset): DatasetConfig { id: 23cd0d59-9f14-4249-9b60-6aa71ba79a7f (dataset), name: DatasetName { pool_name: ZpoolName { id: 0686bda3-5eb8-4859-ac7b-e5a6ceb8616d (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 241ab4c8-dde5-47cf-bc8f-bfe2fe0a0d05 (dataset): DatasetConfig { id: 241ab4c8-dde5-47cf-bc8f-bfe2fe0a0d05 (dataset), name: DatasetName { pool_name: ZpoolName { id: 436ef9e1-c612-46c3-866b-9e48c044fdf2 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_75a56219-191b-4e5c-8eb1-d0e62e0c42f9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2522409a-b487-42dd-890a-d37eb6f0d972 (dataset): DatasetConfig { id: 2522409a-b487-42dd-890a-d37eb6f0d972 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0cdd8476-a0d8-44ca-a74b-0704c56ede98 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_a70a1db1-4ed4-460d-a7ae-0e54347df152" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 25b99aee-7ce6-43e0-9525-6157d6d912b0 (dataset): DatasetConfig { id: 25b99aee-7ce6-43e0-9525-6157d6d912b0 (dataset), name: DatasetName { pool_name: ZpoolName { id: b5578c06-5ed8-4225-9470-d661174b141e (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2a9ea8fd-fa2d-4232-9a22-240dc33c2803 (dataset): DatasetConfig { id: 2a9ea8fd-fa2d-4232-9a22-240dc33c2803 (dataset), name: DatasetName { pool_name: ZpoolName { id: f1c83160-c846-4e0a-a537-6a326722ac5a (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_bb4845ab-0600-4d61-a9f2-eb93a7cc0896" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3173e31c-4688-4f24-b5fb-92ea5684c2c1 (dataset): DatasetConfig { id: 3173e31c-4688-4f24-b5fb-92ea5684c2c1 (dataset), name: DatasetName { pool_name: ZpoolName { id: f1c83160-c846-4e0a-a537-6a326722ac5a (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_58ae657f-f744-4b0b-a838-01074a6743ed" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 36e3b320-cea6-464b-95e5-ba6a5b3f27b0 (dataset): DatasetConfig { id: 36e3b320-cea6-464b-95e5-ba6a5b3f27b0 (dataset), name: DatasetName { pool_name: ZpoolName { id: f1c83160-c846-4e0a-a537-6a326722ac5a (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_f6dcc1d5-458d-4c06-aac2-ae852ccaf5f0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 38833cc3-4373-4d0d-99fa-31d36614eea5 (dataset): DatasetConfig { id: 38833cc3-4373-4d0d-99fa-31d36614eea5 (dataset), name: DatasetName { pool_name: ZpoolName { id: defcb6a1-2bbe-47a6-a426-436ed60fd6fc (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_503e10f4-0146-46a7-bcc4-a71beb2225b2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3cbe7367-5357-4e3e-95b0-523911bfa4b6 (dataset): DatasetConfig { id: 3cbe7367-5357-4e3e-95b0-523911bfa4b6 (dataset), name: DatasetName { pool_name: ZpoolName { id: c12c68d5-6ddb-4829-80b0-49f80baef150 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3d4a35fd-3b48-4567-834c-fbd2bee549d5 (dataset): DatasetConfig { id: 3d4a35fd-3b48-4567-834c-fbd2bee549d5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 436ef9e1-c612-46c3-866b-9e48c044fdf2 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_1e0292d6-c327-472e-85e6-622aab78d10f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 45b816bb-3465-4cea-a1a4-1416be12d7ab (dataset): DatasetConfig { id: 45b816bb-3465-4cea-a1a4-1416be12d7ab (dataset), name: DatasetName { pool_name: ZpoolName { id: a0552d97-e3e6-4586-a789-e6bcdec66672 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_f534ccb4-1884-4b0c-b250-92aa7d3370a6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 488cc320-b1dd-480a-b9c9-7192cc65cb64 (dataset): DatasetConfig { id: 488cc320-b1dd-480a-b9c9-7192cc65cb64 (dataset), name: DatasetName { pool_name: ZpoolName { id: defcb6a1-2bbe-47a6-a426-436ed60fd6fc (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 498f4bbe-4e06-42bc-8235-3cc842a3352e (dataset): DatasetConfig { id: 498f4bbe-4e06-42bc-8235-3cc842a3352e (dataset), name: DatasetName { pool_name: ZpoolName { id: c12c68d5-6ddb-4829-80b0-49f80baef150 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_7701880a-5341-4c52-93af-e0d5f29a4650" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 504ddbbe-1210-422f-ba84-ae1bff393cab (dataset): DatasetConfig { id: 504ddbbe-1210-422f-ba84-ae1bff393cab (dataset), name: DatasetName { pool_name: ZpoolName { id: 0cdd8476-a0d8-44ca-a74b-0704c56ede98 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 54ef8803-54b7-470b-b7f3-f3b293ea5b38 (dataset): DatasetConfig { id: 54ef8803-54b7-470b-b7f3-f3b293ea5b38 (dataset), name: DatasetName { pool_name: ZpoolName { id: f1c83160-c846-4e0a-a537-6a326722ac5a (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 585a4e9e-51b0-455c-b412-43aa56f3cc9e (dataset): DatasetConfig { id: 585a4e9e-51b0-455c-b412-43aa56f3cc9e (dataset), name: DatasetName { pool_name: ZpoolName { id: 436ef9e1-c612-46c3-866b-9e48c044fdf2 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5b8f378f-a2bb-4e9f-a477-cb2f2e0d67a3 (dataset): DatasetConfig { id: 5b8f378f-a2bb-4e9f-a477-cb2f2e0d67a3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0686bda3-5eb8-4859-ac7b-e5a6ceb8616d (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5cbf83da-8f96-49cb-a292-3562d906d750 (dataset): DatasetConfig { id: 5cbf83da-8f96-49cb-a292-3562d906d750 (dataset), name: DatasetName { pool_name: ZpoolName { id: a0552d97-e3e6-4586-a789-e6bcdec66672 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 68a19795-865b-4f27-8962-e27da377b6e8 (dataset): DatasetConfig { id: 68a19795-865b-4f27-8962-e27da377b6e8 (dataset), name: DatasetName { pool_name: ZpoolName { id: f1c83160-c846-4e0a-a537-6a326722ac5a (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 6fa52b37-3bed-4a77-b2ca-8312b126b2fa (dataset): DatasetConfig { id: 6fa52b37-3bed-4a77-b2ca-8312b126b2fa (dataset), name: DatasetName { pool_name: ZpoolName { id: f1c83160-c846-4e0a-a537-6a326722ac5a (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_c32c373d-ccc1-45e0-bb27-49a4415e7fca" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7443ad79-71dd-40c6-9399-e4f65e12b4d2 (dataset): DatasetConfig { id: 7443ad79-71dd-40c6-9399-e4f65e12b4d2 (dataset), name: DatasetName { pool_name: ZpoolName { id: c12c68d5-6ddb-4829-80b0-49f80baef150 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7a1a5625-44d8-4b40-a491-b0d9896dfed3 (dataset): DatasetConfig { id: 7a1a5625-44d8-4b40-a491-b0d9896dfed3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 436ef9e1-c612-46c3-866b-9e48c044fdf2 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7cd70c72-2283-42d4-bfef-e2ead4978427 (dataset): DatasetConfig { id: 7cd70c72-2283-42d4-bfef-e2ead4978427 (dataset), name: DatasetName { pool_name: ZpoolName { id: a0552d97-e3e6-4586-a789-e6bcdec66672 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_1b5a99e2-3552-4a7c-bf7a-59d1fd251d45" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7da40331-fe53-491a-91cc-38e76ba5ae76 (dataset): DatasetConfig { id: 7da40331-fe53-491a-91cc-38e76ba5ae76 (dataset), name: DatasetName { pool_name: ZpoolName { id: c12c68d5-6ddb-4829-80b0-49f80baef150 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 7f7ad38b-20f9-4bfb-b9d0-b4e0d2d4f26a (dataset): DatasetConfig { id: 7f7ad38b-20f9-4bfb-b9d0-b4e0d2d4f26a (dataset), name: DatasetName { pool_name: ZpoolName { id: f1c83160-c846-4e0a-a537-6a326722ac5a (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_e31fad89-c82a-4b5e-8dad-c806db878c58" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7fa01183-cfd7-48fe-b1b3-6ee7bb13e656 (dataset): DatasetConfig { id: 7fa01183-cfd7-48fe-b1b3-6ee7bb13e656 (dataset), name: DatasetName { pool_name: ZpoolName { id: 436ef9e1-c612-46c3-866b-9e48c044fdf2 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 80a1f92b-9d54-4ed8-81da-c99325560288 (dataset): DatasetConfig { id: 80a1f92b-9d54-4ed8-81da-c99325560288 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1fd2ac0f-93a9-44e1-a6b3-7ccfcdc6b252 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_831f544f-98b3-466d-855d-ee48ae395f0b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 815ef5f9-4d67-4500-ac8c-cd81efa30edc (dataset): DatasetConfig { id: 815ef5f9-4d67-4500-ac8c-cd81efa30edc (dataset), name: DatasetName { pool_name: ZpoolName { id: 436ef9e1-c612-46c3-866b-9e48c044fdf2 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_e6d0c6fc-9f27-4b59-8b64-52d8f20ddfd9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 81f19680-4d33-42e7-9ba9-6778fa4adcd0 (dataset): DatasetConfig { id: 81f19680-4d33-42e7-9ba9-6778fa4adcd0 (dataset), name: DatasetName { pool_name: ZpoolName { id: b5578c06-5ed8-4225-9470-d661174b141e (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_6ae04bea-989b-4227-a44b-60ac3e1e9aa6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 88c1b824-d09b-4743-926c-b5a722bc4c74 (dataset): DatasetConfig { id: 88c1b824-d09b-4743-926c-b5a722bc4c74 (dataset), name: DatasetName { pool_name: ZpoolName { id: defcb6a1-2bbe-47a6-a426-436ed60fd6fc (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 8c383d1d-4d8a-4d3d-8db2-c5ca93ef898a (dataset): DatasetConfig { id: 8c383d1d-4d8a-4d3d-8db2-c5ca93ef898a (dataset), name: DatasetName { pool_name: ZpoolName { id: 0cdd8476-a0d8-44ca-a74b-0704c56ede98 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 95ee9daa-2e85-4e17-a536-69f934318c5c (dataset): DatasetConfig { id: 95ee9daa-2e85-4e17-a536-69f934318c5c (dataset), name: DatasetName { pool_name: ZpoolName { id: defcb6a1-2bbe-47a6-a426-436ed60fd6fc (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 98b6090d-5f1b-4aba-b3c8-bb2f3b25788a (dataset): DatasetConfig { id: 98b6090d-5f1b-4aba-b3c8-bb2f3b25788a (dataset), name: DatasetName { pool_name: ZpoolName { id: b5578c06-5ed8-4225-9470-d661174b141e (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_1b05e3ee-34fc-4615-91df-a477e1a37258" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9f4cad0e-d32a-4ee1-97dc-89c9a1f25d21 (dataset): DatasetConfig { id: 9f4cad0e-d32a-4ee1-97dc-89c9a1f25d21 (dataset), name: DatasetName { pool_name: ZpoolName { id: 436ef9e1-c612-46c3-866b-9e48c044fdf2 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_f28b01fa-a622-4300-b098-26693361bed2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a056ec7a-666f-499b-9501-9b8eefc55d9a (dataset): DatasetConfig { id: a056ec7a-666f-499b-9501-9b8eefc55d9a (dataset), name: DatasetName { pool_name: ZpoolName { id: f1c83160-c846-4e0a-a537-6a326722ac5a (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, af2b178e-a991-4b41-8bc8-0f120eec5682 (dataset): DatasetConfig { id: af2b178e-a991-4b41-8bc8-0f120eec5682 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0686bda3-5eb8-4859-ac7b-e5a6ceb8616d (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_bf630637-78f3-4e20-a86d-c4f19712ebb4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b0516ab1-1867-4602-9076-c1e24f937943 (dataset): DatasetConfig { id: b0516ab1-1867-4602-9076-c1e24f937943 (dataset), name: DatasetName { pool_name: ZpoolName { id: defcb6a1-2bbe-47a6-a426-436ed60fd6fc (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b54f59a6-4bf1-4c58-9e7c-f3f84a1ef468 (dataset): DatasetConfig { id: b54f59a6-4bf1-4c58-9e7c-f3f84a1ef468 (dataset), name: DatasetName { pool_name: ZpoolName { id: f1c83160-c846-4e0a-a537-6a326722ac5a (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_32bd82c5-9132-4cc5-bc52-bbcbaeb63c0a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b5f40b83-b35a-4ab6-b4cb-488ff3816481 (dataset): DatasetConfig { id: b5f40b83-b35a-4ab6-b4cb-488ff3816481 (dataset), name: DatasetName { pool_name: ZpoolName { id: 436ef9e1-c612-46c3-866b-9e48c044fdf2 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, b8cbafed-cb3a-4eb2-b894-5d93db32ac99 (dataset): DatasetConfig { id: b8cbafed-cb3a-4eb2-b894-5d93db32ac99 (dataset), name: DatasetName { pool_name: ZpoolName { id: a0552d97-e3e6-4586-a789-e6bcdec66672 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b97905b7-3b20-482b-b338-41c4f5090cf9 (dataset): DatasetConfig { id: b97905b7-3b20-482b-b338-41c4f5090cf9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1fd2ac0f-93a9-44e1-a6b3-7ccfcdc6b252 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c36b0860-fdaf-49de-adba-b8e8d66ca7d7 (dataset): DatasetConfig { id: c36b0860-fdaf-49de-adba-b8e8d66ca7d7 (dataset), name: DatasetName { pool_name: ZpoolName { id: b5578c06-5ed8-4225-9470-d661174b141e (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c68ce133-f93c-4486-bf67-229ceb776c6d (dataset): DatasetConfig { id: c68ce133-f93c-4486-bf67-229ceb776c6d (dataset), name: DatasetName { pool_name: ZpoolName { id: f1c83160-c846-4e0a-a537-6a326722ac5a (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ccb7134d-8ece-4331-aeb1-5a366e32e1c5 (dataset): DatasetConfig { id: ccb7134d-8ece-4331-aeb1-5a366e32e1c5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0cdd8476-a0d8-44ca-a74b-0704c56ede98 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, d2889ded-ce08-4cfc-b3f3-f4defb718a8b (dataset): DatasetConfig { id: d2889ded-ce08-4cfc-b3f3-f4defb718a8b (dataset), name: DatasetName { pool_name: ZpoolName { id: defcb6a1-2bbe-47a6-a426-436ed60fd6fc (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_b10d7d14-e913-49db-8411-992e06a1f1e2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d72a89b5-a1ca-42d5-8bd1-0460335c3598 (dataset): DatasetConfig { id: d72a89b5-a1ca-42d5-8bd1-0460335c3598 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0686bda3-5eb8-4859-ac7b-e5a6ceb8616d (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, df331b4c-5bd4-4405-bdf9-4cf7c9231c3a (dataset): DatasetConfig { id: df331b4c-5bd4-4405-bdf9-4cf7c9231c3a (dataset), name: DatasetName { pool_name: ZpoolName { id: 436ef9e1-c612-46c3-866b-9e48c044fdf2 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_94497aa9-1336-4df1-af83-5ca2d4a43909" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e12461f6-5852-41bc-b77b-bcf5d56552d3 (dataset): DatasetConfig { id: e12461f6-5852-41bc-b77b-bcf5d56552d3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1fd2ac0f-93a9-44e1-a6b3-7ccfcdc6b252 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, eb3cedf2-e7a6-4046-a37d-2f96f9c94b02 (dataset): DatasetConfig { id: eb3cedf2-e7a6-4046-a37d-2f96f9c94b02 (dataset), name: DatasetName { pool_name: ZpoolName { id: a0552d97-e3e6-4586-a789-e6bcdec66672 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ecf79bda-6082-4e55-9287-c662da4a1f31 (dataset): DatasetConfig { id: ecf79bda-6082-4e55-9287-c662da4a1f31 (dataset), name: DatasetName { pool_name: ZpoolName { id: c12c68d5-6ddb-4829-80b0-49f80baef150 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_4a60288a-de85-4cc2-97ae-0e9800cf70c5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ee24fa6c-b087-406a-beed-6b0b74f7cdc7 (dataset): DatasetConfig { id: ee24fa6c-b087-406a-beed-6b0b74f7cdc7 (dataset), name: DatasetName { pool_name: ZpoolName { id: f1c83160-c846-4e0a-a537-6a326722ac5a (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, eefb7f1d-6a07-461a-bcaf-c512734569b7 (dataset): DatasetConfig { id: eefb7f1d-6a07-461a-bcaf-c512734569b7 (dataset), name: DatasetName { pool_name: ZpoolName { id: f1c83160-c846-4e0a-a537-6a326722ac5a (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f48cfb5f-0628-4bbc-9bfd-247dbcdafa63 (dataset): DatasetConfig { id: f48cfb5f-0628-4bbc-9bfd-247dbcdafa63 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1fd2ac0f-93a9-44e1-a6b3-7ccfcdc6b252 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, f52c8d2b-727e-4097-9fe6-adaf6977ba01 (dataset): DatasetConfig { id: f52c8d2b-727e-4097-9fe6-adaf6977ba01 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0cdd8476-a0d8-44ca-a74b-0704c56ede98 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f5634269-f78d-4a9a-acc9-cb0cc92363e4 (dataset): DatasetConfig { id: f5634269-f78d-4a9a-acc9-cb0cc92363e4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 436ef9e1-c612-46c3-866b-9e48c044fdf2 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fc1e72e3-ddc2-4c1f-acbd-846f9cfaedf9 (dataset): DatasetConfig { id: fc1e72e3-ddc2-4c1f-acbd-846f9cfaedf9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0cdd8476-a0d8-44ca-a74b-0704c56ede98 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_e027a9c4-2388-40aa-8459-5f776f88554d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fc4556df-222b-41f5-b9af-1c1ee4a4c514 (dataset): DatasetConfig { id: fc4556df-222b-41f5-b9af-1c1ee4a4c514 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0686bda3-5eb8-4859-ac7b-e5a6ceb8616d (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_fa00fdf3-10e6-4350-898d-2ec64b75259e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ff7038db-85c7-4249-b1c2-5fd84d51472c (dataset): DatasetConfig { id: ff7038db-85c7-4249-b1c2-5fd84d51472c (dataset), name: DatasetName { pool_name: ZpoolName { id: b5578c06-5ed8-4225-9470-d661174b141e (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, ff94ff53-cc57-4a24-b9bd-ddf2b8714bbc (dataset): DatasetConfig { id: ff94ff53-cc57-4a24-b9bd-ddf2b8714bbc (dataset), name: DatasetName { pool_name: ZpoolName { id: a0552d97-e3e6-4586-a789-e6bcdec66672 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} }, tx: ... } file = sled-storage/src/manager.rs:603
4462024-12-19T05:49:12.058ZINFOSledAgent (StorageManager): No ledger in /pool/int/e0de026f-6896-43b8-9686-b840d0967c1e/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4472024-12-19T05:49:12.058ZINFOSledAgent (StorageManager): No ledger in /pool/int/d2802dae-55e1-4039-8308-ca231b2dc40c/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4482024-12-19T05:49:12.058ZINFOSledAgent (StorageManager): No previously-stored 'requested datasets', creating new ledger file = sled-storage/src/manager.rs:905 request = datasets_ensure
4492024-12-19T05:49:12.058ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4502024-12-19T05:49:12.058ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_defcb6a1-2bbe-47a6-a426-436ed60fd6fc/crypt/internal_dns" } file = sled-storage/src/manager.rs:1331
4512024-12-19T05:49:12.136ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/a9851483-adb5-4271-9f27-41db71133b55) file = sled-agent/src/probe_manager.rs:231 sled_id = a9851483-adb5-4271-9f27-41db71133b55
4522024-12-19T05:49:12.147ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4532024-12-19T05:49:12.147ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_436ef9e1-c612-46c3-866b-9e48c044fdf2/crypt/external_dns" } file = sled-storage/src/manager.rs:1331
4542024-12-19T05:49:12.234ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4552024-12-19T05:49:12.234ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/defcb6a1-2bbe-47a6-a426-436ed60fd6fc/crypt/zone/oxz_cockroachdb_33158fa9-57db-43e4-a282-d8c6f236773d"), full_name: "oxp_defcb6a1-2bbe-47a6-a426-436ed60fd6fc/crypt/zone/oxz_cockroachdb_33158fa9-57db-43e4-a282-d8c6f236773d" } file = sled-storage/src/manager.rs:1331
4562024-12-19T05:49:12.331ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4572024-12-19T05:49:12.332ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/436ef9e1-c612-46c3-866b-9e48c044fdf2/crypt/zone/oxz_cockroachdb_a059e970-dce9-484b-9af7-85f00f24e142"), full_name: "oxp_436ef9e1-c612-46c3-866b-9e48c044fdf2/crypt/zone/oxz_cockroachdb_a059e970-dce9-484b-9af7-85f00f24e142" } file = sled-storage/src/manager.rs:1331
4582024-12-19T05:49:12.431ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4592024-12-19T05:49:12.431ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/defcb6a1-2bbe-47a6-a426-436ed60fd6fc/crypt/zone/oxz_internal_dns_ecedc0eb-6c7d-4958-9fee-747c67187e55"), full_name: "oxp_defcb6a1-2bbe-47a6-a426-436ed60fd6fc/crypt/zone/oxz_internal_dns_ecedc0eb-6c7d-4958-9fee-747c67187e55" } file = sled-storage/src/manager.rs:1331
4602024-12-19T05:49:12.532ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4612024-12-19T05:49:12.532ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1fd2ac0f-93a9-44e1-a6b3-7ccfcdc6b252/crypt/zone/oxz_crucible_pantry_5aa1584b-558f-482f-872a-fff1fa879759"), full_name: "oxp_1fd2ac0f-93a9-44e1-a6b3-7ccfcdc6b252/crypt/zone/oxz_crucible_pantry_5aa1584b-558f-482f-872a-fff1fa879759" } file = sled-storage/src/manager.rs:1331
4622024-12-19T05:49:12.631ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4632024-12-19T05:49:12.631ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f1c83160-c846-4e0a-a537-6a326722ac5a/crypt/zone"), full_name: "oxp_f1c83160-c846-4e0a-a537-6a326722ac5a/crypt/zone" } file = sled-storage/src/manager.rs:1331
4642024-12-19T05:49:12.697ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4652024-12-19T05:49:12.697ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/0686bda3-5eb8-4859-ac7b-e5a6ceb8616d/crypt/zone"), full_name: "oxp_0686bda3-5eb8-4859-ac7b-e5a6ceb8616d/crypt/zone" } file = sled-storage/src/manager.rs:1331
4662024-12-19T05:49:12.766ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4672024-12-19T05:49:12.766ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/436ef9e1-c612-46c3-866b-9e48c044fdf2/crypt/zone/oxz_external_dns_75a56219-191b-4e5c-8eb1-d0e62e0c42f9"), full_name: "oxp_436ef9e1-c612-46c3-866b-9e48c044fdf2/crypt/zone/oxz_external_dns_75a56219-191b-4e5c-8eb1-d0e62e0c42f9" } file = sled-storage/src/manager.rs:1331
4682024-12-19T05:49:12.864ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4692024-12-19T05:49:12.864ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/0cdd8476-a0d8-44ca-a74b-0704c56ede98/crypt/zone/oxz_cockroachdb_a70a1db1-4ed4-460d-a7ae-0e54347df152"), full_name: "oxp_0cdd8476-a0d8-44ca-a74b-0704c56ede98/crypt/zone/oxz_cockroachdb_a70a1db1-4ed4-460d-a7ae-0e54347df152" } file = sled-storage/src/manager.rs:1331
4702024-12-19T05:49:12.959ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4712024-12-19T05:49:12.959ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b5578c06-5ed8-4225-9470-d661174b141e/crypt/zone"), full_name: "oxp_b5578c06-5ed8-4225-9470-d661174b141e/crypt/zone" } file = sled-storage/src/manager.rs:1331
4722024-12-19T05:49:13.026ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4732024-12-19T05:49:13.026ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f1c83160-c846-4e0a-a537-6a326722ac5a/crypt/zone/oxz_external_dns_bb4845ab-0600-4d61-a9f2-eb93a7cc0896"), full_name: "oxp_f1c83160-c846-4e0a-a537-6a326722ac5a/crypt/zone/oxz_external_dns_bb4845ab-0600-4d61-a9f2-eb93a7cc0896" } file = sled-storage/src/manager.rs:1331
4742024-12-19T05:49:13.122ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4752024-12-19T05:49:13.122ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f1c83160-c846-4e0a-a537-6a326722ac5a/crypt/zone/oxz_crucible_58ae657f-f744-4b0b-a838-01074a6743ed"), full_name: "oxp_f1c83160-c846-4e0a-a537-6a326722ac5a/crypt/zone/oxz_crucible_58ae657f-f744-4b0b-a838-01074a6743ed" } file = sled-storage/src/manager.rs:1331
4762024-12-19T05:49:13.138ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/a9851483-adb5-4271-9f27-41db71133b55) file = sled-agent/src/probe_manager.rs:231 sled_id = a9851483-adb5-4271-9f27-41db71133b55
4772024-12-19T05:49:13.220ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4782024-12-19T05:49:13.220ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f1c83160-c846-4e0a-a537-6a326722ac5a/crypt/zone/oxz_clickhouse_f6dcc1d5-458d-4c06-aac2-ae852ccaf5f0"), full_name: "oxp_f1c83160-c846-4e0a-a537-6a326722ac5a/crypt/zone/oxz_clickhouse_f6dcc1d5-458d-4c06-aac2-ae852ccaf5f0" } file = sled-storage/src/manager.rs:1331
4792024-12-19T05:49:13.312ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4802024-12-19T05:49:13.312ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/defcb6a1-2bbe-47a6-a426-436ed60fd6fc/crypt/zone/oxz_crucible_503e10f4-0146-46a7-bcc4-a71beb2225b2"), full_name: "oxp_defcb6a1-2bbe-47a6-a426-436ed60fd6fc/crypt/zone/oxz_crucible_503e10f4-0146-46a7-bcc4-a71beb2225b2" } file = sled-storage/src/manager.rs:1331
4812024-12-19T05:49:13.403ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4822024-12-19T05:49:13.403ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c12c68d5-6ddb-4829-80b0-49f80baef150/crypt/zone"), full_name: "oxp_c12c68d5-6ddb-4829-80b0-49f80baef150/crypt/zone" } file = sled-storage/src/manager.rs:1331
4832024-12-19T05:49:13.467ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4842024-12-19T05:49:13.467ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/436ef9e1-c612-46c3-866b-9e48c044fdf2/crypt/zone/oxz_nexus_1e0292d6-c327-472e-85e6-622aab78d10f"), full_name: "oxp_436ef9e1-c612-46c3-866b-9e48c044fdf2/crypt/zone/oxz_nexus_1e0292d6-c327-472e-85e6-622aab78d10f" } file = sled-storage/src/manager.rs:1331
4852024-12-19T05:49:13.563ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4862024-12-19T05:49:13.563ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a0552d97-e3e6-4586-a789-e6bcdec66672/crypt/zone/oxz_crucible_f534ccb4-1884-4b0c-b250-92aa7d3370a6"), full_name: "oxp_a0552d97-e3e6-4586-a789-e6bcdec66672/crypt/zone/oxz_crucible_f534ccb4-1884-4b0c-b250-92aa7d3370a6" } file = sled-storage/src/manager.rs:1331
4872024-12-19T05:49:13.655ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4882024-12-19T05:49:13.655ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_defcb6a1-2bbe-47a6-a426-436ed60fd6fc/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
4892024-12-19T05:49:13.738ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4902024-12-19T05:49:13.738ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c12c68d5-6ddb-4829-80b0-49f80baef150/crypt/zone/oxz_crucible_pantry_7701880a-5341-4c52-93af-e0d5f29a4650"), full_name: "oxp_c12c68d5-6ddb-4829-80b0-49f80baef150/crypt/zone/oxz_crucible_pantry_7701880a-5341-4c52-93af-e0d5f29a4650" } file = sled-storage/src/manager.rs:1331
4912024-12-19T05:49:13.831ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4922024-12-19T05:49:13.831ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/0cdd8476-a0d8-44ca-a74b-0704c56ede98/crypt/zone"), full_name: "oxp_0cdd8476-a0d8-44ca-a74b-0704c56ede98/crypt/zone" } file = sled-storage/src/manager.rs:1331
4932024-12-19T05:49:13.894ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4942024-12-19T05:49:13.894ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_f1c83160-c846-4e0a-a537-6a326722ac5a/crypt/clickhouse" } file = sled-storage/src/manager.rs:1331
4952024-12-19T05:49:13.980ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4962024-12-19T05:49:13.980ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_436ef9e1-c612-46c3-866b-9e48c044fdf2/crypt/internal_dns" } file = sled-storage/src/manager.rs:1331
4972024-12-19T05:49:14.072ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4982024-12-19T05:49:14.072ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_0686bda3-5eb8-4859-ac7b-e5a6ceb8616d/crucible" } file = sled-storage/src/manager.rs:1331
4992024-12-19T05:49:14.143ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/a9851483-adb5-4271-9f27-41db71133b55) file = sled-agent/src/probe_manager.rs:231 sled_id = a9851483-adb5-4271-9f27-41db71133b55
5002024-12-19T05:49:14.162ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5012024-12-19T05:49:14.162ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a0552d97-e3e6-4586-a789-e6bcdec66672/crypt/debug"), full_name: "oxp_a0552d97-e3e6-4586-a789-e6bcdec66672/crypt/debug" } file = sled-storage/src/manager.rs:1331
5022024-12-19T05:49:14.229ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5032024-12-19T05:49:14.229ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f1c83160-c846-4e0a-a537-6a326722ac5a/crypt/debug"), full_name: "oxp_f1c83160-c846-4e0a-a537-6a326722ac5a/crypt/debug" } file = sled-storage/src/manager.rs:1331
5042024-12-19T05:49:14.295ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5052024-12-19T05:49:14.296ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f1c83160-c846-4e0a-a537-6a326722ac5a/crypt/zone/oxz_nexus_c32c373d-ccc1-45e0-bb27-49a4415e7fca"), full_name: "oxp_f1c83160-c846-4e0a-a537-6a326722ac5a/crypt/zone/oxz_nexus_c32c373d-ccc1-45e0-bb27-49a4415e7fca" } file = sled-storage/src/manager.rs:1331
5062024-12-19T05:49:14.393ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5072024-12-19T05:49:14.393ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_c12c68d5-6ddb-4829-80b0-49f80baef150/crucible" } file = sled-storage/src/manager.rs:1331
5082024-12-19T05:49:14.480ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5092024-12-19T05:49:14.480ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_436ef9e1-c612-46c3-866b-9e48c044fdf2/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
5102024-12-19T05:49:14.565ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5112024-12-19T05:49:14.565ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a0552d97-e3e6-4586-a789-e6bcdec66672/crypt/zone/oxz_cockroachdb_1b5a99e2-3552-4a7c-bf7a-59d1fd251d45"), full_name: "oxp_a0552d97-e3e6-4586-a789-e6bcdec66672/crypt/zone/oxz_cockroachdb_1b5a99e2-3552-4a7c-bf7a-59d1fd251d45" } file = sled-storage/src/manager.rs:1331
5122024-12-19T05:49:14.661ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5132024-12-19T05:49:14.661ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c12c68d5-6ddb-4829-80b0-49f80baef150/crypt/debug"), full_name: "oxp_c12c68d5-6ddb-4829-80b0-49f80baef150/crypt/debug" } file = sled-storage/src/manager.rs:1331
5142024-12-19T05:49:14.728ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5152024-12-19T05:49:14.728ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f1c83160-c846-4e0a-a537-6a326722ac5a/crypt/zone/oxz_cockroachdb_e31fad89-c82a-4b5e-8dad-c806db878c58"), full_name: "oxp_f1c83160-c846-4e0a-a537-6a326722ac5a/crypt/zone/oxz_cockroachdb_e31fad89-c82a-4b5e-8dad-c806db878c58" } file = sled-storage/src/manager.rs:1331
5162024-12-19T05:49:14.828ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5172024-12-19T05:49:14.828ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/436ef9e1-c612-46c3-866b-9e48c044fdf2/crypt/zone"), full_name: "oxp_436ef9e1-c612-46c3-866b-9e48c044fdf2/crypt/zone" } file = sled-storage/src/manager.rs:1331
5182024-12-19T05:49:14.893ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5192024-12-19T05:49:14.893ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1fd2ac0f-93a9-44e1-a6b3-7ccfcdc6b252/crypt/zone/oxz_crucible_831f544f-98b3-466d-855d-ee48ae395f0b"), full_name: "oxp_1fd2ac0f-93a9-44e1-a6b3-7ccfcdc6b252/crypt/zone/oxz_crucible_831f544f-98b3-466d-855d-ee48ae395f0b" } file = sled-storage/src/manager.rs:1331
5202024-12-19T05:49:14.988ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5212024-12-19T05:49:14.988ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/436ef9e1-c612-46c3-866b-9e48c044fdf2/crypt/zone/oxz_crucible_e6d0c6fc-9f27-4b59-8b64-52d8f20ddfd9"), full_name: "oxp_436ef9e1-c612-46c3-866b-9e48c044fdf2/crypt/zone/oxz_crucible_e6d0c6fc-9f27-4b59-8b64-52d8f20ddfd9" } file = sled-storage/src/manager.rs:1331
5222024-12-19T05:49:15.085ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5232024-12-19T05:49:15.085ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b5578c06-5ed8-4225-9470-d661174b141e/crypt/zone/oxz_crucible_6ae04bea-989b-4227-a44b-60ac3e1e9aa6"), full_name: "oxp_b5578c06-5ed8-4225-9470-d661174b141e/crypt/zone/oxz_crucible_6ae04bea-989b-4227-a44b-60ac3e1e9aa6" } file = sled-storage/src/manager.rs:1331
5242024-12-19T05:49:15.146ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/a9851483-adb5-4271-9f27-41db71133b55) file = sled-agent/src/probe_manager.rs:231 sled_id = a9851483-adb5-4271-9f27-41db71133b55
5252024-12-19T05:49:15.189ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5262024-12-19T05:49:15.189ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/defcb6a1-2bbe-47a6-a426-436ed60fd6fc/crypt/debug"), full_name: "oxp_defcb6a1-2bbe-47a6-a426-436ed60fd6fc/crypt/debug" } file = sled-storage/src/manager.rs:1331
5272024-12-19T05:49:15.258ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5282024-12-19T05:49:15.258ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_0cdd8476-a0d8-44ca-a74b-0704c56ede98/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
5292024-12-19T05:49:15.349ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5302024-12-19T05:49:15.349ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_defcb6a1-2bbe-47a6-a426-436ed60fd6fc/crucible" } file = sled-storage/src/manager.rs:1331
5312024-12-19T05:49:15.439ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5322024-12-19T05:49:15.439ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b5578c06-5ed8-4225-9470-d661174b141e/crypt/zone/oxz_nexus_1b05e3ee-34fc-4615-91df-a477e1a37258"), full_name: "oxp_b5578c06-5ed8-4225-9470-d661174b141e/crypt/zone/oxz_nexus_1b05e3ee-34fc-4615-91df-a477e1a37258" } file = sled-storage/src/manager.rs:1331
5332024-12-19T05:49:15.536ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5342024-12-19T05:49:15.536ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/436ef9e1-c612-46c3-866b-9e48c044fdf2/crypt/zone/oxz_internal_dns_f28b01fa-a622-4300-b098-26693361bed2"), full_name: "oxp_436ef9e1-c612-46c3-866b-9e48c044fdf2/crypt/zone/oxz_internal_dns_f28b01fa-a622-4300-b098-26693361bed2" } file = sled-storage/src/manager.rs:1331
5352024-12-19T05:49:15.635ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5362024-12-19T05:49:15.635ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_f1c83160-c846-4e0a-a537-6a326722ac5a/crucible" } file = sled-storage/src/manager.rs:1331
5372024-12-19T05:49:15.722ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5382024-12-19T05:49:15.723ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/0686bda3-5eb8-4859-ac7b-e5a6ceb8616d/crypt/zone/oxz_oximeter_bf630637-78f3-4e20-a86d-c4f19712ebb4"), full_name: "oxp_0686bda3-5eb8-4859-ac7b-e5a6ceb8616d/crypt/zone/oxz_oximeter_bf630637-78f3-4e20-a86d-c4f19712ebb4" } file = sled-storage/src/manager.rs:1331
5392024-12-19T05:49:15.764ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 12.107612602s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = a9851483-adb5-4271-9f27-41db71133b55
5402024-12-19T05:49:15.823ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5412024-12-19T05:49:15.823ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/defcb6a1-2bbe-47a6-a426-436ed60fd6fc/crypt/zone"), full_name: "oxp_defcb6a1-2bbe-47a6-a426-436ed60fd6fc/crypt/zone" } file = sled-storage/src/manager.rs:1331
5422024-12-19T05:49:15.891ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5432024-12-19T05:49:15.891ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f1c83160-c846-4e0a-a537-6a326722ac5a/crypt/zone/oxz_internal_dns_32bd82c5-9132-4cc5-bc52-bbcbaeb63c0a"), full_name: "oxp_f1c83160-c846-4e0a-a537-6a326722ac5a/crypt/zone/oxz_internal_dns_32bd82c5-9132-4cc5-bc52-bbcbaeb63c0a" } file = sled-storage/src/manager.rs:1331
5442024-12-19T05:49:15.989ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5452024-12-19T05:49:15.989ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/436ef9e1-c612-46c3-866b-9e48c044fdf2/crypt/debug"), full_name: "oxp_436ef9e1-c612-46c3-866b-9e48c044fdf2/crypt/debug" } file = sled-storage/src/manager.rs:1331
5462024-12-19T05:49:16.060ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5472024-12-19T05:49:16.060ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a0552d97-e3e6-4586-a789-e6bcdec66672/crypt/zone"), full_name: "oxp_a0552d97-e3e6-4586-a789-e6bcdec66672/crypt/zone" } file = sled-storage/src/manager.rs:1331
5482024-12-19T05:49:16.129ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5492024-12-19T05:49:16.129ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1fd2ac0f-93a9-44e1-a6b3-7ccfcdc6b252/crypt/zone"), full_name: "oxp_1fd2ac0f-93a9-44e1-a6b3-7ccfcdc6b252/crypt/zone" } file = sled-storage/src/manager.rs:1331
5502024-12-19T05:49:16.148ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/a9851483-adb5-4271-9f27-41db71133b55) file = sled-agent/src/probe_manager.rs:231 sled_id = a9851483-adb5-4271-9f27-41db71133b55
5512024-12-19T05:49:16.199ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5522024-12-19T05:49:16.199ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_b5578c06-5ed8-4225-9470-d661174b141e/crucible" } file = sled-storage/src/manager.rs:1331
5532024-12-19T05:49:16.288ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5542024-12-19T05:49:16.288ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_f1c83160-c846-4e0a-a537-6a326722ac5a/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
5552024-12-19T05:49:16.396ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5562024-12-19T05:49:16.396ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/0cdd8476-a0d8-44ca-a74b-0704c56ede98/crypt/debug"), full_name: "oxp_0cdd8476-a0d8-44ca-a74b-0704c56ede98/crypt/debug" } file = sled-storage/src/manager.rs:1331
5572024-12-19T05:49:16.467ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5582024-12-19T05:49:16.467ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/defcb6a1-2bbe-47a6-a426-436ed60fd6fc/crypt/zone/oxz_ntp_b10d7d14-e913-49db-8411-992e06a1f1e2"), full_name: "oxp_defcb6a1-2bbe-47a6-a426-436ed60fd6fc/crypt/zone/oxz_ntp_b10d7d14-e913-49db-8411-992e06a1f1e2" } file = sled-storage/src/manager.rs:1331
5592024-12-19T05:49:16.568ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5602024-12-19T05:49:16.568ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/0686bda3-5eb8-4859-ac7b-e5a6ceb8616d/crypt/debug"), full_name: "oxp_0686bda3-5eb8-4859-ac7b-e5a6ceb8616d/crypt/debug" } file = sled-storage/src/manager.rs:1331
5612024-12-19T05:49:16.636ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5622024-12-19T05:49:16.636ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/436ef9e1-c612-46c3-866b-9e48c044fdf2/crypt/zone/oxz_crucible_pantry_94497aa9-1336-4df1-af83-5ca2d4a43909"), full_name: "oxp_436ef9e1-c612-46c3-866b-9e48c044fdf2/crypt/zone/oxz_crucible_pantry_94497aa9-1336-4df1-af83-5ca2d4a43909" } file = sled-storage/src/manager.rs:1331
5632024-12-19T05:49:16.736ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5642024-12-19T05:49:16.736ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_1fd2ac0f-93a9-44e1-a6b3-7ccfcdc6b252/crucible" } file = sled-storage/src/manager.rs:1331
5652024-12-19T05:49:16.825ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5662024-12-19T05:49:16.825ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_a0552d97-e3e6-4586-a789-e6bcdec66672/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
5672024-12-19T05:49:16.915ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5682024-12-19T05:49:16.915ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c12c68d5-6ddb-4829-80b0-49f80baef150/crypt/zone/oxz_crucible_4a60288a-de85-4cc2-97ae-0e9800cf70c5"), full_name: "oxp_c12c68d5-6ddb-4829-80b0-49f80baef150/crypt/zone/oxz_crucible_4a60288a-de85-4cc2-97ae-0e9800cf70c5" } file = sled-storage/src/manager.rs:1331
5692024-12-19T05:49:17.016ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5702024-12-19T05:49:17.016ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_f1c83160-c846-4e0a-a537-6a326722ac5a/crypt/internal_dns" } file = sled-storage/src/manager.rs:1331
5712024-12-19T05:49:17.106ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5722024-12-19T05:49:17.106ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_f1c83160-c846-4e0a-a537-6a326722ac5a/crypt/external_dns" } file = sled-storage/src/manager.rs:1331
5732024-12-19T05:49:17.150ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/a9851483-adb5-4271-9f27-41db71133b55) file = sled-agent/src/probe_manager.rs:231 sled_id = a9851483-adb5-4271-9f27-41db71133b55
5742024-12-19T05:49:17.201ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5752024-12-19T05:49:17.201ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1fd2ac0f-93a9-44e1-a6b3-7ccfcdc6b252/crypt/debug"), full_name: "oxp_1fd2ac0f-93a9-44e1-a6b3-7ccfcdc6b252/crypt/debug" } file = sled-storage/src/manager.rs:1331
5762024-12-19T05:49:17.272ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5772024-12-19T05:49:17.272ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_0cdd8476-a0d8-44ca-a74b-0704c56ede98/crucible" } file = sled-storage/src/manager.rs:1331
5782024-12-19T05:49:17.354ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5792024-12-19T05:49:17.354ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_436ef9e1-c612-46c3-866b-9e48c044fdf2/crucible" } file = sled-storage/src/manager.rs:1331
5802024-12-19T05:49:17.438ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5812024-12-19T05:49:17.439ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/0cdd8476-a0d8-44ca-a74b-0704c56ede98/crypt/zone/oxz_crucible_e027a9c4-2388-40aa-8459-5f776f88554d"), full_name: "oxp_0cdd8476-a0d8-44ca-a74b-0704c56ede98/crypt/zone/oxz_crucible_e027a9c4-2388-40aa-8459-5f776f88554d" } file = sled-storage/src/manager.rs:1331
5822024-12-19T05:49:17.535ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5832024-12-19T05:49:17.535ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/0686bda3-5eb8-4859-ac7b-e5a6ceb8616d/crypt/zone/oxz_crucible_fa00fdf3-10e6-4350-898d-2ec64b75259e"), full_name: "oxp_0686bda3-5eb8-4859-ac7b-e5a6ceb8616d/crypt/zone/oxz_crucible_fa00fdf3-10e6-4350-898d-2ec64b75259e" } file = sled-storage/src/manager.rs:1331
5842024-12-19T05:49:17.636ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5852024-12-19T05:49:17.636ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b5578c06-5ed8-4225-9470-d661174b141e/crypt/debug"), full_name: "oxp_b5578c06-5ed8-4225-9470-d661174b141e/crypt/debug" } file = sled-storage/src/manager.rs:1331
5862024-12-19T05:49:17.643ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:4292
5872024-12-19T05:49:17.643ZINFOSledAgent (ServiceManager): Ensuring there is a default route file = sled-agent/src/services.rs:4302 gateway = fd00:1122:3344:101::1
5882024-12-19T05:49:17.650ZINFOSledAgent (ServiceManager): Default route already exists file = sled-agent/src/services.rs:4316 gateway = fd00:1122:3344:101::1
5892024-12-19T05:49:17.650ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4381
5902024-12-19T05:49:17.716ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5912024-12-19T05:49:17.716ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_a0552d97-e3e6-4586-a789-e6bcdec66672/crucible" } file = sled-storage/src/manager.rs:1331
5922024-12-19T05:49:17.809ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4447
5932024-12-19T05:49:17.809ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4474
5942024-12-19T05:49:17.815ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/e0de026f-6896-43b8-9686-b840d0967c1e/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
5952024-12-19T05:49:17.816ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/d2802dae-55e1-4039-8308-ca231b2dc40c/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
5962024-12-19T05:49:17.816ZINFOSledAgent: datasets ensure: Updated storage file = sled-agent/src/sled_agent.rs:864 sled_id = a9851483-adb5-4271-9f27-41db71133b55
5972024-12-19T05:49:17.816ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5761358 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:60628 req_id = ce7e78be-b221-4fca-9ae8-4b4acd997cca response_code = 200 uri = /datasets
5982024-12-19T05:49:17.849ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4487
5992024-12-19T05:49:17.849ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4333
6002024-12-19T05:49:17.865ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: 32bd82c5-9132-4cc5-bc52-bbcbaeb63c0a (service), filesystem_pool: Some(ZpoolName { id: f1c83160-c846-4e0a-a537-6a326722ac5a (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f1c83160-c846-4e0a-a537-6a326722ac5a (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: f28b01fa-a622-4300-b098-26693361bed2 (service), filesystem_pool: Some(ZpoolName { id: 436ef9e1-c612-46c3-866b-9e48c044fdf2 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 436ef9e1-c612-46c3-866b-9e48c044fdf2 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: ecedc0eb-6c7d-4958-9fee-747c67187e55 (service), filesystem_pool: Some(ZpoolName { id: defcb6a1-2bbe-47a6-a426-436ed60fd6fc (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: defcb6a1-2bbe-47a6-a426-436ed60fd6fc (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
6012024-12-19T05:49:17.865ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41444
6022024-12-19T05:49:17.865ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 32bd82c5-9132-4cc5-bc52-bbcbaeb63c0a, dataset_name: DatasetName { pool_name: ZpoolName { id: f1c83160-c846-4e0a-a537-6a326722ac5a (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
6032024-12-19T05:49:17.865ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 32bd82c5-9132-4cc5-bc52-bbcbaeb63c0a, dataset_name: DatasetName { pool_name: ZpoolName { id: f1c83160-c846-4e0a-a537-6a326722ac5a (zpool), kind: External }, kind: InternalDns }, responder: ... }
6042024-12-19T05:49:17.900ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: f28b01fa-a622-4300-b098-26693361bed2, dataset_name: DatasetName { pool_name: ZpoolName { id: 436ef9e1-c612-46c3-866b-9e48c044fdf2 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
6052024-12-19T05:49:17.900ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: f28b01fa-a622-4300-b098-26693361bed2, dataset_name: DatasetName { pool_name: ZpoolName { id: 436ef9e1-c612-46c3-866b-9e48c044fdf2 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6062024-12-19T05:49:17.902ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4375
6072024-12-19T05:49:17.902ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4454 rack_subnet = fd00:1122:3344::
6082024-12-19T05:49:17.924ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4465
6092024-12-19T05:49:17.924ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4507
6102024-12-19T05:49:17.934ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: ecedc0eb-6c7d-4958-9fee-747c67187e55, dataset_name: DatasetName { pool_name: ZpoolName { id: defcb6a1-2bbe-47a6-a426-436ed60fd6fc (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
6112024-12-19T05:49:17.935ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: ecedc0eb-6c7d-4958-9fee-747c67187e55, dataset_name: DatasetName { pool_name: ZpoolName { id: defcb6a1-2bbe-47a6-a426-436ed60fd6fc (zpool), kind: External }, kind: InternalDns }, responder: ... }
6122024-12-19T05:49:17.971ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6132024-12-19T05:49:17.971ZINFOSledAgent (ServiceManager): No ledger in /pool/int/e0de026f-6896-43b8-9686-b840d0967c1e/config/omicron-zones.json file = common/src/ledger.rs:188
6142024-12-19T05:49:17.971ZINFOSledAgent (ServiceManager): No ledger in /pool/int/d2802dae-55e1-4039-8308-ca231b2dc40c/config/omicron-zones.json file = common/src/ledger.rs:188
6152024-12-19T05:49:17.971ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6162024-12-19T05:49:17.999ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4539
6172024-12-19T05:49:17.999ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4545
6182024-12-19T05:49:18.021ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6192024-12-19T05:49:18.021ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6202024-12-19T05:49:18.021ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6212024-12-19T05:49:18.084ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_32bd82c5-9132-4cc5-bc52-bbcbaeb63c0a file = illumos-utils/src/zone.rs:325
6222024-12-19T05:49:18.088ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_f28b01fa-a622-4300-b098-26693361bed2 file = illumos-utils/src/zone.rs:325
6232024-12-19T05:49:18.093ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_ecedc0eb-6c7d-4958-9fee-747c67187e55 file = illumos-utils/src/zone.rs:325
6242024-12-19T05:49:18.097ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8721346749480555036 sled_id = a9851483-adb5-4271-9f27-41db71133b55
6252024-12-19T05:49:18.098ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5756148205014167459 sled_id = a9851483-adb5-4271-9f27-41db71133b55
6262024-12-19T05:49:18.101ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4586
6272024-12-19T05:49:18.101ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:370
6282024-12-19T05:49:18.103ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_32bd82c5-9132-4cc5-bc52-bbcbaeb63c0a file = illumos-utils/src/zone.rs:363
6292024-12-19T05:49:18.107ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_f28b01fa-a622-4300-b098-26693361bed2 file = illumos-utils/src/zone.rs:363
6302024-12-19T05:49:18.113ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_ecedc0eb-6c7d-4958-9fee-747c67187e55 file = illumos-utils/src/zone.rs:363
6312024-12-19T05:49:18.142ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:420
6322024-12-19T05:49:18.142ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/a9851483-adb5-4271-9f27-41db71133b55) file = sled-agent/src/nexus.rs:527 sled_id = a9851483-adb5-4271-9f27-41db71133b55
6332024-12-19T05:49:18.152ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/a9851483-adb5-4271-9f27-41db71133b55) file = sled-agent/src/probe_manager.rs:231 sled_id = a9851483-adb5-4271-9f27-41db71133b55
6342024-12-19T05:49:18.174ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:717
6352024-12-19T05:49:18.174ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:762
6362024-12-19T05:49:18.175ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:765 uptime = 1
6372024-12-19T05:49:18.175ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.1.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: Some(\n None,\n ),\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n tx_eq: None,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:444
6382024-12-19T05:49:18.222ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
6392024-12-19T05:49:18.291ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:603
6402024-12-19T05:49:18.291ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
6412024-12-19T05:49:18.291ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
6422024-12-19T05:49:18.291ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
6432024-12-19T05:49:18.291ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
6442024-12-19T05:49:18.291ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
6452024-12-19T05:49:18.291ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
6462024-12-19T05:49:18.291ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
6472024-12-19T05:49:18.291ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
6482024-12-19T05:49:18.291ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
6492024-12-19T05:49:18.291ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
6502024-12-19T05:49:18.291ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
6512024-12-19T05:49:18.291ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
6522024-12-19T05:49:18.292ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
6532024-12-19T05:49:18.292ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
6542024-12-19T05:49:18.292ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
6552024-12-19T05:49:18.292ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
6562024-12-19T05:49:18.292ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
6572024-12-19T05:49:18.292ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
6582024-12-19T05:49:18.292ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
6592024-12-19T05:49:18.292ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
6602024-12-19T05:49:18.292ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
6612024-12-19T05:49:18.292ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
6622024-12-19T05:49:18.797ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5534721212470721226 sled_id = a9851483-adb5-4271-9f27-41db71133b55
6632024-12-19T05:49:18.797ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7823616040735775052 sled_id = a9851483-adb5-4271-9f27-41db71133b55
6642024-12-19T05:49:19.154ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/a9851483-adb5-4271-9f27-41db71133b55) file = sled-agent/src/probe_manager.rs:231 sled_id = a9851483-adb5-4271-9f27-41db71133b55
6652024-12-19T05:49:19.709ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_f28b01fa-a622-4300-b098-26693361bed2: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6662024-12-19T05:49:19.709ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
6672024-12-19T05:49:19.709ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_f28b01fa-a622-4300-b098-26693361bed2 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_f28b01fa-a622-4300-b098-26693361bed2
6682024-12-19T05:49:20.193ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_ecedc0eb-6c7d-4958-9fee-747c67187e55: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6692024-12-19T05:49:20.193ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
6702024-12-19T05:49:20.677ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_32bd82c5-9132-4cc5-bc52-bbcbaeb63c0a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6712024-12-19T05:49:20.684ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f28b01fa-a622-4300-b098-26693361bed2") failed: Property not found. retry in 39.876361ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_f28b01fa-a622-4300-b098-26693361bed2
6722024-12-19T05:49:20.684ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_ecedc0eb-6c7d-4958-9fee-747c67187e55 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_ecedc0eb-6c7d-4958-9fee-747c67187e55
6732024-12-19T05:49:20.689ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
6742024-12-19T05:49:20.689ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_32bd82c5-9132-4cc5-bc52-bbcbaeb63c0a zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_32bd82c5-9132-4cc5-bc52-bbcbaeb63c0a
6752024-12-19T05:49:20.733ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f28b01fa-a622-4300-b098-26693361bed2") failed: Property not found. retry in 94.126656ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_f28b01fa-a622-4300-b098-26693361bed2
6762024-12-19T05:49:20.816ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ecedc0eb-6c7d-4958-9fee-747c67187e55") failed: Property not found. retry in 32.113111ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_ecedc0eb-6c7d-4958-9fee-747c67187e55
6772024-12-19T05:49:20.823ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_32bd82c5-9132-4cc5-bc52-bbcbaeb63c0a") failed: Property not found. retry in 52.332731ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_32bd82c5-9132-4cc5-bc52-bbcbaeb63c0a
6782024-12-19T05:49:20.837ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f28b01fa-a622-4300-b098-26693361bed2") failed: Property not found. retry in 125.509116ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_f28b01fa-a622-4300-b098-26693361bed2
6792024-12-19T05:49:20.856ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ecedc0eb-6c7d-4958-9fee-747c67187e55") failed: Property not found. retry in 115.205431ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_ecedc0eb-6c7d-4958-9fee-747c67187e55
6802024-12-19T05:49:20.890ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_32bd82c5-9132-4cc5-bc52-bbcbaeb63c0a") failed: Property not found. retry in 60.969889ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_32bd82c5-9132-4cc5-bc52-bbcbaeb63c0a
6812024-12-19T05:49:21.129ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_32bd82c5-9132-4cc5-bc52-bbcbaeb63c0a") failed: Property not found. retry in 239.128641ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_32bd82c5-9132-4cc5-bc52-bbcbaeb63c0a
6822024-12-19T05:49:21.175ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f28b01fa-a622-4300-b098-26693361bed2") failed: Property not found. retry in 555.67314ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_f28b01fa-a622-4300-b098-26693361bed2
6832024-12-19T05:49:21.257ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ecedc0eb-6c7d-4958-9fee-747c67187e55") failed: Property not found. retry in 134.316547ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_ecedc0eb-6c7d-4958-9fee-747c67187e55
6842024-12-19T05:49:21.381ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_32bd82c5-9132-4cc5-bc52-bbcbaeb63c0a") failed: Property not found. retry in 269.721837ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_32bd82c5-9132-4cc5-bc52-bbcbaeb63c0a
6852024-12-19T05:49:21.402ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ecedc0eb-6c7d-4958-9fee-747c67187e55") failed: Property not found. retry in 237.71832ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_ecedc0eb-6c7d-4958-9fee-747c67187e55
6862024-12-19T05:49:21.650ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ecedc0eb-6c7d-4958-9fee-747c67187e55") failed: Property not found. retry in 551.475576ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_ecedc0eb-6c7d-4958-9fee-747c67187e55
6872024-12-19T05:49:21.659ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_32bd82c5-9132-4cc5-bc52-bbcbaeb63c0a") failed: Property not found. retry in 451.217336ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_32bd82c5-9132-4cc5-bc52-bbcbaeb63c0a
6882024-12-19T05:49:21.740ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f28b01fa-a622-4300-b098-26693361bed2") failed: Property not found. retry in 671.751433ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_f28b01fa-a622-4300-b098-26693361bed2
6892024-12-19T05:49:22.121ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_32bd82c5-9132-4cc5-bc52-bbcbaeb63c0a") failed: Property not found. retry in 584.639873ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_32bd82c5-9132-4cc5-bc52-bbcbaeb63c0a
6902024-12-19T05:49:22.211ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ecedc0eb-6c7d-4958-9fee-747c67187e55") failed: Property not found. retry in 1.442674395s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_ecedc0eb-6c7d-4958-9fee-747c67187e55
6912024-12-19T05:49:22.422ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f28b01fa-a622-4300-b098-26693361bed2") failed: Property not found. retry in 925.295538ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_f28b01fa-a622-4300-b098-26693361bed2
6922024-12-19T05:49:22.715ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_32bd82c5-9132-4cc5-bc52-bbcbaeb63c0a") failed: Property not found. retry in 1.220322485s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_32bd82c5-9132-4cc5-bc52-bbcbaeb63c0a
6932024-12-19T05:49:23.357ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f28b01fa-a622-4300-b098-26693361bed2") failed: Property not found. retry in 1.10929922s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_f28b01fa-a622-4300-b098-26693361bed2
6942024-12-19T05:49:23.662ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ecedc0eb-6c7d-4958-9fee-747c67187e55") failed: Property not found. retry in 678.414361ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_ecedc0eb-6c7d-4958-9fee-747c67187e55
6952024-12-19T05:49:23.944ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_32bd82c5-9132-4cc5-bc52-bbcbaeb63c0a") failed: Property not found. retry in 892.446464ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_32bd82c5-9132-4cc5-bc52-bbcbaeb63c0a
6962024-12-19T05:49:24.349ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ecedc0eb-6c7d-4958-9fee-747c67187e55") failed: Property not found. retry in 1.214430821s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_ecedc0eb-6c7d-4958-9fee-747c67187e55
6972024-12-19T05:49:24.476ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f28b01fa-a622-4300-b098-26693361bed2") failed: Property not found. retry in 512.244453ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_f28b01fa-a622-4300-b098-26693361bed2
6982024-12-19T05:49:24.846ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_32bd82c5-9132-4cc5-bc52-bbcbaeb63c0a") failed: Property not found. retry in 1.489432925s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_32bd82c5-9132-4cc5-bc52-bbcbaeb63c0a
6992024-12-19T05:49:24.997ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f28b01fa-a622-4300-b098-26693361bed2") failed: Property not found. retry in 1.212425016s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_f28b01fa-a622-4300-b098-26693361bed2
7002024-12-19T05:49:25.573ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ecedc0eb-6c7d-4958-9fee-747c67187e55") failed: Property not found. retry in 787.435285ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_ecedc0eb-6c7d-4958-9fee-747c67187e55
7012024-12-19T05:49:26.345ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_32bd82c5-9132-4cc5-bc52-bbcbaeb63c0a") failed: Property not found. retry in 675.308377ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_32bd82c5-9132-4cc5-bc52-bbcbaeb63c0a
7022024-12-19T05:49:26.370ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ecedc0eb-6c7d-4958-9fee-747c67187e55") failed: Property not found. retry in 1.217368068s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_ecedc0eb-6c7d-4958-9fee-747c67187e55
7032024-12-19T05:49:27.607ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_internal_dns_32bd82c5-9132-4cc5-bc52-bbcbaeb63c0a
7042024-12-19T05:49:27.607ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_internal_dns_f28b01fa-a622-4300-b098-26693361bed2
7052024-12-19T05:49:27.607ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_internal_dns_ecedc0eb-6c7d-4958-9fee-747c67187e55
7062024-12-19T05:49:27.607ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/e0de026f-6896-43b8-9686-b840d0967c1e/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7072024-12-19T05:49:27.607ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/d2802dae-55e1-4039-8308-ca231b2dc40c/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7082024-12-19T05:49:27.608ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9742460 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:41444 req_id = 1448b79f-71d6-4be2-9e85-65064cfd62b6 response_code = 204 uri = /omicron-zones
7092024-12-19T05:49:27.610ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7102024-12-19T05:49:28.100ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8721346749480555036 sled_id = a9851483-adb5-4271-9f27-41db71133b55
7112024-12-19T05:49:28.100ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5756148205014167459 sled_id = a9851483-adb5-4271-9f27-41db71133b55
7122024-12-19T05:49:28.799ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5534721212470721226 sled_id = a9851483-adb5-4271-9f27-41db71133b55
7132024-12-19T05:49:28.799ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7823616040735775052 sled_id = a9851483-adb5-4271-9f27-41db71133b55
7142024-12-19T05:49:29.175ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 57.781393ms) dns_config_addr = [fd00:1122:3344:1::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:1::1]:5353/config) file = sled-agent/src/rack_setup/service.rs:678
7152024-12-19T05:49:29.234ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 165.729337ms) dns_config_addr = [fd00:1122:3344:1::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:1::1]:5353/config) file = sled-agent/src/rack_setup/service.rs:678
7162024-12-19T05:49:29.468ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7172024-12-19T05:49:29.578ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7182024-12-19T05:49:29.661ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:694
7192024-12-19T05:49:29.661ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7202024-12-19T05:49:29.692ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7212024-12-19T05:49:29.693ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7222024-12-19T05:49:29.693ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7232024-12-19T05:49:29.722ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: 32bd82c5-9132-4cc5-bc52-bbcbaeb63c0a (service), filesystem_pool: Some(ZpoolName { id: f1c83160-c846-4e0a-a537-6a326722ac5a (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f1c83160-c846-4e0a-a537-6a326722ac5a (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: f28b01fa-a622-4300-b098-26693361bed2 (service), filesystem_pool: Some(ZpoolName { id: 436ef9e1-c612-46c3-866b-9e48c044fdf2 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 436ef9e1-c612-46c3-866b-9e48c044fdf2 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: ecedc0eb-6c7d-4958-9fee-747c67187e55 (service), filesystem_pool: Some(ZpoolName { id: defcb6a1-2bbe-47a6-a426-436ed60fd6fc (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: defcb6a1-2bbe-47a6-a426-436ed60fd6fc (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: b10d7d14-e913-49db-8411-992e06a1f1e2 (service), filesystem_pool: Some(ZpoolName { id: defcb6a1-2bbe-47a6-a426-436ed60fd6fc (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 6a759d48-5f75-4601-8164-346068267cb2, kind: Service { id: b10d7d14-e913-49db-8411-992e06a1f1e2 }, name: Name("ntp-b10d7d14-e913-49db-8411-992e06a1f1e2"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 40])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
7242024-12-19T05:49:29.722ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61864
7252024-12-19T05:49:29.722ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 32bd82c5-9132-4cc5-bc52-bbcbaeb63c0a, dataset_name: DatasetName { pool_name: ZpoolName { id: f1c83160-c846-4e0a-a537-6a326722ac5a (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
7262024-12-19T05:49:29.722ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 32bd82c5-9132-4cc5-bc52-bbcbaeb63c0a, dataset_name: DatasetName { pool_name: ZpoolName { id: f1c83160-c846-4e0a-a537-6a326722ac5a (zpool), kind: External }, kind: InternalDns }, responder: ... }
7272024-12-19T05:49:29.783ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: f28b01fa-a622-4300-b098-26693361bed2, dataset_name: DatasetName { pool_name: ZpoolName { id: 436ef9e1-c612-46c3-866b-9e48c044fdf2 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
7282024-12-19T05:49:29.783ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: f28b01fa-a622-4300-b098-26693361bed2, dataset_name: DatasetName { pool_name: ZpoolName { id: 436ef9e1-c612-46c3-866b-9e48c044fdf2 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7292024-12-19T05:49:29.822ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: ecedc0eb-6c7d-4958-9fee-747c67187e55, dataset_name: DatasetName { pool_name: ZpoolName { id: defcb6a1-2bbe-47a6-a426-436ed60fd6fc (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
7302024-12-19T05:49:29.822ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: ecedc0eb-6c7d-4958-9fee-747c67187e55, dataset_name: DatasetName { pool_name: ZpoolName { id: defcb6a1-2bbe-47a6-a426-436ed60fd6fc (zpool), kind: External }, kind: InternalDns }, responder: ... }
7312024-12-19T05:49:29.876ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7322024-12-19T05:49:29.876ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/e0de026f-6896-43b8-9686-b840d0967c1e/config/omicron-zones.json file = common/src/ledger.rs:177
7332024-12-19T05:49:29.876ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/d2802dae-55e1-4039-8308-ca231b2dc40c/config/omicron-zones.json file = common/src/ledger.rs:177
7342024-12-19T05:49:29.876ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7352024-12-19T05:49:29.888ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7362024-12-19T05:49:29.920ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7372024-12-19T05:49:29.921ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7382024-12-19T05:49:29.921ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7392024-12-19T05:49:29.950ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 129, 40]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
7402024-12-19T05:49:29.950ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1263 zone_type = boundary_ntp
7412024-12-19T05:49:29.951ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:83
7422024-12-19T05:49:29.951ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:90
7432024-12-19T05:49:29.951ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:118
7442024-12-19T05:49:29.951ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7452024-12-19T05:49:29.974ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_b10d7d14-e913-49db-8411-992e06a1f1e2 file = illumos-utils/src/zone.rs:325
7462024-12-19T05:49:29.992ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_b10d7d14-e913-49db-8411-992e06a1f1e2 file = illumos-utils/src/zone.rs:363
7472024-12-19T05:49:30.609ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_b10d7d14-e913-49db-8411-992e06a1f1e2: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7482024-12-19T05:49:30.609ZINFOSledAgent (ServiceManager): Booting oxz_ntp_b10d7d14-e913-49db-8411-992e06a1f1e2 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_ntp_b10d7d14-e913-49db-8411-992e06a1f1e2
7492024-12-19T05:49:30.743ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_b10d7d14-e913-49db-8411-992e06a1f1e2") failed: Property not found. retry in 36.948298ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_b10d7d14-e913-49db-8411-992e06a1f1e2
7502024-12-19T05:49:30.786ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_b10d7d14-e913-49db-8411-992e06a1f1e2") failed: Property not found. retry in 148.095636ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_b10d7d14-e913-49db-8411-992e06a1f1e2
7512024-12-19T05:49:30.962ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_b10d7d14-e913-49db-8411-992e06a1f1e2") failed: Property not found. retry in 299.852115ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_b10d7d14-e913-49db-8411-992e06a1f1e2
7522024-12-19T05:49:31.272ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_b10d7d14-e913-49db-8411-992e06a1f1e2") failed: Property not found. retry in 332.048656ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_b10d7d14-e913-49db-8411-992e06a1f1e2
7532024-12-19T05:49:31.613ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_b10d7d14-e913-49db-8411-992e06a1f1e2") failed: Property not found. retry in 655.653774ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_b10d7d14-e913-49db-8411-992e06a1f1e2
7542024-12-19T05:49:32.278ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_b10d7d14-e913-49db-8411-992e06a1f1e2") failed: Property not found. retry in 1.017483882s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_b10d7d14-e913-49db-8411-992e06a1f1e2
7552024-12-19T05:49:33.306ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_b10d7d14-e913-49db-8411-992e06a1f1e2") failed: Property not found. retry in 1.371712292s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_b10d7d14-e913-49db-8411-992e06a1f1e2
7562024-12-19T05:49:34.686ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_b10d7d14-e913-49db-8411-992e06a1f1e2") failed: Property not found. retry in 924.62881ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_b10d7d14-e913-49db-8411-992e06a1f1e2
7572024-12-19T05:49:35.620ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_b10d7d14-e913-49db-8411-992e06a1f1e2") failed: Property not found. retry in 864.880301ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_b10d7d14-e913-49db-8411-992e06a1f1e2
7582024-12-19T05:49:36.257ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7218971715660750967 sled_id = a9851483-adb5-4271-9f27-41db71133b55
7592024-12-19T05:49:36.495ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_b10d7d14-e913-49db-8411-992e06a1f1e2") failed: Property not found. retry in 1.43173196s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_b10d7d14-e913-49db-8411-992e06a1f1e2
7602024-12-19T05:49:37.043ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3446670803788481298 sled_id = a9851483-adb5-4271-9f27-41db71133b55
7612024-12-19T05:49:37.610ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3676573883658449401 sled_id = a9851483-adb5-4271-9f27-41db71133b55
7622024-12-19T05:49:37.945ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_ntp_b10d7d14-e913-49db-8411-992e06a1f1e2
7632024-12-19T05:49:37.946ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/e0de026f-6896-43b8-9686-b840d0967c1e/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7642024-12-19T05:49:37.946ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/d2802dae-55e1-4039-8308-ca231b2dc40c/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7652024-12-19T05:49:37.946ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8224329 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:61864 req_id = 17b2b4c8-4cdd-4c71-b4c3-e9ed0d541730 response_code = 204 uri = /omicron-zones
7662024-12-19T05:49:37.949ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:735
7672024-12-19T05:49:37.979ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
7682024-12-19T05:49:37.979ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34516
7692024-12-19T05:49:37.988ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_b10d7d14-e913-49db-8411-992e06a1f1e2': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
7702024-12-19T05:49:37.988ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 8255 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:34516 req_id = fae8b405-2edd-4c20-8887-61db62c9f0ca response_code = 500 uri = /timesync
7712024-12-19T05:49:37.990ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
7722024-12-19T05:49:38.102ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8721346749480555036 sled_id = a9851483-adb5-4271-9f27-41db71133b55
7732024-12-19T05:49:38.102ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5756148205014167459 sled_id = a9851483-adb5-4271-9f27-41db71133b55
7742024-12-19T05:49:38.171ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
7752024-12-19T05:49:38.171ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54781
7762024-12-19T05:49:42.181ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_b10d7d14-e913-49db-8411-992e06a1f1e2': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
7772024-12-19T05:49:42.181ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 4009402 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:54781 req_id = 0aff6392-eaee-4d1b-b500-df64173ae349 response_code = 500 uri = /timesync
7782024-12-19T05:49:42.183ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5534721212470721226 sled_id = a9851483-adb5-4271-9f27-41db71133b55
7792024-12-19T05:49:42.183ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7823616040735775052 sled_id = a9851483-adb5-4271-9f27-41db71133b55
7802024-12-19T05:49:42.185ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
7812024-12-19T05:49:42.339ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
7822024-12-19T05:49:42.339ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48802
7832024-12-19T05:49:42.348ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8597 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:48802 req_id = c99d0e8e-95b9-460a-b65a-cefacf12ebed response_code = 200 uri = /timesync
7842024-12-19T05:49:42.350ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
7852024-12-19T05:49:42.350ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
7862024-12-19T05:49:42.532ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
7872024-12-19T05:49:42.532ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51017
7882024-12-19T05:49:42.541ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8485 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:51017 req_id = ecb0af30-bd32-4ede-8f85-cd4b458b6831 response_code = 200 uri = /timesync
7892024-12-19T05:49:42.543ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
7902024-12-19T05:49:42.543ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
7912024-12-19T05:49:42.681ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
7922024-12-19T05:49:42.681ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41492
7932024-12-19T05:49:42.690ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8357 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:41492 req_id = d5dbb016-89de-4d2a-a810-842fc693c4f7 response_code = 200 uri = /timesync
7942024-12-19T05:49:42.692ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
7952024-12-19T05:49:42.692ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
7962024-12-19T05:49:42.911ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
7972024-12-19T05:49:42.911ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57293
7982024-12-19T05:49:42.919ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7909 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:57293 req_id = f8eb0de9-7072-48f1-90a6-6e1af55c9859 response_code = 200 uri = /timesync
7992024-12-19T05:49:42.921ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8002024-12-19T05:49:42.921ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8012024-12-19T05:49:43.205ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8022024-12-19T05:49:43.205ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62243
8032024-12-19T05:49:43.213ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8099 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:62243 req_id = f0f0823b-d03c-4cd0-89d2-c2dae9abc39e response_code = 200 uri = /timesync
8042024-12-19T05:49:43.217ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8052024-12-19T05:49:43.217ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8062024-12-19T05:49:43.187ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8072024-12-19T05:49:43.187ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48096
8082024-12-19T05:49:43.195ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7676 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:48096 req_id = 11007f2d-d652-4fe2-ac61-65700cb34ce6 response_code = 200 uri = /timesync
8092024-12-19T05:49:43.197ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8102024-12-19T05:49:43.197ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8112024-12-19T05:49:43.321ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8122024-12-19T05:49:43.321ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44736
8132024-12-19T05:49:43.329ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8369 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:44736 req_id = 36cec6a4-c792-48ff-917b-36b17c7534ed response_code = 200 uri = /timesync
8142024-12-19T05:49:43.331ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8152024-12-19T05:49:43.331ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8162024-12-19T05:49:43.582ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8172024-12-19T05:49:43.582ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42622
8182024-12-19T05:49:43.590ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7860 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42622 req_id = 4f4e4524-3707-4229-a2d3-bc2c2617b3df response_code = 200 uri = /timesync
8192024-12-19T05:49:43.592ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8202024-12-19T05:49:43.592ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8212024-12-19T05:49:44.351ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8222024-12-19T05:49:44.351ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58478
8232024-12-19T05:49:44.360ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8553 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:58478 req_id = 3582a0d5-f956-46aa-a901-d07815303846 response_code = 200 uri = /timesync
8242024-12-19T05:49:44.362ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.400741011 } file = sled-agent/src/rack_setup/service.rs:743
8252024-12-19T05:49:44.362ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8262024-12-19T05:49:44.814ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8272024-12-19T05:49:44.814ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47376
8282024-12-19T05:49:44.823ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8177 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:47376 req_id = d8aa47b7-183d-469b-b54d-7353db0f34b8 response_code = 200 uri = /timesync
8292024-12-19T05:49:44.826ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.399483144 } file = sled-agent/src/rack_setup/service.rs:743
8302024-12-19T05:49:44.826ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8312024-12-19T05:49:45.937ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8322024-12-19T05:49:45.937ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34955
8332024-12-19T05:49:45.945ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:34955 req_id = 032d3e5e-0ca9-4c5f-a478-67958f80d35c response_code = 200 uri = /timesync
8342024-12-19T05:49:45.948ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.39644593 } file = sled-agent/src/rack_setup/service.rs:743
8352024-12-19T05:49:45.948ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8362024-12-19T05:49:45.963ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7218971715660750967 sled_id = a9851483-adb5-4271-9f27-41db71133b55
8372024-12-19T05:49:46.446ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8382024-12-19T05:49:46.446ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62933
8392024-12-19T05:49:46.454ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7978 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:62933 req_id = a577006d-9d41-452e-9c30-56c4630d3e87 response_code = 200 uri = /timesync
8402024-12-19T05:49:46.456ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2892107533, ip_addr: 172.98.15.13, stratum: 3, ref_time: 1734587385.9492657, correction: -0.392560929 } file = sled-agent/src/rack_setup/service.rs:743
8412024-12-19T05:49:46.456ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8422024-12-19T05:49:46.746ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3446670803788481298 sled_id = a9851483-adb5-4271-9f27-41db71133b55
8432024-12-19T05:49:47.310ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3676573883658449401 sled_id = a9851483-adb5-4271-9f27-41db71133b55
8442024-12-19T05:49:47.374ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8452024-12-19T05:49:47.375ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37721
8462024-12-19T05:49:47.383ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8579 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:37721 req_id = bbaa1d52-1965-4c5f-97e1-538075637440 response_code = 200 uri = /timesync
8472024-12-19T05:49:47.386ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1734587385.350855, correction: -0.390038788 } file = sled-agent/src/rack_setup/service.rs:743
8482024-12-19T05:49:47.386ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8492024-12-19T05:49:47.558ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:33460
8502024-12-19T05:49:47.558ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:33460 req_id = 3796389f-0c88-44cf-937c-285a5e28e7ae response_code = 200 uri = /baseboard
8512024-12-19T05:49:47.609ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 195.825109ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = a9851483-adb5-4271-9f27-41db71133b55
8522024-12-19T05:49:47.647ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16746935770677152466 sled_id = a9851483-adb5-4271-9f27-41db71133b55
8532024-12-19T05:49:47.647ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 18074085491604458815 sled_id = a9851483-adb5-4271-9f27-41db71133b55
8542024-12-19T05:49:47.801ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8721346749480555036 sled_id = a9851483-adb5-4271-9f27-41db71133b55
8552024-12-19T05:49:47.801ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5756148205014167459 sled_id = a9851483-adb5-4271-9f27-41db71133b55
8562024-12-19T05:49:48.299ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8572024-12-19T05:49:48.300ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44975
8582024-12-19T05:49:48.308ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8408 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:44975 req_id = b8d4ca90-6487-43e6-870a-beac2930a43d response_code = 200 uri = /timesync
8592024-12-19T05:49:48.311ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1734587385.350855, correction: -0.388895571 } file = sled-agent/src/rack_setup/service.rs:743
8602024-12-19T05:49:48.311ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8612024-12-19T05:49:50.057ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8622024-12-19T05:49:50.057ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42436
8632024-12-19T05:49:50.067ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9343 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42436 req_id = cfc71386-e701-41b0-a1f4-a0afc1d54698 response_code = 200 uri = /timesync
8642024-12-19T05:49:50.070ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1734587385.350855, correction: -0.37702471 } file = sled-agent/src/rack_setup/service.rs:743
8652024-12-19T05:49:50.070ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8662024-12-19T05:49:51.872ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5534721212470721226 sled_id = a9851483-adb5-4271-9f27-41db71133b55
8672024-12-19T05:49:51.872ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7823616040735775052 sled_id = a9851483-adb5-4271-9f27-41db71133b55
8682024-12-19T05:49:52.532ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8692024-12-19T05:49:52.532ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55372
8702024-12-19T05:49:52.540ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7893 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:55372 req_id = 1052a7d8-ed2a-4a64-9a3c-a6acf5569a8a response_code = 200 uri = /timesync
8712024-12-19T05:49:52.543ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2892107533, ip_addr: 172.98.15.13, stratum: 3, ref_time: 1734587391.0972924, correction: -0.369617879 } file = sled-agent/src/rack_setup/service.rs:743
8722024-12-19T05:49:52.543ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8732024-12-19T05:49:54.675ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8742024-12-19T05:49:54.675ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51840
8752024-12-19T05:49:54.685ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9348 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:51840 req_id = 0d3e61dd-efee-4e66-a418-979facd2dcb3 response_code = 200 uri = /timesync
8762024-12-19T05:49:54.687ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2892107533, ip_addr: 172.98.15.13, stratum: 3, ref_time: 1734587393.7528453, correction: -0.364166975 } file = sled-agent/src/rack_setup/service.rs:743
8772024-12-19T05:49:54.687ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8782024-12-19T05:49:55.938ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7218971715660750967 sled_id = a9851483-adb5-4271-9f27-41db71133b55
8792024-12-19T05:49:56.674ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8802024-12-19T05:49:56.675ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60270
8812024-12-19T05:49:56.684ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8961 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:60270 req_id = f8b82125-f0e4-4703-ac65-25f03db078c0 response_code = 200 uri = /timesync
8822024-12-19T05:49:56.686ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 94465982, ip_addr: 5.161.111.190, stratum: 5, ref_time: 1734587395.8025892, correction: -0.358242333 } file = sled-agent/src/rack_setup/service.rs:743
8832024-12-19T05:49:56.686ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8842024-12-19T05:49:56.721ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3446670803788481298 sled_id = a9851483-adb5-4271-9f27-41db71133b55
8852024-12-19T05:49:57.284ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3676573883658449401 sled_id = a9851483-adb5-4271-9f27-41db71133b55
8862024-12-19T05:49:57.622ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16746935770677152466 sled_id = a9851483-adb5-4271-9f27-41db71133b55
8872024-12-19T05:49:57.622ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 18074085491604458815 sled_id = a9851483-adb5-4271-9f27-41db71133b55
8882024-12-19T05:49:57.775ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8721346749480555036 sled_id = a9851483-adb5-4271-9f27-41db71133b55
8892024-12-19T05:49:57.775ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5756148205014167459 sled_id = a9851483-adb5-4271-9f27-41db71133b55
8902024-12-19T05:50:00.280ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8912024-12-19T05:50:00.280ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59297
8922024-12-19T05:50:00.289ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8717 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:59297 req_id = 1ade04e4-d594-4b36-ae9d-86a1e72e5954 response_code = 200 uri = /timesync
8932024-12-19T05:50:00.292ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 94465982, ip_addr: 5.161.111.190, stratum: 5, ref_time: 1734587399.113487, correction: -0.348444551 } file = sled-agent/src/rack_setup/service.rs:743
8942024-12-19T05:50:00.292ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8952024-12-19T05:50:01.847ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5534721212470721226 sled_id = a9851483-adb5-4271-9f27-41db71133b55
8962024-12-19T05:50:01.847ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7823616040735775052 sled_id = a9851483-adb5-4271-9f27-41db71133b55
8972024-12-19T05:50:02.799ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 532.785475ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = a9851483-adb5-4271-9f27-41db71133b55
8982024-12-19T05:50:04.719ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8992024-12-19T05:50:04.719ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59276
9002024-12-19T05:50:04.728ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8944 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:59276 req_id = 4efb0d07-9692-4183-873a-b50138ddd5d6 response_code = 200 uri = /timesync
9012024-12-19T05:50:04.730ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 94465982, ip_addr: 5.161.111.190, stratum: 5, ref_time: 1734587403.1299071, correction: -0.336268514 } file = sled-agent/src/rack_setup/service.rs:743
9022024-12-19T05:50:04.730ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9032024-12-19T05:50:05.913ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7218971715660750967 sled_id = a9851483-adb5-4271-9f27-41db71133b55
9042024-12-19T05:50:06.696ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3446670803788481298 sled_id = a9851483-adb5-4271-9f27-41db71133b55
9052024-12-19T05:50:07.258ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3676573883658449401 sled_id = a9851483-adb5-4271-9f27-41db71133b55
9062024-12-19T05:50:07.597ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16746935770677152466 sled_id = a9851483-adb5-4271-9f27-41db71133b55
9072024-12-19T05:50:07.598ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 18074085491604458815 sled_id = a9851483-adb5-4271-9f27-41db71133b55
9082024-12-19T05:50:07.749ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8721346749480555036 sled_id = a9851483-adb5-4271-9f27-41db71133b55
9092024-12-19T05:50:07.750ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5756148205014167459 sled_id = a9851483-adb5-4271-9f27-41db71133b55
9102024-12-19T05:50:09.263ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9112024-12-19T05:50:09.263ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60939
9122024-12-19T05:50:09.271ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8605 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:60939 req_id = 013c29b0-1dd0-48cb-89b1-cf62f8319577 response_code = 200 uri = /timesync
9132024-12-19T05:50:09.275ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 94465982, ip_addr: 5.161.111.190, stratum: 5, ref_time: 1734587406.9913995, correction: -0.324382812 } file = sled-agent/src/rack_setup/service.rs:743
9142024-12-19T05:50:09.275ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9152024-12-19T05:50:11.822ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5534721212470721226 sled_id = a9851483-adb5-4271-9f27-41db71133b55
9162024-12-19T05:50:11.822ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7823616040735775052 sled_id = a9851483-adb5-4271-9f27-41db71133b55
9172024-12-19T05:50:12.804ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9182024-12-19T05:50:12.804ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59497
9192024-12-19T05:50:12.813ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8701 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:59497 req_id = cfc47deb-1f16-4954-bb13-d8fedbeb63d7 response_code = 200 uri = /timesync
9202024-12-19T05:50:12.815ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 94465982, ip_addr: 5.161.111.190, stratum: 5, ref_time: 1734587410.7819982, correction: -0.31470421 } file = sled-agent/src/rack_setup/service.rs:743
9212024-12-19T05:50:12.815ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9222024-12-19T05:50:15.888ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7218971715660750967 sled_id = a9851483-adb5-4271-9f27-41db71133b55
9232024-12-19T05:50:16.670ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3446670803788481298 sled_id = a9851483-adb5-4271-9f27-41db71133b55
9242024-12-19T05:50:17.187ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9252024-12-19T05:50:17.188ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54749
9262024-12-19T05:50:17.197ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8927 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:54749 req_id = bd7a0ab2-5d73-41cc-87b4-2fe0b271fa83 response_code = 200 uri = /timesync
9272024-12-19T05:50:17.200ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 94465982, ip_addr: 5.161.111.190, stratum: 5, ref_time: 1734587415.1533077, correction: -0.302889973 } file = sled-agent/src/rack_setup/service.rs:743
9282024-12-19T05:50:17.200ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9292024-12-19T05:50:17.234ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3676573883658449401 sled_id = a9851483-adb5-4271-9f27-41db71133b55
9302024-12-19T05:50:17.512ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:58112
9312024-12-19T05:50:17.512ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 25 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:58112 req_id = 296c34b9-c41b-4d3b-8ce7-c1ee7c8465ce response_code = 200 uri = /baseboard
9322024-12-19T05:50:17.572ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16746935770677152466 sled_id = a9851483-adb5-4271-9f27-41db71133b55
9332024-12-19T05:50:17.572ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 18074085491604458815 sled_id = a9851483-adb5-4271-9f27-41db71133b55
9342024-12-19T05:50:17.724ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 8721346749480555036 reason = Duration(60s) sled_id = a9851483-adb5-4271-9f27-41db71133b55
9352024-12-19T05:50:17.725ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 5756148205014167459 reason = Duration(60s) sled_id = a9851483-adb5-4271-9f27-41db71133b55
9362024-12-19T05:50:18.326ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 929.678859ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = a9851483-adb5-4271-9f27-41db71133b55
9372024-12-19T05:50:21.796ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5534721212470721226 sled_id = a9851483-adb5-4271-9f27-41db71133b55
9382024-12-19T05:50:21.796ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7823616040735775052 sled_id = a9851483-adb5-4271-9f27-41db71133b55
9392024-12-19T05:50:23.994ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9402024-12-19T05:50:23.994ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64984
9412024-12-19T05:50:24.004ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9504 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:64984 req_id = 4d902402-95bd-4352-85d6-5959ed268213 response_code = 200 uri = /timesync
9422024-12-19T05:50:24.007ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 94465982, ip_addr: 5.161.111.190, stratum: 5, ref_time: 1734587419.269292, correction: -0.28407675 } file = sled-agent/src/rack_setup/service.rs:743
9432024-12-19T05:50:24.007ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9442024-12-19T05:50:25.862ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7218971715660750967 sled_id = a9851483-adb5-4271-9f27-41db71133b55
9452024-12-19T05:50:26.645ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3446670803788481298 sled_id = a9851483-adb5-4271-9f27-41db71133b55
9462024-12-19T05:50:27.208ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3676573883658449401 sled_id = a9851483-adb5-4271-9f27-41db71133b55
9472024-12-19T05:50:27.547ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16746935770677152466 sled_id = a9851483-adb5-4271-9f27-41db71133b55
9482024-12-19T05:50:27.547ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 18074085491604458815 sled_id = a9851483-adb5-4271-9f27-41db71133b55
9492024-12-19T05:50:31.772ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5534721212470721226 sled_id = a9851483-adb5-4271-9f27-41db71133b55
9502024-12-19T05:50:31.772ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7823616040735775052 sled_id = a9851483-adb5-4271-9f27-41db71133b55
9512024-12-19T05:50:34.248ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.537116018s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = a9851483-adb5-4271-9f27-41db71133b55
9522024-12-19T05:50:35.837ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 7218971715660750967 reason = Duration(60s) sled_id = a9851483-adb5-4271-9f27-41db71133b55
9532024-12-19T05:50:36.621ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 3446670803788481298 reason = Duration(60s) sled_id = a9851483-adb5-4271-9f27-41db71133b55
9542024-12-19T05:50:37.018ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9552024-12-19T05:50:37.018ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:50592
9562024-12-19T05:50:37.027ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8815 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:50592 req_id = 62f37a5c-d44e-485f-bbf7-fee5d510c48b response_code = 200 uri = /timesync
9572024-12-19T05:50:37.030ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 94465982, ip_addr: 5.161.111.190, stratum: 5, ref_time: 1734587431.670792, correction: -0.248669371 } file = sled-agent/src/rack_setup/service.rs:743
9582024-12-19T05:50:37.030ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9592024-12-19T05:50:37.183ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 3676573883658449401 reason = Duration(60s) sled_id = a9851483-adb5-4271-9f27-41db71133b55
9602024-12-19T05:50:37.522ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16746935770677152466 sled_id = a9851483-adb5-4271-9f27-41db71133b55
9612024-12-19T05:50:37.522ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 18074085491604458815 sled_id = a9851483-adb5-4271-9f27-41db71133b55
9622024-12-19T05:50:41.747ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5534721212470721226 sled_id = a9851483-adb5-4271-9f27-41db71133b55
9632024-12-19T05:50:41.747ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7823616040735775052 sled_id = a9851483-adb5-4271-9f27-41db71133b55
9642024-12-19T05:50:43.674ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9652024-12-19T05:50:43.674ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54797
9662024-12-19T05:50:43.683ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8692 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:54797 req_id = 94800036-7336-4925-a12a-43210fe2f20e response_code = 200 uri = /timesync
9672024-12-19T05:50:43.685ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 94465982, ip_addr: 5.161.111.190, stratum: 5, ref_time: 1734587439.5578728, correction: -0.230564266 } file = sled-agent/src/rack_setup/service.rs:743
9682024-12-19T05:50:43.685ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9692024-12-19T05:50:47.462ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:46037
9702024-12-19T05:50:47.463ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:46037 req_id = c614713a-2daf-4af8-b2b1-ebd4292bdfe1 response_code = 200 uri = /baseboard
9712024-12-19T05:50:47.497ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 16746935770677152466 reason = Duration(60s) sled_id = a9851483-adb5-4271-9f27-41db71133b55
9722024-12-19T05:50:47.497ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 18074085491604458815 reason = Duration(60s) sled_id = a9851483-adb5-4271-9f27-41db71133b55
9732024-12-19T05:50:50.774ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 2.585034016s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = a9851483-adb5-4271-9f27-41db71133b55
9742024-12-19T05:50:51.723ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5534721212470721226 sled_id = a9851483-adb5-4271-9f27-41db71133b55
9752024-12-19T05:50:51.723ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7823616040735775052 sled_id = a9851483-adb5-4271-9f27-41db71133b55
9762024-12-19T05:51:00.526ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9772024-12-19T05:51:00.526ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40432
9782024-12-19T05:51:00.535ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8728 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:40432 req_id = f0f07a42-7891-4955-b828-2f920672bddc response_code = 200 uri = /timesync
9792024-12-19T05:51:00.538ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 94465982, ip_addr: 5.161.111.190, stratum: 5, ref_time: 1734587455.383249, correction: -0.184704021 } file = sled-agent/src/rack_setup/service.rs:743
9802024-12-19T05:51:00.538ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9812024-12-19T05:51:01.698ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5534721212470721226 sled_id = a9851483-adb5-4271-9f27-41db71133b55
9822024-12-19T05:51:01.699ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7823616040735775052 sled_id = a9851483-adb5-4271-9f27-41db71133b55
9832024-12-19T05:51:08.346ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 10.345854959s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = a9851483-adb5-4271-9f27-41db71133b55
9842024-12-19T05:51:11.673ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5534721212470721226 sled_id = a9851483-adb5-4271-9f27-41db71133b55
9852024-12-19T05:51:11.674ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7823616040735775052 sled_id = a9851483-adb5-4271-9f27-41db71133b55
9862024-12-19T05:51:17.413ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49386
9872024-12-19T05:51:17.413ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49386 req_id = 35419485-5f31-440e-918d-d3c52ad8f3ee response_code = 200 uri = /baseboard
9882024-12-19T05:51:21.648ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5534721212470721226 sled_id = a9851483-adb5-4271-9f27-41db71133b55
9892024-12-19T05:51:21.648ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7823616040735775052 sled_id = a9851483-adb5-4271-9f27-41db71133b55
9902024-12-19T05:51:23.848ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9912024-12-19T05:51:23.848ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39385
9922024-12-19T05:51:23.857ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9056 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39385 req_id = 9b19c20f-bc04-424e-a1c3-cbbdb0666a74 response_code = 200 uri = /timesync
9932024-12-19T05:51:23.860ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 3330918944, ip_addr: 198.137.202.32, stratum: 3, ref_time: 1734587480.92695, correction: -0.119453952 } file = sled-agent/src/rack_setup/service.rs:743
9942024-12-19T05:51:23.860ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9952024-12-19T05:51:31.622ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5534721212470721226 sled_id = a9851483-adb5-4271-9f27-41db71133b55
9962024-12-19T05:51:31.622ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7823616040735775052 sled_id = a9851483-adb5-4271-9f27-41db71133b55
9972024-12-19T05:51:33.658ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 8.94656378s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = a9851483-adb5-4271-9f27-41db71133b55
9982024-12-19T05:51:41.598ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5534721212470721226 sled_id = a9851483-adb5-4271-9f27-41db71133b55
9992024-12-19T05:51:41.598ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7823616040735775052 sled_id = a9851483-adb5-4271-9f27-41db71133b55
10002024-12-19T05:51:47.364ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:55077
10012024-12-19T05:51:47.364ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:55077 req_id = 2b01ea2c-4ee7-40dc-ba73-b53ec66e2b15 response_code = 200 uri = /baseboard
10022024-12-19T05:51:48.426ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
10032024-12-19T05:51:48.426ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35292
10042024-12-19T05:51:48.435ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8741 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:35292 req_id = 821a81f5-691f-45f7-939e-5c4a0206f077 response_code = 200 uri = /timesync
10052024-12-19T05:51:48.438ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 3330918944, ip_addr: 198.137.202.32, stratum: 3, ref_time: 1734587504.9125383, correction: -0.052693855 } file = sled-agent/src/rack_setup/service.rs:743
10062024-12-19T05:51:48.438ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
10072024-12-19T05:51:51.573ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5534721212470721226 sled_id = a9851483-adb5-4271-9f27-41db71133b55
10082024-12-19T05:51:51.573ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7823616040735775052 sled_id = a9851483-adb5-4271-9f27-41db71133b55
10092024-12-19T05:51:57.575ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 22.267868651s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = a9851483-adb5-4271-9f27-41db71133b55
10102024-12-19T05:52:01.547ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5534721212470721226 sled_id = a9851483-adb5-4271-9f27-41db71133b55
10112024-12-19T05:52:01.547ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7823616040735775052 sled_id = a9851483-adb5-4271-9f27-41db71133b55
10122024-12-19T05:52:11.531ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5534721212470721226 sled_id = a9851483-adb5-4271-9f27-41db71133b55
10132024-12-19T05:52:11.531ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7823616040735775052 sled_id = a9851483-adb5-4271-9f27-41db71133b55
10142024-12-19T05:52:12.354ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
10152024-12-19T05:52:12.354ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33097
10162024-12-19T05:52:12.376ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 21766 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:33097 req_id = 57b3bf28-6610-43a6-8cd0-03849d1ba3a3 response_code = 200 uri = /timesync
10172024-12-19T05:52:12.376ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-12-19T05:50:35.837792833Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 7218971715660750967 sled_id = a9851483-adb5-4271-9f27-41db71133b55
10182024-12-19T05:52:12.378ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-12-19T05:50:37.183214435Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 3676573883658449401 sled_id = a9851483-adb5-4271-9f27-41db71133b55
10192024-12-19T05:52:12.378ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-12-19T05:50:17.724541277Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 8721346749480555036 sled_id = a9851483-adb5-4271-9f27-41db71133b55
10202024-12-19T05:52:12.378ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-12-19T05:50:47.497584218Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 18074085491604458815 sled_id = a9851483-adb5-4271-9f27-41db71133b55
10212024-12-19T05:52:12.378ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-12-19T05:50:47.497265177Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 16746935770677152466 sled_id = a9851483-adb5-4271-9f27-41db71133b55
10222024-12-19T05:52:12.379ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-12-19T05:50:17.725155857Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 5756148205014167459 sled_id = a9851483-adb5-4271-9f27-41db71133b55
10232024-12-19T05:52:12.379ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-12-19T05:50:36.621169069Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 3446670803788481298 sled_id = a9851483-adb5-4271-9f27-41db71133b55
10242024-12-19T05:52:12.380ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 3330918944, ip_addr: 198.137.202.32, stratum: 3, ref_time: 1734587524.5569327, correction: 1e-8 } file = sled-agent/src/rack_setup/service.rs:743
10252024-12-19T05:52:12.380ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1392
10262024-12-19T05:52:12.410ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 32bd82c5-9132-4cc5-bc52-bbcbaeb63c0a (service), filesystem_pool: Some(ZpoolName { id: f1c83160-c846-4e0a-a537-6a326722ac5a (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f1c83160-c846-4e0a-a537-6a326722ac5a (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: f28b01fa-a622-4300-b098-26693361bed2 (service), filesystem_pool: Some(ZpoolName { id: 436ef9e1-c612-46c3-866b-9e48c044fdf2 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 436ef9e1-c612-46c3-866b-9e48c044fdf2 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: ecedc0eb-6c7d-4958-9fee-747c67187e55 (service), filesystem_pool: Some(ZpoolName { id: defcb6a1-2bbe-47a6-a426-436ed60fd6fc (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: defcb6a1-2bbe-47a6-a426-436ed60fd6fc (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: b10d7d14-e913-49db-8411-992e06a1f1e2 (service), filesystem_pool: Some(ZpoolName { id: defcb6a1-2bbe-47a6-a426-436ed60fd6fc (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 6a759d48-5f75-4601-8164-346068267cb2, kind: Service { id: b10d7d14-e913-49db-8411-992e06a1f1e2 }, name: Name("ntp-b10d7d14-e913-49db-8411-992e06a1f1e2"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 40])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: e31fad89-c82a-4b5e-8dad-c806db878c58 (service), filesystem_pool: Some(ZpoolName { id: f1c83160-c846-4e0a-a537-6a326722ac5a (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f1c83160-c846-4e0a-a537-6a326722ac5a (zpool), kind: External } } } }, OmicronZoneConfig { id: a059e970-dce9-484b-9af7-85f00f24e142 (service), filesystem_pool: Some(ZpoolName { id: 436ef9e1-c612-46c3-866b-9e48c044fdf2 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 436ef9e1-c612-46c3-866b-9e48c044fdf2 (zpool), kind: External } } } }, OmicronZoneConfig { id: 33158fa9-57db-43e4-a282-d8c6f236773d (service), filesystem_pool: Some(ZpoolName { id: defcb6a1-2bbe-47a6-a426-436ed60fd6fc (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: defcb6a1-2bbe-47a6-a426-436ed60fd6fc (zpool), kind: External } } } }, OmicronZoneConfig { id: 1b5a99e2-3552-4a7c-bf7a-59d1fd251d45 (service), filesystem_pool: Some(ZpoolName { id: a0552d97-e3e6-4586-a789-e6bcdec66672 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a0552d97-e3e6-4586-a789-e6bcdec66672 (zpool), kind: External } } } }, OmicronZoneConfig { id: a70a1db1-4ed4-460d-a7ae-0e54347df152 (service), filesystem_pool: Some(ZpoolName { id: 0cdd8476-a0d8-44ca-a74b-0704c56ede98 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 0cdd8476-a0d8-44ca-a74b-0704c56ede98 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
10272024-12-19T05:52:12.410ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42978
10282024-12-19T05:52:12.410ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 32bd82c5-9132-4cc5-bc52-bbcbaeb63c0a, dataset_name: DatasetName { pool_name: ZpoolName { id: f1c83160-c846-4e0a-a537-6a326722ac5a (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
10292024-12-19T05:52:12.410ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 32bd82c5-9132-4cc5-bc52-bbcbaeb63c0a, dataset_name: DatasetName { pool_name: ZpoolName { id: f1c83160-c846-4e0a-a537-6a326722ac5a (zpool), kind: External }, kind: InternalDns }, responder: ... }
10302024-12-19T05:52:12.449ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: f28b01fa-a622-4300-b098-26693361bed2, dataset_name: DatasetName { pool_name: ZpoolName { id: 436ef9e1-c612-46c3-866b-9e48c044fdf2 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
10312024-12-19T05:52:12.449ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: f28b01fa-a622-4300-b098-26693361bed2, dataset_name: DatasetName { pool_name: ZpoolName { id: 436ef9e1-c612-46c3-866b-9e48c044fdf2 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10322024-12-19T05:52:12.484ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: ecedc0eb-6c7d-4958-9fee-747c67187e55, dataset_name: DatasetName { pool_name: ZpoolName { id: defcb6a1-2bbe-47a6-a426-436ed60fd6fc (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
10332024-12-19T05:52:12.484ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: ecedc0eb-6c7d-4958-9fee-747c67187e55, dataset_name: DatasetName { pool_name: ZpoolName { id: defcb6a1-2bbe-47a6-a426-436ed60fd6fc (zpool), kind: External }, kind: InternalDns }, responder: ... }
10342024-12-19T05:52:12.517ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: e31fad89-c82a-4b5e-8dad-c806db878c58, dataset_name: DatasetName { pool_name: ZpoolName { id: f1c83160-c846-4e0a-a537-6a326722ac5a (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10352024-12-19T05:52:12.518ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: e31fad89-c82a-4b5e-8dad-c806db878c58, dataset_name: DatasetName { pool_name: ZpoolName { id: f1c83160-c846-4e0a-a537-6a326722ac5a (zpool), kind: External }, kind: Cockroach }, responder: ... }
10362024-12-19T05:52:12.551ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: a059e970-dce9-484b-9af7-85f00f24e142, dataset_name: DatasetName { pool_name: ZpoolName { id: 436ef9e1-c612-46c3-866b-9e48c044fdf2 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10372024-12-19T05:52:12.551ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: a059e970-dce9-484b-9af7-85f00f24e142, dataset_name: DatasetName { pool_name: ZpoolName { id: 436ef9e1-c612-46c3-866b-9e48c044fdf2 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10382024-12-19T05:52:12.586ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 33158fa9-57db-43e4-a282-d8c6f236773d, dataset_name: DatasetName { pool_name: ZpoolName { id: defcb6a1-2bbe-47a6-a426-436ed60fd6fc (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10392024-12-19T05:52:12.586ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 33158fa9-57db-43e4-a282-d8c6f236773d, dataset_name: DatasetName { pool_name: ZpoolName { id: defcb6a1-2bbe-47a6-a426-436ed60fd6fc (zpool), kind: External }, kind: Cockroach }, responder: ... }
10402024-12-19T05:52:12.620ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 1b5a99e2-3552-4a7c-bf7a-59d1fd251d45, dataset_name: DatasetName { pool_name: ZpoolName { id: a0552d97-e3e6-4586-a789-e6bcdec66672 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10412024-12-19T05:52:12.621ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 1b5a99e2-3552-4a7c-bf7a-59d1fd251d45, dataset_name: DatasetName { pool_name: ZpoolName { id: a0552d97-e3e6-4586-a789-e6bcdec66672 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10422024-12-19T05:52:12.656ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: a70a1db1-4ed4-460d-a7ae-0e54347df152, dataset_name: DatasetName { pool_name: ZpoolName { id: 0cdd8476-a0d8-44ca-a74b-0704c56ede98 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10432024-12-19T05:52:12.656ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: a70a1db1-4ed4-460d-a7ae-0e54347df152, dataset_name: DatasetName { pool_name: ZpoolName { id: 0cdd8476-a0d8-44ca-a74b-0704c56ede98 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10442024-12-19T05:52:12.694ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10452024-12-19T05:52:12.694ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/e0de026f-6896-43b8-9686-b840d0967c1e/config/omicron-zones.json file = common/src/ledger.rs:177
10462024-12-19T05:52:12.695ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/d2802dae-55e1-4039-8308-ca231b2dc40c/config/omicron-zones.json file = common/src/ledger.rs:177
10472024-12-19T05:52:12.695ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10482024-12-19T05:52:12.776ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10492024-12-19T05:52:12.777ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10502024-12-19T05:52:12.777ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10512024-12-19T05:52:12.777ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10522024-12-19T05:52:12.777ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10532024-12-19T05:52:12.869ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_a059e970-dce9-484b-9af7-85f00f24e142 file = illumos-utils/src/zone.rs:325
10542024-12-19T05:52:12.873ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_1b5a99e2-3552-4a7c-bf7a-59d1fd251d45 file = illumos-utils/src/zone.rs:325
10552024-12-19T05:52:12.877ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_e31fad89-c82a-4b5e-8dad-c806db878c58 file = illumos-utils/src/zone.rs:325
10562024-12-19T05:52:12.881ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_a70a1db1-4ed4-460d-a7ae-0e54347df152 file = illumos-utils/src/zone.rs:325
10572024-12-19T05:52:12.885ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_33158fa9-57db-43e4-a282-d8c6f236773d file = illumos-utils/src/zone.rs:325
10582024-12-19T05:52:12.890ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_a059e970-dce9-484b-9af7-85f00f24e142 file = illumos-utils/src/zone.rs:363
10592024-12-19T05:52:12.895ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_1b5a99e2-3552-4a7c-bf7a-59d1fd251d45 file = illumos-utils/src/zone.rs:363
10602024-12-19T05:52:12.899ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_e31fad89-c82a-4b5e-8dad-c806db878c58 file = illumos-utils/src/zone.rs:363
10612024-12-19T05:52:12.903ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_a70a1db1-4ed4-460d-a7ae-0e54347df152 file = illumos-utils/src/zone.rs:363
10622024-12-19T05:52:12.907ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_33158fa9-57db-43e4-a282-d8c6f236773d file = illumos-utils/src/zone.rs:363
10632024-12-19T05:52:15.739ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_a059e970-dce9-484b-9af7-85f00f24e142: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='a059e970-dce9-484b-9af7-85f00f24e142'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10642024-12-19T05:52:15.739ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_a059e970-dce9-484b-9af7-85f00f24e142 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_a059e970-dce9-484b-9af7-85f00f24e142
10652024-12-19T05:52:15.792ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_33158fa9-57db-43e4-a282-d8c6f236773d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='33158fa9-57db-43e4-a282-d8c6f236773d'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10662024-12-19T05:52:15.792ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_33158fa9-57db-43e4-a282-d8c6f236773d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_33158fa9-57db-43e4-a282-d8c6f236773d
10672024-12-19T05:52:15.857ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_1b5a99e2-3552-4a7c-bf7a-59d1fd251d45: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='1b5a99e2-3552-4a7c-bf7a-59d1fd251d45'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10682024-12-19T05:52:15.857ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_a70a1db1-4ed4-460d-a7ae-0e54347df152: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='a70a1db1-4ed4-460d-a7ae-0e54347df152'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10692024-12-19T05:52:15.857ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_1b5a99e2-3552-4a7c-bf7a-59d1fd251d45 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_1b5a99e2-3552-4a7c-bf7a-59d1fd251d45
10702024-12-19T05:52:15.862ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_a70a1db1-4ed4-460d-a7ae-0e54347df152 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_a70a1db1-4ed4-460d-a7ae-0e54347df152
10712024-12-19T05:52:15.867ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_e31fad89-c82a-4b5e-8dad-c806db878c58: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='e31fad89-c82a-4b5e-8dad-c806db878c58'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10722024-12-19T05:52:15.867ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_e31fad89-c82a-4b5e-8dad-c806db878c58 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_e31fad89-c82a-4b5e-8dad-c806db878c58
10732024-12-19T05:52:15.880ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a059e970-dce9-484b-9af7-85f00f24e142") failed: Property not found. retry in 25.944214ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a059e970-dce9-484b-9af7-85f00f24e142
10742024-12-19T05:52:15.915ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a059e970-dce9-484b-9af7-85f00f24e142") failed: Property not found. retry in 117.514298ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a059e970-dce9-484b-9af7-85f00f24e142
10752024-12-19T05:52:15.938ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_33158fa9-57db-43e4-a282-d8c6f236773d") failed: Property not found. retry in 63.68238ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_33158fa9-57db-43e4-a282-d8c6f236773d
10762024-12-19T05:52:16.031ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_33158fa9-57db-43e4-a282-d8c6f236773d") failed: Property not found. retry in 73.188847ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_33158fa9-57db-43e4-a282-d8c6f236773d
10772024-12-19T05:52:16.225ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a059e970-dce9-484b-9af7-85f00f24e142") failed: Property not found. retry in 227.169944ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a059e970-dce9-484b-9af7-85f00f24e142
10782024-12-19T05:52:16.248ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1b5a99e2-3552-4a7c-bf7a-59d1fd251d45") failed: Property not found. retry in 51.822987ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1b5a99e2-3552-4a7c-bf7a-59d1fd251d45
10792024-12-19T05:52:16.403ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e31fad89-c82a-4b5e-8dad-c806db878c58") failed: Property not found. retry in 28.706681ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e31fad89-c82a-4b5e-8dad-c806db878c58
10802024-12-19T05:52:16.515ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a70a1db1-4ed4-460d-a7ae-0e54347df152") failed: Property not found. retry in 31.89652ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a70a1db1-4ed4-460d-a7ae-0e54347df152
10812024-12-19T05:52:16.611ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_33158fa9-57db-43e4-a282-d8c6f236773d") failed: Property not found. retry in 241.092225ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_33158fa9-57db-43e4-a282-d8c6f236773d
10822024-12-19T05:52:16.763ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a059e970-dce9-484b-9af7-85f00f24e142") failed: Property not found. retry in 225.111413ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a059e970-dce9-484b-9af7-85f00f24e142
10832024-12-19T05:52:16.811ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1b5a99e2-3552-4a7c-bf7a-59d1fd251d45") failed: Property not found. retry in 99.198561ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1b5a99e2-3552-4a7c-bf7a-59d1fd251d45
10842024-12-19T05:52:16.845ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e31fad89-c82a-4b5e-8dad-c806db878c58") failed: Property not found. retry in 113.478717ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e31fad89-c82a-4b5e-8dad-c806db878c58
10852024-12-19T05:52:16.900ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a70a1db1-4ed4-460d-a7ae-0e54347df152") failed: Property not found. retry in 147.603265ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a70a1db1-4ed4-460d-a7ae-0e54347df152
10862024-12-19T05:52:16.962ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_33158fa9-57db-43e4-a282-d8c6f236773d") failed: Property not found. retry in 569.813117ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_33158fa9-57db-43e4-a282-d8c6f236773d
10872024-12-19T05:52:17.028ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1b5a99e2-3552-4a7c-bf7a-59d1fd251d45") failed: Property not found. retry in 205.840392ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1b5a99e2-3552-4a7c-bf7a-59d1fd251d45
10882024-12-19T05:52:17.155ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e31fad89-c82a-4b5e-8dad-c806db878c58") failed: Property not found. retry in 220.45828ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e31fad89-c82a-4b5e-8dad-c806db878c58
10892024-12-19T05:52:17.176ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a70a1db1-4ed4-460d-a7ae-0e54347df152") failed: Property not found. retry in 190.042529ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a70a1db1-4ed4-460d-a7ae-0e54347df152
10902024-12-19T05:52:17.301ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a059e970-dce9-484b-9af7-85f00f24e142") failed: Property not found. retry in 1.18586593s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a059e970-dce9-484b-9af7-85f00f24e142
10912024-12-19T05:52:17.445ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:35160
10922024-12-19T05:52:17.482ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 228 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:35160 req_id = 7c7859e0-91dd-4fb2-ba83-c90a63d91c27 response_code = 200 uri = /baseboard
10932024-12-19T05:52:17.733ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1b5a99e2-3552-4a7c-bf7a-59d1fd251d45") failed: Property not found. retry in 374.203225ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1b5a99e2-3552-4a7c-bf7a-59d1fd251d45
10942024-12-19T05:52:17.883ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e31fad89-c82a-4b5e-8dad-c806db878c58") failed: Property not found. retry in 359.954487ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e31fad89-c82a-4b5e-8dad-c806db878c58
10952024-12-19T05:52:17.982ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a70a1db1-4ed4-460d-a7ae-0e54347df152") failed: Property not found. retry in 576.866362ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a70a1db1-4ed4-460d-a7ae-0e54347df152
10962024-12-19T05:52:18.087ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_33158fa9-57db-43e4-a282-d8c6f236773d") failed: Property not found. retry in 421.490334ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_33158fa9-57db-43e4-a282-d8c6f236773d
10972024-12-19T05:52:18.135ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1b5a99e2-3552-4a7c-bf7a-59d1fd251d45") failed: Property not found. retry in 1.022773932s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1b5a99e2-3552-4a7c-bf7a-59d1fd251d45
10982024-12-19T05:52:18.257ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e31fad89-c82a-4b5e-8dad-c806db878c58") failed: Property not found. retry in 502.025912ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e31fad89-c82a-4b5e-8dad-c806db878c58
10992024-12-19T05:52:18.498ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a059e970-dce9-484b-9af7-85f00f24e142") failed: Property not found. retry in 937.817912ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a059e970-dce9-484b-9af7-85f00f24e142
11002024-12-19T05:52:18.519ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_33158fa9-57db-43e4-a282-d8c6f236773d") failed: Property not found. retry in 1.296652192s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_33158fa9-57db-43e4-a282-d8c6f236773d
11012024-12-19T05:52:18.569ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a70a1db1-4ed4-460d-a7ae-0e54347df152") failed: Property not found. retry in 872.01949ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a70a1db1-4ed4-460d-a7ae-0e54347df152
11022024-12-19T05:52:18.770ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e31fad89-c82a-4b5e-8dad-c806db878c58") failed: Property not found. retry in 1.095809343s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e31fad89-c82a-4b5e-8dad-c806db878c58
11032024-12-19T05:52:19.168ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1b5a99e2-3552-4a7c-bf7a-59d1fd251d45") failed: Property not found. retry in 1.362552275s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1b5a99e2-3552-4a7c-bf7a-59d1fd251d45
11042024-12-19T05:52:19.445ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a059e970-dce9-484b-9af7-85f00f24e142") failed: Property not found. retry in 839.31199ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a059e970-dce9-484b-9af7-85f00f24e142
11052024-12-19T05:52:19.453ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a70a1db1-4ed4-460d-a7ae-0e54347df152") failed: Property not found. retry in 1.35532108s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a70a1db1-4ed4-460d-a7ae-0e54347df152
11062024-12-19T05:52:19.858ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_33158fa9-57db-43e4-a282-d8c6f236773d") failed: Property not found. retry in 1.405389881s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_33158fa9-57db-43e4-a282-d8c6f236773d
11072024-12-19T05:52:19.874ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e31fad89-c82a-4b5e-8dad-c806db878c58") failed: Property not found. retry in 767.268988ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e31fad89-c82a-4b5e-8dad-c806db878c58
11082024-12-19T05:52:20.294ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a059e970-dce9-484b-9af7-85f00f24e142") failed: Property not found. retry in 1.45237827s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a059e970-dce9-484b-9af7-85f00f24e142
11092024-12-19T05:52:20.541ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1b5a99e2-3552-4a7c-bf7a-59d1fd251d45") failed: Property not found. retry in 880.203601ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1b5a99e2-3552-4a7c-bf7a-59d1fd251d45
11102024-12-19T05:52:20.652ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e31fad89-c82a-4b5e-8dad-c806db878c58") failed: Property not found. retry in 850.086936ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e31fad89-c82a-4b5e-8dad-c806db878c58
11112024-12-19T05:52:20.822ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a70a1db1-4ed4-460d-a7ae-0e54347df152") failed: Property not found. retry in 1.086769125s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a70a1db1-4ed4-460d-a7ae-0e54347df152
11122024-12-19T05:52:21.275ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_33158fa9-57db-43e4-a282-d8c6f236773d") failed: Property not found. retry in 1.381941864s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_33158fa9-57db-43e4-a282-d8c6f236773d
11132024-12-19T05:52:21.435ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1b5a99e2-3552-4a7c-bf7a-59d1fd251d45") failed: Property not found. retry in 1.235033173s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1b5a99e2-3552-4a7c-bf7a-59d1fd251d45
11142024-12-19T05:52:21.511ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e31fad89-c82a-4b5e-8dad-c806db878c58") failed: Property not found. retry in 813.095095ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e31fad89-c82a-4b5e-8dad-c806db878c58
11152024-12-19T05:52:21.757ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a059e970-dce9-484b-9af7-85f00f24e142") failed: Property not found. retry in 786.763531ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a059e970-dce9-484b-9af7-85f00f24e142
11162024-12-19T05:52:21.917ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a70a1db1-4ed4-460d-a7ae-0e54347df152") failed: Property not found. retry in 937.21872ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a70a1db1-4ed4-460d-a7ae-0e54347df152
11172024-12-19T05:52:22.333ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e31fad89-c82a-4b5e-8dad-c806db878c58") failed: Property not found. retry in 672.148857ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e31fad89-c82a-4b5e-8dad-c806db878c58
11182024-12-19T05:52:22.551ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a059e970-dce9-484b-9af7-85f00f24e142") failed: Property not found. retry in 785.348053ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a059e970-dce9-484b-9af7-85f00f24e142
11192024-12-19T05:52:22.666ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_33158fa9-57db-43e4-a282-d8c6f236773d") failed: Property not found. retry in 668.252472ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_33158fa9-57db-43e4-a282-d8c6f236773d
11202024-12-19T05:52:22.679ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1b5a99e2-3552-4a7c-bf7a-59d1fd251d45") failed: Property not found. retry in 683.422524ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1b5a99e2-3552-4a7c-bf7a-59d1fd251d45
11212024-12-19T05:52:22.863ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a70a1db1-4ed4-460d-a7ae-0e54347df152") failed: Property not found. retry in 950.108953ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a70a1db1-4ed4-460d-a7ae-0e54347df152
11222024-12-19T05:52:23.016ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e31fad89-c82a-4b5e-8dad-c806db878c58") failed: Property not found. retry in 1.364963752s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e31fad89-c82a-4b5e-8dad-c806db878c58
11232024-12-19T05:52:23.344ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_33158fa9-57db-43e4-a282-d8c6f236773d") failed: Property not found. retry in 1.102956642s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_33158fa9-57db-43e4-a282-d8c6f236773d
11242024-12-19T05:52:23.352ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a059e970-dce9-484b-9af7-85f00f24e142") failed: Property not found. retry in 1.392767017s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a059e970-dce9-484b-9af7-85f00f24e142
11252024-12-19T05:52:23.372ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1b5a99e2-3552-4a7c-bf7a-59d1fd251d45") failed: Property not found. retry in 1.259937744s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1b5a99e2-3552-4a7c-bf7a-59d1fd251d45
11262024-12-19T05:52:23.823ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a70a1db1-4ed4-460d-a7ae-0e54347df152") failed: Property not found. retry in 519.400969ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a70a1db1-4ed4-460d-a7ae-0e54347df152
11272024-12-19T05:52:24.353ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a70a1db1-4ed4-460d-a7ae-0e54347df152") failed: Property not found. retry in 1.391466101s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a70a1db1-4ed4-460d-a7ae-0e54347df152
11282024-12-19T05:52:24.457ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_33158fa9-57db-43e4-a282-d8c6f236773d") failed: Property not found. retry in 1.194676881s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_33158fa9-57db-43e4-a282-d8c6f236773d
11292024-12-19T05:52:24.754ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a059e970-dce9-484b-9af7-85f00f24e142") failed: Property not found. retry in 724.864787ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a059e970-dce9-484b-9af7-85f00f24e142
11302024-12-19T05:52:25.489ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a059e970-dce9-484b-9af7-85f00f24e142") failed: Property not found. retry in 1.23639558s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a059e970-dce9-484b-9af7-85f00f24e142
11312024-12-19T05:52:25.661ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_33158fa9-57db-43e4-a282-d8c6f236773d") failed: Property not found. retry in 1.253727696s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_33158fa9-57db-43e4-a282-d8c6f236773d
11322024-12-19T05:52:26.738ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a059e970-dce9-484b-9af7-85f00f24e142") failed: Property not found. retry in 1.236458308s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a059e970-dce9-484b-9af7-85f00f24e142
11332024-12-19T05:52:26.927ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_33158fa9-57db-43e4-a282-d8c6f236773d") failed: Property not found. retry in 1.188177271s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_33158fa9-57db-43e4-a282-d8c6f236773d
11342024-12-19T05:52:28.538ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a059e970-dce9-484b-9af7-85f00f24e142") failed: Property not found. retry in 1.012324209s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a059e970-dce9-484b-9af7-85f00f24e142
11352024-12-19T05:52:28.553ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_33158fa9-57db-43e4-a282-d8c6f236773d") failed: Property not found. retry in 882.676747ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_33158fa9-57db-43e4-a282-d8c6f236773d
11362024-12-19T05:52:29.448ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_33158fa9-57db-43e4-a282-d8c6f236773d") failed: Property not found. retry in 925.1809ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_33158fa9-57db-43e4-a282-d8c6f236773d
11372024-12-19T05:52:29.561ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a059e970-dce9-484b-9af7-85f00f24e142") failed: Property not found. retry in 566.525767ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a059e970-dce9-484b-9af7-85f00f24e142
11382024-12-19T05:52:30.142ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a059e970-dce9-484b-9af7-85f00f24e142") failed: Property not found. retry in 1.118683189s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a059e970-dce9-484b-9af7-85f00f24e142
11392024-12-19T05:52:30.383ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_33158fa9-57db-43e4-a282-d8c6f236773d") failed: Property not found. retry in 835.73696ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_33158fa9-57db-43e4-a282-d8c6f236773d
11402024-12-19T05:52:31.228ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_33158fa9-57db-43e4-a282-d8c6f236773d") failed: Property not found. retry in 586.788996ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_33158fa9-57db-43e4-a282-d8c6f236773d
11412024-12-19T05:52:31.270ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a059e970-dce9-484b-9af7-85f00f24e142") failed: Property not found. retry in 1.100086133s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a059e970-dce9-484b-9af7-85f00f24e142
11422024-12-19T05:52:31.824ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_33158fa9-57db-43e4-a282-d8c6f236773d") failed: Property not found. retry in 1.402014897s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_33158fa9-57db-43e4-a282-d8c6f236773d
11432024-12-19T05:52:32.379ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a059e970-dce9-484b-9af7-85f00f24e142") failed: Property not found. retry in 1.199058921s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a059e970-dce9-484b-9af7-85f00f24e142
11442024-12-19T05:52:33.235ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_33158fa9-57db-43e4-a282-d8c6f236773d") failed: Property not found. retry in 663.43267ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_33158fa9-57db-43e4-a282-d8c6f236773d
11452024-12-19T05:52:33.588ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a059e970-dce9-484b-9af7-85f00f24e142") failed: Property not found. retry in 1.419177779s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a059e970-dce9-484b-9af7-85f00f24e142
11462024-12-19T05:52:33.908ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_33158fa9-57db-43e4-a282-d8c6f236773d") failed: Property not found. retry in 564.537574ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_33158fa9-57db-43e4-a282-d8c6f236773d
11472024-12-19T05:52:34.854ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 33.10052566s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = a9851483-adb5-4271-9f27-41db71133b55
11482024-12-19T05:52:35.029ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_a059e970-dce9-484b-9af7-85f00f24e142
11492024-12-19T05:52:35.029ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_1b5a99e2-3552-4a7c-bf7a-59d1fd251d45
11502024-12-19T05:52:35.029ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_e31fad89-c82a-4b5e-8dad-c806db878c58
11512024-12-19T05:52:35.029ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_a70a1db1-4ed4-460d-a7ae-0e54347df152
11522024-12-19T05:52:35.029ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_33158fa9-57db-43e4-a282-d8c6f236773d
11532024-12-19T05:52:35.029ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/e0de026f-6896-43b8-9686-b840d0967c1e/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
11542024-12-19T05:52:35.030ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/d2802dae-55e1-4039-8308-ca231b2dc40c/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
11552024-12-19T05:52:35.031ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 22619998 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:42978 req_id = 1d8c9303-e839-4d1c-b752-058ebbc4b61a response_code = 204 uri = /omicron-zones
11562024-12-19T05:52:35.065ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57549
11572024-12-19T05:52:35.093ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::6]:32221 file = sled-agent/src/services.rs:3743
11582024-12-19T05:52:35.262ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3761
11592024-12-19T05:52:40.522ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3784
11602024-12-19T05:52:40.522ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5457036 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:57549 req_id = 25d582d8-e74a-43db-be4f-c2746770c637 response_code = 204 uri = /cockroachdb
11612024-12-19T05:52:40.569ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: 32bd82c5-9132-4cc5-bc52-bbcbaeb63c0a (service), filesystem_pool: Some(ZpoolName { id: f1c83160-c846-4e0a-a537-6a326722ac5a (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f1c83160-c846-4e0a-a537-6a326722ac5a (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: f28b01fa-a622-4300-b098-26693361bed2 (service), filesystem_pool: Some(ZpoolName { id: 436ef9e1-c612-46c3-866b-9e48c044fdf2 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 436ef9e1-c612-46c3-866b-9e48c044fdf2 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: ecedc0eb-6c7d-4958-9fee-747c67187e55 (service), filesystem_pool: Some(ZpoolName { id: defcb6a1-2bbe-47a6-a426-436ed60fd6fc (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: defcb6a1-2bbe-47a6-a426-436ed60fd6fc (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: b10d7d14-e913-49db-8411-992e06a1f1e2 (service), filesystem_pool: Some(ZpoolName { id: defcb6a1-2bbe-47a6-a426-436ed60fd6fc (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 6a759d48-5f75-4601-8164-346068267cb2, kind: Service { id: b10d7d14-e913-49db-8411-992e06a1f1e2 }, name: Name("ntp-b10d7d14-e913-49db-8411-992e06a1f1e2"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 40])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: e31fad89-c82a-4b5e-8dad-c806db878c58 (service), filesystem_pool: Some(ZpoolName { id: f1c83160-c846-4e0a-a537-6a326722ac5a (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f1c83160-c846-4e0a-a537-6a326722ac5a (zpool), kind: External } } } }, OmicronZoneConfig { id: a059e970-dce9-484b-9af7-85f00f24e142 (service), filesystem_pool: Some(ZpoolName { id: 436ef9e1-c612-46c3-866b-9e48c044fdf2 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 436ef9e1-c612-46c3-866b-9e48c044fdf2 (zpool), kind: External } } } }, OmicronZoneConfig { id: 33158fa9-57db-43e4-a282-d8c6f236773d (service), filesystem_pool: Some(ZpoolName { id: defcb6a1-2bbe-47a6-a426-436ed60fd6fc (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: defcb6a1-2bbe-47a6-a426-436ed60fd6fc (zpool), kind: External } } } }, OmicronZoneConfig { id: 1b5a99e2-3552-4a7c-bf7a-59d1fd251d45 (service), filesystem_pool: Some(ZpoolName { id: a0552d97-e3e6-4586-a789-e6bcdec66672 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a0552d97-e3e6-4586-a789-e6bcdec66672 (zpool), kind: External } } } }, OmicronZoneConfig { id: a70a1db1-4ed4-460d-a7ae-0e54347df152 (service), filesystem_pool: Some(ZpoolName { id: 0cdd8476-a0d8-44ca-a74b-0704c56ede98 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 0cdd8476-a0d8-44ca-a74b-0704c56ede98 (zpool), kind: External } } } }, OmicronZoneConfig { id: bb4845ab-0600-4d61-a9f2-eb93a7cc0896 (service), filesystem_pool: Some(ZpoolName { id: f1c83160-c846-4e0a-a537-6a326722ac5a (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f1c83160-c846-4e0a-a537-6a326722ac5a (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.1.164:53, nic: NetworkInterface { id: 9edfb32a-e2bb-4e56-b9b4-ce860f893b5e, kind: Service { id: bb4845ab-0600-4d61-a9f2-eb93a7cc0896 }, name: Name("external-dns-bb4845ab-0600-4d61-a9f2-eb93a7cc0896"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 241])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 75a56219-191b-4e5c-8eb1-d0e62e0c42f9 (service), filesystem_pool: Some(ZpoolName { id: 436ef9e1-c612-46c3-866b-9e48c044fdf2 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 436ef9e1-c612-46c3-866b-9e48c044fdf2 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.1.165:53, nic: NetworkInterface { id: 9a77c36e-7345-430e-9e83-8c3363325e9b, kind: Service { id: 75a56219-191b-4e5c-8eb1-d0e62e0c42f9 }, name: Name("external-dns-75a56219-191b-4e5c-8eb1-d0e62e0c42f9"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 10])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: c32c373d-ccc1-45e0-bb27-49a4415e7fca (service), filesystem_pool: Some(ZpoolName { id: f1c83160-c846-4e0a-a537-6a326722ac5a (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.1.166, nic: NetworkInterface { id: 37828052-0f7a-4cca-a068-121a8b67e439, kind: Service { id: c32c373d-ccc1-45e0-bb27-49a4415e7fca }, name: Name("nexus-c32c373d-ccc1-45e0-bb27-49a4415e7fca"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 144, 193])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 1e0292d6-c327-472e-85e6-622aab78d10f (service), filesystem_pool: Some(ZpoolName { id: 436ef9e1-c612-46c3-866b-9e48c044fdf2 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.1.167, nic: NetworkInterface { id: a59ef66c-a1c5-4c9a-a337-f2d47efa332a, kind: Service { id: 1e0292d6-c327-472e-85e6-622aab78d10f }, name: Name("nexus-1e0292d6-c327-472e-85e6-622aab78d10f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 168, 229])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 1b05e3ee-34fc-4615-91df-a477e1a37258 (service), filesystem_pool: Some(ZpoolName { id: b5578c06-5ed8-4225-9470-d661174b141e (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.1.168, nic: NetworkInterface { id: 24da1f38-f5d2-4b50-a6f0-27b3479e0f93, kind: Service { id: 1b05e3ee-34fc-4615-91df-a477e1a37258 }, name: Name("nexus-1b05e3ee-34fc-4615-91df-a477e1a37258"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 52])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: bf630637-78f3-4e20-a86d-c4f19712ebb4 (service), filesystem_pool: Some(ZpoolName { id: 0686bda3-5eb8-4859-ac7b-e5a6ceb8616d (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: f6dcc1d5-458d-4c06-aac2-ae852ccaf5f0 (service), filesystem_pool: Some(ZpoolName { id: f1c83160-c846-4e0a-a537-6a326722ac5a (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f1c83160-c846-4e0a-a537-6a326722ac5a (zpool), kind: External } } } }, OmicronZoneConfig { id: 5aa1584b-558f-482f-872a-fff1fa879759 (service), filesystem_pool: Some(ZpoolName { id: 1fd2ac0f-93a9-44e1-a6b3-7ccfcdc6b252 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: 94497aa9-1336-4df1-af83-5ca2d4a43909 (service), filesystem_pool: Some(ZpoolName { id: 436ef9e1-c612-46c3-866b-9e48c044fdf2 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: 7701880a-5341-4c52-93af-e0d5f29a4650 (service), filesystem_pool: Some(ZpoolName { id: c12c68d5-6ddb-4829-80b0-49f80baef150 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: 58ae657f-f744-4b0b-a838-01074a6743ed (service), filesystem_pool: Some(ZpoolName { id: f1c83160-c846-4e0a-a537-6a326722ac5a (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f1c83160-c846-4e0a-a537-6a326722ac5a (zpool), kind: External } } } }, OmicronZoneConfig { id: e6d0c6fc-9f27-4b59-8b64-52d8f20ddfd9 (service), filesystem_pool: Some(ZpoolName { id: 436ef9e1-c612-46c3-866b-9e48c044fdf2 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 436ef9e1-c612-46c3-866b-9e48c044fdf2 (zpool), kind: External } } } }, OmicronZoneConfig { id: 503e10f4-0146-46a7-bcc4-a71beb2225b2 (service), filesystem_pool: Some(ZpoolName { id: defcb6a1-2bbe-47a6-a426-436ed60fd6fc (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: defcb6a1-2bbe-47a6-a426-436ed60fd6fc (zpool), kind: External } } } }, OmicronZoneConfig { id: f534ccb4-1884-4b0c-b250-92aa7d3370a6 (service), filesystem_pool: Some(ZpoolName { id: a0552d97-e3e6-4586-a789-e6bcdec66672 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a0552d97-e3e6-4586-a789-e6bcdec66672 (zpool), kind: External } } } }, OmicronZoneConfig { id: e027a9c4-2388-40aa-8459-5f776f88554d (service), filesystem_pool: Some(ZpoolName { id: 0cdd8476-a0d8-44ca-a74b-0704c56ede98 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 0cdd8476-a0d8-44ca-a74b-0704c56ede98 (zpool), kind: External } } } }, OmicronZoneConfig { id: fa00fdf3-10e6-4350-898d-2ec64b75259e (service), filesystem_pool: Some(ZpoolName { id: 0686bda3-5eb8-4859-ac7b-e5a6ceb8616d (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 0686bda3-5eb8-4859-ac7b-e5a6ceb8616d (zpool), kind: External } } } }, OmicronZoneConfig { id: 831f544f-98b3-466d-855d-ee48ae395f0b (service), filesystem_pool: Some(ZpoolName { id: 1fd2ac0f-93a9-44e1-a6b3-7ccfcdc6b252 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1fd2ac0f-93a9-44e1-a6b3-7ccfcdc6b252 (zpool), kind: External } } } }, OmicronZoneConfig { id: 6ae04bea-989b-4227-a44b-60ac3e1e9aa6 (service), filesystem_pool: Some(ZpoolName { id: b5578c06-5ed8-4225-9470-d661174b141e (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b5578c06-5ed8-4225-9470-d661174b141e (zpool), kind: External } } } }, OmicronZoneConfig { id: 4a60288a-de85-4cc2-97ae-0e9800cf70c5 (service), filesystem_pool: Some(ZpoolName { id: c12c68d5-6ddb-4829-80b0-49f80baef150 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c12c68d5-6ddb-4829-80b0-49f80baef150 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
11622024-12-19T05:52:40.570ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55778
11632024-12-19T05:52:40.570ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 32bd82c5-9132-4cc5-bc52-bbcbaeb63c0a, dataset_name: DatasetName { pool_name: ZpoolName { id: f1c83160-c846-4e0a-a537-6a326722ac5a (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
11642024-12-19T05:52:40.570ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 32bd82c5-9132-4cc5-bc52-bbcbaeb63c0a, dataset_name: DatasetName { pool_name: ZpoolName { id: f1c83160-c846-4e0a-a537-6a326722ac5a (zpool), kind: External }, kind: InternalDns }, responder: ... }
11652024-12-19T05:52:40.629ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: f28b01fa-a622-4300-b098-26693361bed2, dataset_name: DatasetName { pool_name: ZpoolName { id: 436ef9e1-c612-46c3-866b-9e48c044fdf2 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
11662024-12-19T05:52:40.629ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: f28b01fa-a622-4300-b098-26693361bed2, dataset_name: DatasetName { pool_name: ZpoolName { id: 436ef9e1-c612-46c3-866b-9e48c044fdf2 (zpool), kind: External }, kind: InternalDns }, responder: ... }
11672024-12-19T05:52:40.690ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: ecedc0eb-6c7d-4958-9fee-747c67187e55, dataset_name: DatasetName { pool_name: ZpoolName { id: defcb6a1-2bbe-47a6-a426-436ed60fd6fc (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
11682024-12-19T05:52:40.691ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: ecedc0eb-6c7d-4958-9fee-747c67187e55, dataset_name: DatasetName { pool_name: ZpoolName { id: defcb6a1-2bbe-47a6-a426-436ed60fd6fc (zpool), kind: External }, kind: InternalDns }, responder: ... }
11692024-12-19T05:52:40.753ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: e31fad89-c82a-4b5e-8dad-c806db878c58, dataset_name: DatasetName { pool_name: ZpoolName { id: f1c83160-c846-4e0a-a537-6a326722ac5a (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
11702024-12-19T05:52:40.753ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: e31fad89-c82a-4b5e-8dad-c806db878c58, dataset_name: DatasetName { pool_name: ZpoolName { id: f1c83160-c846-4e0a-a537-6a326722ac5a (zpool), kind: External }, kind: Cockroach }, responder: ... }
11712024-12-19T05:52:40.811ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: a059e970-dce9-484b-9af7-85f00f24e142, dataset_name: DatasetName { pool_name: ZpoolName { id: 436ef9e1-c612-46c3-866b-9e48c044fdf2 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
11722024-12-19T05:52:40.811ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: a059e970-dce9-484b-9af7-85f00f24e142, dataset_name: DatasetName { pool_name: ZpoolName { id: 436ef9e1-c612-46c3-866b-9e48c044fdf2 (zpool), kind: External }, kind: Cockroach }, responder: ... }
11732024-12-19T05:52:40.868ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 33158fa9-57db-43e4-a282-d8c6f236773d, dataset_name: DatasetName { pool_name: ZpoolName { id: defcb6a1-2bbe-47a6-a426-436ed60fd6fc (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
11742024-12-19T05:52:40.868ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 33158fa9-57db-43e4-a282-d8c6f236773d, dataset_name: DatasetName { pool_name: ZpoolName { id: defcb6a1-2bbe-47a6-a426-436ed60fd6fc (zpool), kind: External }, kind: Cockroach }, responder: ... }
11752024-12-19T05:52:40.922ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 1b5a99e2-3552-4a7c-bf7a-59d1fd251d45, dataset_name: DatasetName { pool_name: ZpoolName { id: a0552d97-e3e6-4586-a789-e6bcdec66672 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
11762024-12-19T05:52:40.922ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 1b5a99e2-3552-4a7c-bf7a-59d1fd251d45, dataset_name: DatasetName { pool_name: ZpoolName { id: a0552d97-e3e6-4586-a789-e6bcdec66672 (zpool), kind: External }, kind: Cockroach }, responder: ... }
11772024-12-19T05:52:40.978ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: a70a1db1-4ed4-460d-a7ae-0e54347df152, dataset_name: DatasetName { pool_name: ZpoolName { id: 0cdd8476-a0d8-44ca-a74b-0704c56ede98 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
11782024-12-19T05:52:40.978ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: a70a1db1-4ed4-460d-a7ae-0e54347df152, dataset_name: DatasetName { pool_name: ZpoolName { id: 0cdd8476-a0d8-44ca-a74b-0704c56ede98 (zpool), kind: External }, kind: Cockroach }, responder: ... }
11792024-12-19T05:52:41.034ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: bb4845ab-0600-4d61-a9f2-eb93a7cc0896, dataset_name: DatasetName { pool_name: ZpoolName { id: f1c83160-c846-4e0a-a537-6a326722ac5a (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
11802024-12-19T05:52:41.034ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: bb4845ab-0600-4d61-a9f2-eb93a7cc0896, dataset_name: DatasetName { pool_name: ZpoolName { id: f1c83160-c846-4e0a-a537-6a326722ac5a (zpool), kind: External }, kind: ExternalDns }, responder: ... }
11812024-12-19T05:52:41.094ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 75a56219-191b-4e5c-8eb1-d0e62e0c42f9, dataset_name: DatasetName { pool_name: ZpoolName { id: 436ef9e1-c612-46c3-866b-9e48c044fdf2 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
11822024-12-19T05:52:41.094ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 75a56219-191b-4e5c-8eb1-d0e62e0c42f9, dataset_name: DatasetName { pool_name: ZpoolName { id: 436ef9e1-c612-46c3-866b-9e48c044fdf2 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
11832024-12-19T05:52:41.150ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: f6dcc1d5-458d-4c06-aac2-ae852ccaf5f0, dataset_name: DatasetName { pool_name: ZpoolName { id: f1c83160-c846-4e0a-a537-6a326722ac5a (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:603
11842024-12-19T05:52:41.150ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: f6dcc1d5-458d-4c06-aac2-ae852ccaf5f0, dataset_name: DatasetName { pool_name: ZpoolName { id: f1c83160-c846-4e0a-a537-6a326722ac5a (zpool), kind: External }, kind: Clickhouse }, responder: ... }
11852024-12-19T05:52:41.192ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 58ae657f-f744-4b0b-a838-01074a6743ed, dataset_name: DatasetName { pool_name: ZpoolName { id: f1c83160-c846-4e0a-a537-6a326722ac5a (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
11862024-12-19T05:52:41.192ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 58ae657f-f744-4b0b-a838-01074a6743ed, dataset_name: DatasetName { pool_name: ZpoolName { id: f1c83160-c846-4e0a-a537-6a326722ac5a (zpool), kind: External }, kind: Crucible }, responder: ... }
11872024-12-19T05:52:41.232ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: e6d0c6fc-9f27-4b59-8b64-52d8f20ddfd9, dataset_name: DatasetName { pool_name: ZpoolName { id: 436ef9e1-c612-46c3-866b-9e48c044fdf2 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
11882024-12-19T05:52:41.233ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: e6d0c6fc-9f27-4b59-8b64-52d8f20ddfd9, dataset_name: DatasetName { pool_name: ZpoolName { id: 436ef9e1-c612-46c3-866b-9e48c044fdf2 (zpool), kind: External }, kind: Crucible }, responder: ... }
11892024-12-19T05:52:41.273ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 503e10f4-0146-46a7-bcc4-a71beb2225b2, dataset_name: DatasetName { pool_name: ZpoolName { id: defcb6a1-2bbe-47a6-a426-436ed60fd6fc (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
11902024-12-19T05:52:41.273ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 503e10f4-0146-46a7-bcc4-a71beb2225b2, dataset_name: DatasetName { pool_name: ZpoolName { id: defcb6a1-2bbe-47a6-a426-436ed60fd6fc (zpool), kind: External }, kind: Crucible }, responder: ... }
11912024-12-19T05:52:41.315ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: f534ccb4-1884-4b0c-b250-92aa7d3370a6, dataset_name: DatasetName { pool_name: ZpoolName { id: a0552d97-e3e6-4586-a789-e6bcdec66672 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
11922024-12-19T05:52:41.315ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: f534ccb4-1884-4b0c-b250-92aa7d3370a6, dataset_name: DatasetName { pool_name: ZpoolName { id: a0552d97-e3e6-4586-a789-e6bcdec66672 (zpool), kind: External }, kind: Crucible }, responder: ... }
11932024-12-19T05:52:41.355ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: e027a9c4-2388-40aa-8459-5f776f88554d, dataset_name: DatasetName { pool_name: ZpoolName { id: 0cdd8476-a0d8-44ca-a74b-0704c56ede98 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
11942024-12-19T05:52:41.355ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: e027a9c4-2388-40aa-8459-5f776f88554d, dataset_name: DatasetName { pool_name: ZpoolName { id: 0cdd8476-a0d8-44ca-a74b-0704c56ede98 (zpool), kind: External }, kind: Crucible }, responder: ... }
11952024-12-19T05:52:41.395ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: fa00fdf3-10e6-4350-898d-2ec64b75259e, dataset_name: DatasetName { pool_name: ZpoolName { id: 0686bda3-5eb8-4859-ac7b-e5a6ceb8616d (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
11962024-12-19T05:52:41.395ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: fa00fdf3-10e6-4350-898d-2ec64b75259e, dataset_name: DatasetName { pool_name: ZpoolName { id: 0686bda3-5eb8-4859-ac7b-e5a6ceb8616d (zpool), kind: External }, kind: Crucible }, responder: ... }
11972024-12-19T05:52:41.438ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 831f544f-98b3-466d-855d-ee48ae395f0b, dataset_name: DatasetName { pool_name: ZpoolName { id: 1fd2ac0f-93a9-44e1-a6b3-7ccfcdc6b252 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
11982024-12-19T05:52:41.439ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 831f544f-98b3-466d-855d-ee48ae395f0b, dataset_name: DatasetName { pool_name: ZpoolName { id: 1fd2ac0f-93a9-44e1-a6b3-7ccfcdc6b252 (zpool), kind: External }, kind: Crucible }, responder: ... }
11992024-12-19T05:52:41.481ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 6ae04bea-989b-4227-a44b-60ac3e1e9aa6, dataset_name: DatasetName { pool_name: ZpoolName { id: b5578c06-5ed8-4225-9470-d661174b141e (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
12002024-12-19T05:52:41.481ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 6ae04bea-989b-4227-a44b-60ac3e1e9aa6, dataset_name: DatasetName { pool_name: ZpoolName { id: b5578c06-5ed8-4225-9470-d661174b141e (zpool), kind: External }, kind: Crucible }, responder: ... }
12012024-12-19T05:52:41.522ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 4a60288a-de85-4cc2-97ae-0e9800cf70c5, dataset_name: DatasetName { pool_name: ZpoolName { id: c12c68d5-6ddb-4829-80b0-49f80baef150 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
12022024-12-19T05:52:41.522ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 4a60288a-de85-4cc2-97ae-0e9800cf70c5, dataset_name: DatasetName { pool_name: ZpoolName { id: c12c68d5-6ddb-4829-80b0-49f80baef150 (zpool), kind: External }, kind: Crucible }, responder: ... }
12032024-12-19T05:52:41.567ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12042024-12-19T05:52:41.567ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/e0de026f-6896-43b8-9686-b840d0967c1e/config/omicron-zones.json file = common/src/ledger.rs:177
12052024-12-19T05:52:41.567ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/d2802dae-55e1-4039-8308-ca231b2dc40c/config/omicron-zones.json file = common/src/ledger.rs:177
12062024-12-19T05:52:41.568ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12072024-12-19T05:52:41.669ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12082024-12-19T05:52:41.717ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12092024-12-19T05:52:41.718ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12102024-12-19T05:52:41.718ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12112024-12-19T05:52:41.718ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12122024-12-19T05:52:41.720ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12132024-12-19T05:52:41.720ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12142024-12-19T05:52:41.768ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12152024-12-19T05:52:41.768ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12162024-12-19T05:52:41.768ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12172024-12-19T05:52:41.768ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12182024-12-19T05:52:41.954ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12192024-12-19T05:52:41.954ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12202024-12-19T05:52:41.954ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12212024-12-19T05:52:41.954ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12222024-12-19T05:52:41.954ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12232024-12-19T05:52:41.954ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12242024-12-19T05:52:41.954ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12252024-12-19T05:52:41.955ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12262024-12-19T05:52:41.955ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_831f544f-98b3-466d-855d-ee48ae395f0b file = illumos-utils/src/zone.rs:325
12272024-12-19T05:52:41.961ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_4a60288a-de85-4cc2-97ae-0e9800cf70c5 file = illumos-utils/src/zone.rs:325
12282024-12-19T05:52:41.967ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_6ae04bea-989b-4227-a44b-60ac3e1e9aa6 file = illumos-utils/src/zone.rs:325
12292024-12-19T05:52:41.973ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_94497aa9-1336-4df1-af83-5ca2d4a43909 file = illumos-utils/src/zone.rs:325
12302024-12-19T05:52:41.977ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_58ae657f-f744-4b0b-a838-01074a6743ed file = illumos-utils/src/zone.rs:325
12312024-12-19T05:52:41.982ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_e6d0c6fc-9f27-4b59-8b64-52d8f20ddfd9 file = illumos-utils/src/zone.rs:325
12322024-12-19T05:52:41.987ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_f534ccb4-1884-4b0c-b250-92aa7d3370a6 file = illumos-utils/src/zone.rs:325
12332024-12-19T05:52:42.133ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_831f544f-98b3-466d-855d-ee48ae395f0b file = illumos-utils/src/zone.rs:363
12342024-12-19T05:52:42.138ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_4a60288a-de85-4cc2-97ae-0e9800cf70c5 file = illumos-utils/src/zone.rs:363
12352024-12-19T05:52:42.143ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_6ae04bea-989b-4227-a44b-60ac3e1e9aa6 file = illumos-utils/src/zone.rs:363
12362024-12-19T05:52:42.148ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_94497aa9-1336-4df1-af83-5ca2d4a43909 file = illumos-utils/src/zone.rs:363
12372024-12-19T05:52:42.152ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_58ae657f-f744-4b0b-a838-01074a6743ed file = illumos-utils/src/zone.rs:363
12382024-12-19T05:52:42.156ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_e6d0c6fc-9f27-4b59-8b64-52d8f20ddfd9 file = illumos-utils/src/zone.rs:363
12392024-12-19T05:52:42.160ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_f534ccb4-1884-4b0c-b250-92aa7d3370a6 file = illumos-utils/src/zone.rs:363
12402024-12-19T05:52:42.165ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_f6dcc1d5-458d-4c06-aac2-ae852ccaf5f0 file = illumos-utils/src/zone.rs:325
12412024-12-19T05:52:42.170ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_7701880a-5341-4c52-93af-e0d5f29a4650 file = illumos-utils/src/zone.rs:325
12422024-12-19T05:52:42.174ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_503e10f4-0146-46a7-bcc4-a71beb2225b2 file = illumos-utils/src/zone.rs:325
12432024-12-19T05:52:42.180ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_5aa1584b-558f-482f-872a-fff1fa879759 file = illumos-utils/src/zone.rs:325
12442024-12-19T05:52:42.185ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_e027a9c4-2388-40aa-8459-5f776f88554d file = illumos-utils/src/zone.rs:325
12452024-12-19T05:52:42.191ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_fa00fdf3-10e6-4350-898d-2ec64b75259e file = illumos-utils/src/zone.rs:325
12462024-12-19T05:52:42.196ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_bf630637-78f3-4e20-a86d-c4f19712ebb4 file = illumos-utils/src/zone.rs:325
12472024-12-19T05:52:42.240ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12482024-12-19T05:52:42.240ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_f6dcc1d5-458d-4c06-aac2-ae852ccaf5f0 file = illumos-utils/src/zone.rs:363
12492024-12-19T05:52:42.250ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_7701880a-5341-4c52-93af-e0d5f29a4650 file = illumos-utils/src/zone.rs:363
12502024-12-19T05:52:42.266ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_503e10f4-0146-46a7-bcc4-a71beb2225b2 file = illumos-utils/src/zone.rs:363
12512024-12-19T05:52:42.298ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_5aa1584b-558f-482f-872a-fff1fa879759 file = illumos-utils/src/zone.rs:363
12522024-12-19T05:52:42.317ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_e027a9c4-2388-40aa-8459-5f776f88554d file = illumos-utils/src/zone.rs:363
12532024-12-19T05:52:42.348ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_fa00fdf3-10e6-4350-898d-2ec64b75259e file = illumos-utils/src/zone.rs:363
12542024-12-19T05:52:42.384ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_bf630637-78f3-4e20-a86d-c4f19712ebb4 file = illumos-utils/src/zone.rs:363
12552024-12-19T05:52:42.476ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12562024-12-19T05:52:42.530ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12572024-12-19T05:52:42.582ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12582024-12-19T05:52:42.636ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12592024-12-19T05:52:42.639ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12602024-12-19T05:52:42.639ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12612024-12-19T05:52:42.691ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 140, 10]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
12622024-12-19T05:52:42.691ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1263 zone_type = external_dns
12632024-12-19T05:52:42.692ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12642024-12-19T05:52:42.692ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12652024-12-19T05:52:42.782ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 168, 229]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
12662024-12-19T05:52:42.782ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1263 zone_type = nexus
12672024-12-19T05:52:42.784ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12682024-12-19T05:52:42.784ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12692024-12-19T05:52:42.875ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 165, 241]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
12702024-12-19T05:52:42.875ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1263 zone_type = external_dns
12712024-12-19T05:52:42.878ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12722024-12-19T05:52:42.878ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12732024-12-19T05:52:42.935ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 144, 193]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
12742024-12-19T05:52:42.935ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1263 zone_type = nexus
12752024-12-19T05:52:42.937ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12762024-12-19T05:52:42.937ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12772024-12-19T05:52:42.989ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 158, 52]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
12782024-12-19T05:52:42.989ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1263 zone_type = nexus
12792024-12-19T05:52:42.989ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:83
12802024-12-19T05:52:42.990ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:90
12812024-12-19T05:52:42.990ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:83
12822024-12-19T05:52:42.990ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:90
12832024-12-19T05:52:42.990ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:83
12842024-12-19T05:52:42.990ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:90
12852024-12-19T05:52:42.990ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:83
12862024-12-19T05:52:42.990ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:90
12872024-12-19T05:52:42.990ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:83
12882024-12-19T05:52:42.990ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:90
12892024-12-19T05:52:42.990ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:118
12902024-12-19T05:52:42.992ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12912024-12-19T05:52:43.044ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:118
12922024-12-19T05:52:43.048ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:118
12932024-12-19T05:52:43.048ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12942024-12-19T05:52:43.052ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12952024-12-19T05:52:43.052ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:118
12962024-12-19T05:52:43.056ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:118
12972024-12-19T05:52:43.060ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12982024-12-19T05:52:43.060ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12992024-12-19T05:52:43.193ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_1e0292d6-c327-472e-85e6-622aab78d10f file = illumos-utils/src/zone.rs:325
13002024-12-19T05:52:43.200ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_bb4845ab-0600-4d61-a9f2-eb93a7cc0896 file = illumos-utils/src/zone.rs:325
13012024-12-19T05:52:43.205ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_c32c373d-ccc1-45e0-bb27-49a4415e7fca file = illumos-utils/src/zone.rs:325
13022024-12-19T05:52:43.213ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_1b05e3ee-34fc-4615-91df-a477e1a37258 file = illumos-utils/src/zone.rs:325
13032024-12-19T05:52:43.220ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_75a56219-191b-4e5c-8eb1-d0e62e0c42f9 file = illumos-utils/src/zone.rs:325
13042024-12-19T05:52:43.226ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_1e0292d6-c327-472e-85e6-622aab78d10f file = illumos-utils/src/zone.rs:363
13052024-12-19T05:52:43.231ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_bb4845ab-0600-4d61-a9f2-eb93a7cc0896 file = illumos-utils/src/zone.rs:363
13062024-12-19T05:52:43.242ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_1b05e3ee-34fc-4615-91df-a477e1a37258 file = illumos-utils/src/zone.rs:363
13072024-12-19T05:52:43.250ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_c32c373d-ccc1-45e0-bb27-49a4415e7fca file = illumos-utils/src/zone.rs:363
13082024-12-19T05:52:43.257ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_75a56219-191b-4e5c-8eb1-d0e62e0c42f9 file = illumos-utils/src/zone.rs:363
13092024-12-19T05:52:45.424ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_f534ccb4-1884-4b0c-b250-92aa7d3370a6: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_a0552d97-e3e6-4586-a789-e6bcdec66672/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='cdab4e73-9f25-4699-86e8-ff3a7844369c'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13102024-12-19T05:52:45.424ZINFOSledAgent (ServiceManager): Booting oxz_crucible_f534ccb4-1884-4b0c-b250-92aa7d3370a6 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_f534ccb4-1884-4b0c-b250-92aa7d3370a6
13112024-12-19T05:52:45.470ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_5aa1584b-558f-482f-872a-fff1fa879759: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13122024-12-19T05:52:45.470ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_5aa1584b-558f-482f-872a-fff1fa879759 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_5aa1584b-558f-482f-872a-fff1fa879759
13132024-12-19T05:52:45.478ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_7701880a-5341-4c52-93af-e0d5f29a4650: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13142024-12-19T05:52:45.478ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_7701880a-5341-4c52-93af-e0d5f29a4650 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_7701880a-5341-4c52-93af-e0d5f29a4650
13152024-12-19T05:52:45.490ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_6ae04bea-989b-4227-a44b-60ac3e1e9aa6: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_b5578c06-5ed8-4225-9470-d661174b141e/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='a04330a9-71b8-4807-90ab-05a56327d8cd'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13162024-12-19T05:52:45.490ZINFOSledAgent (ServiceManager): Booting oxz_crucible_6ae04bea-989b-4227-a44b-60ac3e1e9aa6 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_6ae04bea-989b-4227-a44b-60ac3e1e9aa6
13172024-12-19T05:52:45.533ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_4a60288a-de85-4cc2-97ae-0e9800cf70c5: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_c12c68d5-6ddb-4829-80b0-49f80baef150/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='3f6e87d2-e02e-44ed-9642-917d37844bd2'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13182024-12-19T05:52:45.533ZINFOSledAgent (ServiceManager): Booting oxz_crucible_4a60288a-de85-4cc2-97ae-0e9800cf70c5 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_4a60288a-de85-4cc2-97ae-0e9800cf70c5
13192024-12-19T05:52:45.548ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_831f544f-98b3-466d-855d-ee48ae395f0b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_1fd2ac0f-93a9-44e1-a6b3-7ccfcdc6b252/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='3748033f-d8d2-49be-b319-a530acde348a'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13202024-12-19T05:52:45.549ZINFOSledAgent (ServiceManager): Booting oxz_crucible_831f544f-98b3-466d-855d-ee48ae395f0b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_831f544f-98b3-466d-855d-ee48ae395f0b
13212024-12-19T05:52:45.574ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_fa00fdf3-10e6-4350-898d-2ec64b75259e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_0686bda3-5eb8-4859-ac7b-e5a6ceb8616d/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='153be4bc-4678-44a2-af28-50205961c9dd'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13222024-12-19T05:52:45.574ZINFOSledAgent (ServiceManager): Booting oxz_crucible_fa00fdf3-10e6-4350-898d-2ec64b75259e zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_fa00fdf3-10e6-4350-898d-2ec64b75259e
13232024-12-19T05:52:45.585ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_e027a9c4-2388-40aa-8459-5f776f88554d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_0cdd8476-a0d8-44ca-a74b-0704c56ede98/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='25cab1c1-784f-48ff-ad8e-4be6df7639f7'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13242024-12-19T05:52:45.585ZINFOSledAgent (ServiceManager): Booting oxz_crucible_e027a9c4-2388-40aa-8459-5f776f88554d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_e027a9c4-2388-40aa-8459-5f776f88554d
13252024-12-19T05:52:45.594ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_503e10f4-0146-46a7-bcc4-a71beb2225b2: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_defcb6a1-2bbe-47a6-a426-436ed60fd6fc/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='1337f7d4-b1bc-404f-af14-9111e2bdc2b6'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13262024-12-19T05:52:45.594ZINFOSledAgent (ServiceManager): Booting oxz_crucible_503e10f4-0146-46a7-bcc4-a71beb2225b2 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_503e10f4-0146-46a7-bcc4-a71beb2225b2
13272024-12-19T05:52:45.861ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_bf630637-78f3-4e20-a86d-c4f19712ebb4: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='bf630637-78f3-4e20-a86d-c4f19712ebb4'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13282024-12-19T05:52:45.861ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_bf630637-78f3-4e20-a86d-c4f19712ebb4 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_oximeter_bf630637-78f3-4e20-a86d-c4f19712ebb4
13292024-12-19T05:52:45.951ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7701880a-5341-4c52-93af-e0d5f29a4650") failed: Property not found. retry in 64.02512ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7701880a-5341-4c52-93af-e0d5f29a4650
13302024-12-19T05:52:45.960ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_831f544f-98b3-466d-855d-ee48ae395f0b") failed: Property not found. retry in 34.319876ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_831f544f-98b3-466d-855d-ee48ae395f0b
13312024-12-19T05:52:45.968ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4a60288a-de85-4cc2-97ae-0e9800cf70c5") failed: Property not found. retry in 40.453688ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4a60288a-de85-4cc2-97ae-0e9800cf70c5
13322024-12-19T05:52:45.976ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5aa1584b-558f-482f-872a-fff1fa879759") failed: Property not found. retry in 50.586719ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5aa1584b-558f-482f-872a-fff1fa879759
13332024-12-19T05:52:45.985ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e027a9c4-2388-40aa-8459-5f776f88554d") failed: Property not found. retry in 66.596989ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e027a9c4-2388-40aa-8459-5f776f88554d
13342024-12-19T05:52:45.994ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fa00fdf3-10e6-4350-898d-2ec64b75259e") failed: Property not found. retry in 43.6348ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fa00fdf3-10e6-4350-898d-2ec64b75259e
13352024-12-19T05:52:46.002ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6ae04bea-989b-4227-a44b-60ac3e1e9aa6") failed: Property not found. retry in 51.413394ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6ae04bea-989b-4227-a44b-60ac3e1e9aa6
13362024-12-19T05:52:46.012ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f534ccb4-1884-4b0c-b250-92aa7d3370a6") failed: Property not found. retry in 48.276322ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f534ccb4-1884-4b0c-b250-92aa7d3370a6
13372024-12-19T05:52:46.022ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_503e10f4-0146-46a7-bcc4-a71beb2225b2") failed: Property not found. retry in 47.560227ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_503e10f4-0146-46a7-bcc4-a71beb2225b2
13382024-12-19T05:52:46.122ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_831f544f-98b3-466d-855d-ee48ae395f0b") failed: Property not found. retry in 68.173853ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_831f544f-98b3-466d-855d-ee48ae395f0b
13392024-12-19T05:52:53.883ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4a60288a-de85-4cc2-97ae-0e9800cf70c5") failed: Property not found. retry in 95.792657ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4a60288a-de85-4cc2-97ae-0e9800cf70c5
13402024-12-19T05:52:54.066ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7701880a-5341-4c52-93af-e0d5f29a4650") failed: Property not found. retry in 98.615992ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7701880a-5341-4c52-93af-e0d5f29a4650
13412024-12-19T05:52:54.187ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_831f544f-98b3-466d-855d-ee48ae395f0b") failed: Property not found. retry in 226.763718ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_831f544f-98b3-466d-855d-ee48ae395f0b
13422024-12-19T05:52:54.269ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4a60288a-de85-4cc2-97ae-0e9800cf70c5") failed: Property not found. retry in 180.926084ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4a60288a-de85-4cc2-97ae-0e9800cf70c5
13432024-12-19T05:52:54.528ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6ae04bea-989b-4227-a44b-60ac3e1e9aa6") failed: Property not found. retry in 66.583108ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6ae04bea-989b-4227-a44b-60ac3e1e9aa6
13442024-12-19T05:52:54.733ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f534ccb4-1884-4b0c-b250-92aa7d3370a6") failed: Property not found. retry in 119.09377ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f534ccb4-1884-4b0c-b250-92aa7d3370a6
13452024-12-19T05:52:54.753ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7701880a-5341-4c52-93af-e0d5f29a4650") failed: Property not found. retry in 189.245962ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7701880a-5341-4c52-93af-e0d5f29a4650
13462024-12-19T05:52:54.772ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_503e10f4-0146-46a7-bcc4-a71beb2225b2") failed: Property not found. retry in 136.930781ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_503e10f4-0146-46a7-bcc4-a71beb2225b2
13472024-12-19T05:52:54.827ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5aa1584b-558f-482f-872a-fff1fa879759") failed: Property not found. retry in 144.653354ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5aa1584b-558f-482f-872a-fff1fa879759
13482024-12-19T05:52:54.923ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e027a9c4-2388-40aa-8459-5f776f88554d") failed: Property not found. retry in 114.577968ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e027a9c4-2388-40aa-8459-5f776f88554d
13492024-12-19T05:52:55.364ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fa00fdf3-10e6-4350-898d-2ec64b75259e") failed: Property not found. retry in 130.421289ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fa00fdf3-10e6-4350-898d-2ec64b75259e
13502024-12-19T05:52:55.517ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_bf630637-78f3-4e20-a86d-c4f19712ebb4") failed: Property not found. retry in 39.491188ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_bf630637-78f3-4e20-a86d-c4f19712ebb4
13512024-12-19T05:52:55.663ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_831f544f-98b3-466d-855d-ee48ae395f0b") failed: Property not found. retry in 460.988119ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_831f544f-98b3-466d-855d-ee48ae395f0b
13522024-12-19T05:52:55.701ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4a60288a-de85-4cc2-97ae-0e9800cf70c5") failed: Property not found. retry in 470.529464ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4a60288a-de85-4cc2-97ae-0e9800cf70c5
13532024-12-19T05:52:55.716ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6ae04bea-989b-4227-a44b-60ac3e1e9aa6") failed: Property not found. retry in 158.966927ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6ae04bea-989b-4227-a44b-60ac3e1e9aa6
13542024-12-19T05:52:55.721ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_94497aa9-1336-4df1-af83-5ca2d4a43909: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13552024-12-19T05:52:55.723ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_e6d0c6fc-9f27-4b59-8b64-52d8f20ddfd9: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_436ef9e1-c612-46c3-866b-9e48c044fdf2/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='ed93af52-c120-44ec-855e-658048fc9b6f'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13562024-12-19T05:52:55.785ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f534ccb4-1884-4b0c-b250-92aa7d3370a6") failed: Property not found. retry in 199.130643ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f534ccb4-1884-4b0c-b250-92aa7d3370a6
13572024-12-19T05:52:55.802ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7701880a-5341-4c52-93af-e0d5f29a4650") failed: Property not found. retry in 318.423379ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7701880a-5341-4c52-93af-e0d5f29a4650
13582024-12-19T05:52:55.813ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_503e10f4-0146-46a7-bcc4-a71beb2225b2") failed: Property not found. retry in 184.920934ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_503e10f4-0146-46a7-bcc4-a71beb2225b2
13592024-12-19T05:52:55.824ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5aa1584b-558f-482f-872a-fff1fa879759") failed: Property not found. retry in 262.142048ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5aa1584b-558f-482f-872a-fff1fa879759
13602024-12-19T05:52:55.837ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e027a9c4-2388-40aa-8459-5f776f88554d") failed: Property not found. retry in 178.117251ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e027a9c4-2388-40aa-8459-5f776f88554d
13612024-12-19T05:52:55.850ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fa00fdf3-10e6-4350-898d-2ec64b75259e") failed: Property not found. retry in 181.485179ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fa00fdf3-10e6-4350-898d-2ec64b75259e
13622024-12-19T05:52:55.865ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_bf630637-78f3-4e20-a86d-c4f19712ebb4") failed: Property not found. retry in 74.587442ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_bf630637-78f3-4e20-a86d-c4f19712ebb4
13632024-12-19T05:52:55.865ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_94497aa9-1336-4df1-af83-5ca2d4a43909 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_94497aa9-1336-4df1-af83-5ca2d4a43909
13642024-12-19T05:52:55.874ZINFOSledAgent (ServiceManager): Booting oxz_crucible_e6d0c6fc-9f27-4b59-8b64-52d8f20ddfd9 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_e6d0c6fc-9f27-4b59-8b64-52d8f20ddfd9
13652024-12-19T05:52:55.898ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6ae04bea-989b-4227-a44b-60ac3e1e9aa6") failed: Property not found. retry in 526.353003ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6ae04bea-989b-4227-a44b-60ac3e1e9aa6
13662024-12-19T05:52:55.955ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_bf630637-78f3-4e20-a86d-c4f19712ebb4") failed: Property not found. retry in 101.704294ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_bf630637-78f3-4e20-a86d-c4f19712ebb4
13672024-12-19T05:52:55.998ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f534ccb4-1884-4b0c-b250-92aa7d3370a6") failed: Property not found. retry in 539.187475ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f534ccb4-1884-4b0c-b250-92aa7d3370a6
13682024-12-19T05:52:56.012ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_503e10f4-0146-46a7-bcc4-a71beb2225b2") failed: Property not found. retry in 548.119493ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_503e10f4-0146-46a7-bcc4-a71beb2225b2
13692024-12-19T05:52:56.031ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e027a9c4-2388-40aa-8459-5f776f88554d") failed: Property not found. retry in 205.673042ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e027a9c4-2388-40aa-8459-5f776f88554d
13702024-12-19T05:52:56.049ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fa00fdf3-10e6-4350-898d-2ec64b75259e") failed: Property not found. retry in 507.700933ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fa00fdf3-10e6-4350-898d-2ec64b75259e
13712024-12-19T05:52:56.071ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_bf630637-78f3-4e20-a86d-c4f19712ebb4") failed: Property not found. retry in 282.888561ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_bf630637-78f3-4e20-a86d-c4f19712ebb4
13722024-12-19T05:52:56.101ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5aa1584b-558f-482f-872a-fff1fa879759") failed: Property not found. retry in 398.970654ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5aa1584b-558f-482f-872a-fff1fa879759
13732024-12-19T05:52:56.133ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7701880a-5341-4c52-93af-e0d5f29a4650") failed: Property not found. retry in 746.768528ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7701880a-5341-4c52-93af-e0d5f29a4650
13742024-12-19T05:52:56.146ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_831f544f-98b3-466d-855d-ee48ae395f0b") failed: Property not found. retry in 883.070891ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_831f544f-98b3-466d-855d-ee48ae395f0b
13752024-12-19T05:52:56.184ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4a60288a-de85-4cc2-97ae-0e9800cf70c5") failed: Property not found. retry in 513.166482ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4a60288a-de85-4cc2-97ae-0e9800cf70c5
13762024-12-19T05:52:56.255ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e027a9c4-2388-40aa-8459-5f776f88554d") failed: Property not found. retry in 1.070075907s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e027a9c4-2388-40aa-8459-5f776f88554d
13772024-12-19T05:52:56.342ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e6d0c6fc-9f27-4b59-8b64-52d8f20ddfd9") failed: Property not found. retry in 46.73114ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e6d0c6fc-9f27-4b59-8b64-52d8f20ddfd9
13782024-12-19T05:52:56.354ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_94497aa9-1336-4df1-af83-5ca2d4a43909") failed: Property not found. retry in 69.396096ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_94497aa9-1336-4df1-af83-5ca2d4a43909
13792024-12-19T05:52:56.369ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_bf630637-78f3-4e20-a86d-c4f19712ebb4") failed: Property not found. retry in 697.810134ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_bf630637-78f3-4e20-a86d-c4f19712ebb4
13802024-12-19T05:52:56.402ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e6d0c6fc-9f27-4b59-8b64-52d8f20ddfd9") failed: Property not found. retry in 50.241833ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e6d0c6fc-9f27-4b59-8b64-52d8f20ddfd9
13812024-12-19T05:52:56.435ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_94497aa9-1336-4df1-af83-5ca2d4a43909") failed: Property not found. retry in 108.375094ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_94497aa9-1336-4df1-af83-5ca2d4a43909
13822024-12-19T05:52:56.448ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6ae04bea-989b-4227-a44b-60ac3e1e9aa6") failed: Property not found. retry in 1.159704408s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6ae04bea-989b-4227-a44b-60ac3e1e9aa6
13832024-12-19T05:52:56.465ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e6d0c6fc-9f27-4b59-8b64-52d8f20ddfd9") failed: Property not found. retry in 212.039763ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e6d0c6fc-9f27-4b59-8b64-52d8f20ddfd9
13842024-12-19T05:52:56.517ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5aa1584b-558f-482f-872a-fff1fa879759") failed: Property not found. retry in 1.041071634s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5aa1584b-558f-482f-872a-fff1fa879759
13852024-12-19T05:52:56.551ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f534ccb4-1884-4b0c-b250-92aa7d3370a6") failed: Property not found. retry in 666.916399ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f534ccb4-1884-4b0c-b250-92aa7d3370a6
13862024-12-19T05:52:56.563ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_94497aa9-1336-4df1-af83-5ca2d4a43909") failed: Property not found. retry in 152.839203ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_94497aa9-1336-4df1-af83-5ca2d4a43909
13872024-12-19T05:52:56.577ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_503e10f4-0146-46a7-bcc4-a71beb2225b2") failed: Property not found. retry in 1.005135529s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_503e10f4-0146-46a7-bcc4-a71beb2225b2
13882024-12-19T05:52:56.590ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fa00fdf3-10e6-4350-898d-2ec64b75259e") failed: Property not found. retry in 1.136986682s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fa00fdf3-10e6-4350-898d-2ec64b75259e
13892024-12-19T05:52:56.693ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e6d0c6fc-9f27-4b59-8b64-52d8f20ddfd9") failed: Property not found. retry in 422.683834ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e6d0c6fc-9f27-4b59-8b64-52d8f20ddfd9
13902024-12-19T05:52:56.711ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4a60288a-de85-4cc2-97ae-0e9800cf70c5") failed: Property not found. retry in 701.134326ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4a60288a-de85-4cc2-97ae-0e9800cf70c5
13912024-12-19T05:52:56.732ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_94497aa9-1336-4df1-af83-5ca2d4a43909") failed: Property not found. retry in 485.606329ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_94497aa9-1336-4df1-af83-5ca2d4a43909
13922024-12-19T05:52:56.896ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7701880a-5341-4c52-93af-e0d5f29a4650") failed: Property not found. retry in 723.294661ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7701880a-5341-4c52-93af-e0d5f29a4650
13932024-12-19T05:52:56.903ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_1b05e3ee-34fc-4615-91df-a477e1a37258: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13942024-12-19T05:52:56.903ZINFOSledAgent (ServiceManager): Booting oxz_nexus_1b05e3ee-34fc-4615-91df-a477e1a37258 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_1b05e3ee-34fc-4615-91df-a477e1a37258
13952024-12-19T05:52:57.045ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_831f544f-98b3-466d-855d-ee48ae395f0b") failed: Property not found. retry in 535.50352ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_831f544f-98b3-466d-855d-ee48ae395f0b
13962024-12-19T05:52:57.081ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_bf630637-78f3-4e20-a86d-c4f19712ebb4") failed: Property not found. retry in 678.77873ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_bf630637-78f3-4e20-a86d-c4f19712ebb4
13972024-12-19T05:52:57.129ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e6d0c6fc-9f27-4b59-8b64-52d8f20ddfd9") failed: Property not found. retry in 737.786037ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e6d0c6fc-9f27-4b59-8b64-52d8f20ddfd9
13982024-12-19T05:52:57.174ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1b05e3ee-34fc-4615-91df-a477e1a37258") failed: Property not found. retry in 72.826216ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1b05e3ee-34fc-4615-91df-a477e1a37258
13992024-12-19T05:52:57.234ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_94497aa9-1336-4df1-af83-5ca2d4a43909") failed: Property not found. retry in 454.609041ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_94497aa9-1336-4df1-af83-5ca2d4a43909
14002024-12-19T05:52:57.246ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f534ccb4-1884-4b0c-b250-92aa7d3370a6") failed: Property not found. retry in 800.226819ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f534ccb4-1884-4b0c-b250-92aa7d3370a6
14012024-12-19T05:52:57.259ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1b05e3ee-34fc-4615-91df-a477e1a37258") failed: Property not found. retry in 93.271518ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1b05e3ee-34fc-4615-91df-a477e1a37258
14022024-12-19T05:52:57.339ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e027a9c4-2388-40aa-8459-5f776f88554d") failed: Property not found. retry in 673.104214ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e027a9c4-2388-40aa-8459-5f776f88554d
14032024-12-19T05:52:57.365ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1b05e3ee-34fc-4615-91df-a477e1a37258") failed: Property not found. retry in 213.096119ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1b05e3ee-34fc-4615-91df-a477e1a37258
14042024-12-19T05:52:57.425ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4a60288a-de85-4cc2-97ae-0e9800cf70c5") failed: Property not found. retry in 1.02358514s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4a60288a-de85-4cc2-97ae-0e9800cf70c5
14052024-12-19T05:52:57.571ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5aa1584b-558f-482f-872a-fff1fa879759") failed: Property not found. retry in 1.011781069s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5aa1584b-558f-482f-872a-fff1fa879759
14062024-12-19T05:52:57.592ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1b05e3ee-34fc-4615-91df-a477e1a37258") failed: Property not found. retry in 277.230933ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1b05e3ee-34fc-4615-91df-a477e1a37258
14072024-12-19T05:52:57.603ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_831f544f-98b3-466d-855d-ee48ae395f0b") failed: Property not found. retry in 1.406367032s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_831f544f-98b3-466d-855d-ee48ae395f0b
14082024-12-19T05:52:57.616ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_503e10f4-0146-46a7-bcc4-a71beb2225b2") failed: Property not found. retry in 1.442353551s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_503e10f4-0146-46a7-bcc4-a71beb2225b2
14092024-12-19T05:52:57.628ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6ae04bea-989b-4227-a44b-60ac3e1e9aa6") failed: Property not found. retry in 516.25283ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6ae04bea-989b-4227-a44b-60ac3e1e9aa6
14102024-12-19T05:52:57.642ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7701880a-5341-4c52-93af-e0d5f29a4650") failed: Property not found. retry in 1.107030493s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7701880a-5341-4c52-93af-e0d5f29a4650
14112024-12-19T05:52:57.643ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_75a56219-191b-4e5c-8eb1-d0e62e0c42f9: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14122024-12-19T05:52:57.643ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_75a56219-191b-4e5c-8eb1-d0e62e0c42f9 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_75a56219-191b-4e5c-8eb1-d0e62e0c42f9
14132024-12-19T05:52:57.702ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_94497aa9-1336-4df1-af83-5ca2d4a43909") failed: Property not found. retry in 608.11866ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_94497aa9-1336-4df1-af83-5ca2d4a43909
14142024-12-19T05:52:57.742ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fa00fdf3-10e6-4350-898d-2ec64b75259e") failed: Property not found. retry in 622.076042ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fa00fdf3-10e6-4350-898d-2ec64b75259e
14152024-12-19T05:52:57.771ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_bf630637-78f3-4e20-a86d-c4f19712ebb4") failed: Property not found. retry in 963.342872ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_bf630637-78f3-4e20-a86d-c4f19712ebb4
14162024-12-19T05:52:57.888ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e6d0c6fc-9f27-4b59-8b64-52d8f20ddfd9") failed: Property not found. retry in 1.243926318s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e6d0c6fc-9f27-4b59-8b64-52d8f20ddfd9
14172024-12-19T05:52:57.902ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1b05e3ee-34fc-4615-91df-a477e1a37258") failed: Property not found. retry in 710.109692ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1b05e3ee-34fc-4615-91df-a477e1a37258
14182024-12-19T05:52:57.913ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_75a56219-191b-4e5c-8eb1-d0e62e0c42f9") failed: Property not found. retry in 68.655935ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_75a56219-191b-4e5c-8eb1-d0e62e0c42f9
14192024-12-19T05:52:57.993ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_75a56219-191b-4e5c-8eb1-d0e62e0c42f9") failed: Property not found. retry in 53.83798ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_75a56219-191b-4e5c-8eb1-d0e62e0c42f9
14202024-12-19T05:52:58.025ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e027a9c4-2388-40aa-8459-5f776f88554d") failed: Property not found. retry in 1.260629564s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e027a9c4-2388-40aa-8459-5f776f88554d
14212024-12-19T05:52:58.059ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f534ccb4-1884-4b0c-b250-92aa7d3370a6") failed: Property not found. retry in 759.531003ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f534ccb4-1884-4b0c-b250-92aa7d3370a6
14222024-12-19T05:52:58.069ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_75a56219-191b-4e5c-8eb1-d0e62e0c42f9") failed: Property not found. retry in 112.729347ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_75a56219-191b-4e5c-8eb1-d0e62e0c42f9
14232024-12-19T05:52:58.157ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6ae04bea-989b-4227-a44b-60ac3e1e9aa6") failed: Property not found. retry in 585.959239ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6ae04bea-989b-4227-a44b-60ac3e1e9aa6
14242024-12-19T05:52:58.197ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_75a56219-191b-4e5c-8eb1-d0e62e0c42f9") failed: Property not found. retry in 517.441647ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_75a56219-191b-4e5c-8eb1-d0e62e0c42f9
14252024-12-19T05:52:58.324ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_94497aa9-1336-4df1-af83-5ca2d4a43909") failed: Property not found. retry in 1.476536762s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_94497aa9-1336-4df1-af83-5ca2d4a43909
14262024-12-19T05:52:58.376ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fa00fdf3-10e6-4350-898d-2ec64b75259e") failed: Property not found. retry in 514.862204ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fa00fdf3-10e6-4350-898d-2ec64b75259e
14272024-12-19T05:52:58.461ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4a60288a-de85-4cc2-97ae-0e9800cf70c5") failed: Property not found. retry in 955.687005ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4a60288a-de85-4cc2-97ae-0e9800cf70c5
14282024-12-19T05:52:58.596ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5aa1584b-558f-482f-872a-fff1fa879759") failed: Property not found. retry in 1.493209653s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5aa1584b-558f-482f-872a-fff1fa879759
14292024-12-19T05:52:58.626ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1b05e3ee-34fc-4615-91df-a477e1a37258") failed: Property not found. retry in 1.149538835s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1b05e3ee-34fc-4615-91df-a477e1a37258
14302024-12-19T05:52:58.727ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_75a56219-191b-4e5c-8eb1-d0e62e0c42f9") failed: Property not found. retry in 417.90569ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_75a56219-191b-4e5c-8eb1-d0e62e0c42f9
14312024-12-19T05:52:58.747ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_bf630637-78f3-4e20-a86d-c4f19712ebb4") failed: Property not found. retry in 1.154810602s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_bf630637-78f3-4e20-a86d-c4f19712ebb4
14322024-12-19T05:52:58.755ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6ae04bea-989b-4227-a44b-60ac3e1e9aa6") failed: Property not found. retry in 1.492847235s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6ae04bea-989b-4227-a44b-60ac3e1e9aa6
14332024-12-19T05:52:58.764ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7701880a-5341-4c52-93af-e0d5f29a4650") failed: Property not found. retry in 738.532954ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7701880a-5341-4c52-93af-e0d5f29a4650
14342024-12-19T05:52:58.833ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f534ccb4-1884-4b0c-b250-92aa7d3370a6") failed: Property not found. retry in 1.28301472s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f534ccb4-1884-4b0c-b250-92aa7d3370a6
14352024-12-19T05:52:58.906ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fa00fdf3-10e6-4350-898d-2ec64b75259e") failed: Property not found. retry in 587.443958ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fa00fdf3-10e6-4350-898d-2ec64b75259e
14362024-12-19T05:52:59.025ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_831f544f-98b3-466d-855d-ee48ae395f0b") failed: Property not found. retry in 1.432603456s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_831f544f-98b3-466d-855d-ee48ae395f0b
14372024-12-19T05:52:59.072ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_503e10f4-0146-46a7-bcc4-a71beb2225b2") failed: Property not found. retry in 625.878016ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_503e10f4-0146-46a7-bcc4-a71beb2225b2
14382024-12-19T05:52:59.146ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e6d0c6fc-9f27-4b59-8b64-52d8f20ddfd9") failed: Property not found. retry in 1.016087364s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e6d0c6fc-9f27-4b59-8b64-52d8f20ddfd9
14392024-12-19T05:52:59.158ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_75a56219-191b-4e5c-8eb1-d0e62e0c42f9") failed: Property not found. retry in 849.42275ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_75a56219-191b-4e5c-8eb1-d0e62e0c42f9
14402024-12-19T05:52:59.300ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e027a9c4-2388-40aa-8459-5f776f88554d") failed: Property not found. retry in 794.785727ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e027a9c4-2388-40aa-8459-5f776f88554d
14412024-12-19T05:52:59.426ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4a60288a-de85-4cc2-97ae-0e9800cf70c5") failed: Property not found. retry in 1.227091003s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4a60288a-de85-4cc2-97ae-0e9800cf70c5
14422024-12-19T05:52:59.503ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fa00fdf3-10e6-4350-898d-2ec64b75259e") failed: Property not found. retry in 743.961666ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fa00fdf3-10e6-4350-898d-2ec64b75259e
14432024-12-19T05:52:59.513ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7701880a-5341-4c52-93af-e0d5f29a4650") failed: Property not found. retry in 1.039736197s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7701880a-5341-4c52-93af-e0d5f29a4650
14442024-12-19T05:52:59.793ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_503e10f4-0146-46a7-bcc4-a71beb2225b2") failed: Property not found. retry in 932.510517ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_503e10f4-0146-46a7-bcc4-a71beb2225b2
14452024-12-19T05:52:59.810ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1b05e3ee-34fc-4615-91df-a477e1a37258") failed: Property not found. retry in 1.370544889s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1b05e3ee-34fc-4615-91df-a477e1a37258
14462024-12-19T05:52:59.832ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_94497aa9-1336-4df1-af83-5ca2d4a43909") failed: Property not found. retry in 508.638296ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_94497aa9-1336-4df1-af83-5ca2d4a43909
14472024-12-19T05:52:59.934ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_bf630637-78f3-4e20-a86d-c4f19712ebb4") failed: Property not found. retry in 1.439258656s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_bf630637-78f3-4e20-a86d-c4f19712ebb4
14482024-12-19T05:53:00.044ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_75a56219-191b-4e5c-8eb1-d0e62e0c42f9") failed: Property not found. retry in 1.413590343s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_75a56219-191b-4e5c-8eb1-d0e62e0c42f9
14492024-12-19T05:53:00.059ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_58ae657f-f744-4b0b-a838-01074a6743ed: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_f1c83160-c846-4e0a-a537-6a326722ac5a/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='99a0ecd5-3f2b-40a7-ab95-1707a6ea8e76'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14502024-12-19T05:53:08.599ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5aa1584b-558f-482f-872a-fff1fa879759") failed: Property not found. retry in 734.366484ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5aa1584b-558f-482f-872a-fff1fa879759
14512024-12-19T05:53:08.599ZINFOSledAgent (ServiceManager): Booting oxz_crucible_58ae657f-f744-4b0b-a838-01074a6743ed zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_58ae657f-f744-4b0b-a838-01074a6743ed
14522024-12-19T05:53:08.618ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e6d0c6fc-9f27-4b59-8b64-52d8f20ddfd9") failed: Property not found. retry in 877.171991ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e6d0c6fc-9f27-4b59-8b64-52d8f20ddfd9
14532024-12-19T05:53:08.628ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f534ccb4-1884-4b0c-b250-92aa7d3370a6") failed: Property not found. retry in 715.163315ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f534ccb4-1884-4b0c-b250-92aa7d3370a6
14542024-12-19T05:53:08.638ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7701880a-5341-4c52-93af-e0d5f29a4650") failed: Property not found. retry in 786.25214ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7701880a-5341-4c52-93af-e0d5f29a4650
14552024-12-19T05:53:08.647ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_503e10f4-0146-46a7-bcc4-a71beb2225b2") failed: Property not found. retry in 1.236329081s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_503e10f4-0146-46a7-bcc4-a71beb2225b2
14562024-12-19T05:53:08.656ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e027a9c4-2388-40aa-8459-5f776f88554d") failed: Property not found. retry in 1.184524096s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e027a9c4-2388-40aa-8459-5f776f88554d
14572024-12-19T05:53:08.664ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fa00fdf3-10e6-4350-898d-2ec64b75259e") failed: Property not found. retry in 1.047717135s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fa00fdf3-10e6-4350-898d-2ec64b75259e
14582024-12-19T05:53:08.674ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_bf630637-78f3-4e20-a86d-c4f19712ebb4") failed: Property not found. retry in 609.367521ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_bf630637-78f3-4e20-a86d-c4f19712ebb4
14592024-12-19T05:53:08.682ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1b05e3ee-34fc-4615-91df-a477e1a37258") failed: Property not found. retry in 537.387954ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1b05e3ee-34fc-4615-91df-a477e1a37258
14602024-12-19T05:53:08.690ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_831f544f-98b3-466d-855d-ee48ae395f0b") failed: Property not found. retry in 764.665292ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_831f544f-98b3-466d-855d-ee48ae395f0b
14612024-12-19T05:53:08.699ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4a60288a-de85-4cc2-97ae-0e9800cf70c5") failed: Property not found. retry in 1.346677831s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4a60288a-de85-4cc2-97ae-0e9800cf70c5
14622024-12-19T05:53:08.709ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6ae04bea-989b-4227-a44b-60ac3e1e9aa6") failed: Property not found. retry in 1.136923229s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6ae04bea-989b-4227-a44b-60ac3e1e9aa6
14632024-12-19T05:53:08.717ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_75a56219-191b-4e5c-8eb1-d0e62e0c42f9") failed: Property not found. retry in 882.049075ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_75a56219-191b-4e5c-8eb1-d0e62e0c42f9
14642024-12-19T05:53:08.726ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_94497aa9-1336-4df1-af83-5ca2d4a43909") failed: Property not found. retry in 934.830217ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_94497aa9-1336-4df1-af83-5ca2d4a43909
14652024-12-19T05:53:08.781ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_58ae657f-f744-4b0b-a838-01074a6743ed") failed: Property not found. retry in 49.475707ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_58ae657f-f744-4b0b-a838-01074a6743ed
14662024-12-19T05:53:08.839ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_58ae657f-f744-4b0b-a838-01074a6743ed") failed: Property not found. retry in 52.463223ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_58ae657f-f744-4b0b-a838-01074a6743ed
14672024-12-19T05:53:08.889ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_bb4845ab-0600-4d61-a9f2-eb93a7cc0896: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14682024-12-19T05:53:08.891ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_bb4845ab-0600-4d61-a9f2-eb93a7cc0896 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_bb4845ab-0600-4d61-a9f2-eb93a7cc0896
14692024-12-19T05:53:08.915ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_58ae657f-f744-4b0b-a838-01074a6743ed") failed: Property not found. retry in 138.36324ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_58ae657f-f744-4b0b-a838-01074a6743ed
14702024-12-19T05:53:09.016ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_1e0292d6-c327-472e-85e6-622aab78d10f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14712024-12-19T05:53:09.016ZINFOSledAgent (ServiceManager): Booting oxz_nexus_1e0292d6-c327-472e-85e6-622aab78d10f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_1e0292d6-c327-472e-85e6-622aab78d10f
14722024-12-19T05:53:09.065ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_58ae657f-f744-4b0b-a838-01074a6743ed") failed: Property not found. retry in 375.047164ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_58ae657f-f744-4b0b-a838-01074a6743ed
14732024-12-19T05:53:09.098ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_bb4845ab-0600-4d61-a9f2-eb93a7cc0896") failed: Property not found. retry in 48.140439ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_bb4845ab-0600-4d61-a9f2-eb93a7cc0896
14742024-12-19T05:53:09.155ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_bb4845ab-0600-4d61-a9f2-eb93a7cc0896") failed: Property not found. retry in 84.066594ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_bb4845ab-0600-4d61-a9f2-eb93a7cc0896
14752024-12-19T05:53:09.176ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1e0292d6-c327-472e-85e6-622aab78d10f") failed: Property not found. retry in 30.945693ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1e0292d6-c327-472e-85e6-622aab78d10f
14762024-12-19T05:53:09.215ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1e0292d6-c327-472e-85e6-622aab78d10f") failed: Property not found. retry in 87.693536ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1e0292d6-c327-472e-85e6-622aab78d10f
14772024-12-19T05:53:09.229ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1b05e3ee-34fc-4615-91df-a477e1a37258") failed: Property not found. retry in 766.414377ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1b05e3ee-34fc-4615-91df-a477e1a37258
14782024-12-19T05:53:09.247ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_bb4845ab-0600-4d61-a9f2-eb93a7cc0896") failed: Property not found. retry in 169.996964ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_bb4845ab-0600-4d61-a9f2-eb93a7cc0896
14792024-12-19T05:53:09.292ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_bf630637-78f3-4e20-a86d-c4f19712ebb4") failed: Property not found. retry in 1.298071002s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_bf630637-78f3-4e20-a86d-c4f19712ebb4
14802024-12-19T05:53:09.311ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1e0292d6-c327-472e-85e6-622aab78d10f") failed: Property not found. retry in 266.50205ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1e0292d6-c327-472e-85e6-622aab78d10f
14812024-12-19T05:53:09.343ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5aa1584b-558f-482f-872a-fff1fa879759") failed: Property not found. retry in 1.063587046s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5aa1584b-558f-482f-872a-fff1fa879759
14822024-12-19T05:53:09.352ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f534ccb4-1884-4b0c-b250-92aa7d3370a6") failed: Property not found. retry in 930.692186ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f534ccb4-1884-4b0c-b250-92aa7d3370a6
14832024-12-19T05:53:09.427ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_bb4845ab-0600-4d61-a9f2-eb93a7cc0896") failed: Property not found. retry in 285.882453ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_bb4845ab-0600-4d61-a9f2-eb93a7cc0896
14842024-12-19T05:53:09.435ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7701880a-5341-4c52-93af-e0d5f29a4650") failed: Property not found. retry in 1.128611311s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7701880a-5341-4c52-93af-e0d5f29a4650
14852024-12-19T05:53:09.451ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_58ae657f-f744-4b0b-a838-01074a6743ed") failed: Property not found. retry in 701.311905ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_58ae657f-f744-4b0b-a838-01074a6743ed
14862024-12-19T05:53:09.465ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_831f544f-98b3-466d-855d-ee48ae395f0b") failed: Property not found. retry in 608.548184ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_831f544f-98b3-466d-855d-ee48ae395f0b
14872024-12-19T05:53:09.506ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e6d0c6fc-9f27-4b59-8b64-52d8f20ddfd9") failed: Property not found. retry in 857.742597ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e6d0c6fc-9f27-4b59-8b64-52d8f20ddfd9
14882024-12-19T05:53:09.589ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1e0292d6-c327-472e-85e6-622aab78d10f") failed: Property not found. retry in 457.155577ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1e0292d6-c327-472e-85e6-622aab78d10f
14892024-12-19T05:53:09.609ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_75a56219-191b-4e5c-8eb1-d0e62e0c42f9") failed: Property not found. retry in 1.491463139s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_75a56219-191b-4e5c-8eb1-d0e62e0c42f9
14902024-12-19T05:53:09.672ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_94497aa9-1336-4df1-af83-5ca2d4a43909") failed: Property not found. retry in 855.646639ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_94497aa9-1336-4df1-af83-5ca2d4a43909
14912024-12-19T05:53:09.761ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fa00fdf3-10e6-4350-898d-2ec64b75259e") failed: Property not found. retry in 974.179117ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fa00fdf3-10e6-4350-898d-2ec64b75259e
14922024-12-19T05:53:09.776ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_bb4845ab-0600-4d61-a9f2-eb93a7cc0896") failed: Property not found. retry in 807.356788ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_bb4845ab-0600-4d61-a9f2-eb93a7cc0896
14932024-12-19T05:53:09.824ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_c32c373d-ccc1-45e0-bb27-49a4415e7fca: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14942024-12-19T05:53:09.824ZINFOSledAgent (ServiceManager): Booting oxz_nexus_c32c373d-ccc1-45e0-bb27-49a4415e7fca zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_c32c373d-ccc1-45e0-bb27-49a4415e7fca
14952024-12-19T05:53:09.855ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e027a9c4-2388-40aa-8459-5f776f88554d") failed: Property not found. retry in 932.155728ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e027a9c4-2388-40aa-8459-5f776f88554d
14962024-12-19T05:53:09.879ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6ae04bea-989b-4227-a44b-60ac3e1e9aa6") failed: Property not found. retry in 1.029800884s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6ae04bea-989b-4227-a44b-60ac3e1e9aa6
14972024-12-19T05:53:09.900ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_503e10f4-0146-46a7-bcc4-a71beb2225b2") failed: Property not found. retry in 1.155451921s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_503e10f4-0146-46a7-bcc4-a71beb2225b2
14982024-12-19T05:53:10.007ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1b05e3ee-34fc-4615-91df-a477e1a37258") failed: Property not found. retry in 1.39480455s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1b05e3ee-34fc-4615-91df-a477e1a37258
14992024-12-19T05:53:10.032ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c32c373d-ccc1-45e0-bb27-49a4415e7fca") failed: Property not found. retry in 31.001299ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c32c373d-ccc1-45e0-bb27-49a4415e7fca
15002024-12-19T05:53:10.056ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4a60288a-de85-4cc2-97ae-0e9800cf70c5") failed: Property not found. retry in 852.306457ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4a60288a-de85-4cc2-97ae-0e9800cf70c5
15012024-12-19T05:53:10.064ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1e0292d6-c327-472e-85e6-622aab78d10f") failed: Property not found. retry in 892.551168ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1e0292d6-c327-472e-85e6-622aab78d10f
15022024-12-19T05:53:10.071ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c32c373d-ccc1-45e0-bb27-49a4415e7fca") failed: Property not found. retry in 69.812963ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c32c373d-ccc1-45e0-bb27-49a4415e7fca
15032024-12-19T05:53:10.083ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_831f544f-98b3-466d-855d-ee48ae395f0b") failed: Property not found. retry in 1.048757334s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_831f544f-98b3-466d-855d-ee48ae395f0b
15042024-12-19T05:53:10.149ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c32c373d-ccc1-45e0-bb27-49a4415e7fca") failed: Property not found. retry in 261.603996ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c32c373d-ccc1-45e0-bb27-49a4415e7fca
15052024-12-19T05:53:10.162ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_58ae657f-f744-4b0b-a838-01074a6743ed") failed: Property not found. retry in 555.807395ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_58ae657f-f744-4b0b-a838-01074a6743ed
15062024-12-19T05:53:10.293ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f534ccb4-1884-4b0c-b250-92aa7d3370a6") failed: Property not found. retry in 1.245921163s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f534ccb4-1884-4b0c-b250-92aa7d3370a6
15072024-12-19T05:53:10.374ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e6d0c6fc-9f27-4b59-8b64-52d8f20ddfd9") failed: Property not found. retry in 1.406509692s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e6d0c6fc-9f27-4b59-8b64-52d8f20ddfd9
15082024-12-19T05:53:10.415ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5aa1584b-558f-482f-872a-fff1fa879759") failed: Property not found. retry in 961.287037ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5aa1584b-558f-482f-872a-fff1fa879759
15092024-12-19T05:53:10.425ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c32c373d-ccc1-45e0-bb27-49a4415e7fca") failed: Property not found. retry in 265.126131ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c32c373d-ccc1-45e0-bb27-49a4415e7fca
15102024-12-19T05:53:10.536ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_94497aa9-1336-4df1-af83-5ca2d4a43909") failed: Property not found. retry in 1.134446278s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_94497aa9-1336-4df1-af83-5ca2d4a43909
15112024-12-19T05:53:10.574ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7701880a-5341-4c52-93af-e0d5f29a4650") failed: Property not found. retry in 1.018829624s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7701880a-5341-4c52-93af-e0d5f29a4650
15122024-12-19T05:53:10.593ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_bb4845ab-0600-4d61-a9f2-eb93a7cc0896") failed: Property not found. retry in 1.147351378s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_bb4845ab-0600-4d61-a9f2-eb93a7cc0896
15132024-12-19T05:53:10.601ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_bf630637-78f3-4e20-a86d-c4f19712ebb4") failed: Property not found. retry in 1.339808493s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_bf630637-78f3-4e20-a86d-c4f19712ebb4
15142024-12-19T05:53:10.705ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c32c373d-ccc1-45e0-bb27-49a4415e7fca") failed: Property not found. retry in 994.820793ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c32c373d-ccc1-45e0-bb27-49a4415e7fca
15152024-12-19T05:53:10.730ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_58ae657f-f744-4b0b-a838-01074a6743ed") failed: Property not found. retry in 1.41746762s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_58ae657f-f744-4b0b-a838-01074a6743ed
15162024-12-19T05:53:10.748ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fa00fdf3-10e6-4350-898d-2ec64b75259e") failed: Property not found. retry in 1.158287244s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fa00fdf3-10e6-4350-898d-2ec64b75259e
15172024-12-19T05:53:10.798ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e027a9c4-2388-40aa-8459-5f776f88554d") failed: Property not found. retry in 762.212277ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e027a9c4-2388-40aa-8459-5f776f88554d
15182024-12-19T05:53:10.918ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4a60288a-de85-4cc2-97ae-0e9800cf70c5") failed: Property not found. retry in 1.267369047s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4a60288a-de85-4cc2-97ae-0e9800cf70c5
15192024-12-19T05:53:10.926ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6ae04bea-989b-4227-a44b-60ac3e1e9aa6") failed: Property not found. retry in 1.189180285s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6ae04bea-989b-4227-a44b-60ac3e1e9aa6
15202024-12-19T05:53:10.967ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1e0292d6-c327-472e-85e6-622aab78d10f") failed: Property not found. retry in 1.342084122s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1e0292d6-c327-472e-85e6-622aab78d10f
15212024-12-19T05:53:11.064ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_503e10f4-0146-46a7-bcc4-a71beb2225b2") failed: Property not found. retry in 774.604886ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_503e10f4-0146-46a7-bcc4-a71beb2225b2
15222024-12-19T05:53:11.110ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_75a56219-191b-4e5c-8eb1-d0e62e0c42f9") failed: Property not found. retry in 1.171888909s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_75a56219-191b-4e5c-8eb1-d0e62e0c42f9
15232024-12-19T05:53:11.139ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_831f544f-98b3-466d-855d-ee48ae395f0b") failed: Property not found. retry in 591.82708ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_831f544f-98b3-466d-855d-ee48ae395f0b
15242024-12-19T05:53:11.385ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5aa1584b-558f-482f-872a-fff1fa879759") failed: Property not found. retry in 1.05638322s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5aa1584b-558f-482f-872a-fff1fa879759
15252024-12-19T05:53:11.412ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1b05e3ee-34fc-4615-91df-a477e1a37258") failed: Property not found. retry in 877.034363ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1b05e3ee-34fc-4615-91df-a477e1a37258
15262024-12-19T05:53:11.549ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f534ccb4-1884-4b0c-b250-92aa7d3370a6") failed: Property not found. retry in 637.795706ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f534ccb4-1884-4b0c-b250-92aa7d3370a6
15272024-12-19T05:53:11.550ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_f6dcc1d5-458d-4c06-aac2-ae852ccaf5f0: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin-single"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:8123'/> <propval type="astring" name="ch_binary" value='/opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
15282024-12-19T05:53:11.560ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_f6dcc1d5-458d-4c06-aac2-ae852ccaf5f0 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_clickhouse_f6dcc1d5-458d-4c06-aac2-ae852ccaf5f0
15292024-12-19T05:53:11.574ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e027a9c4-2388-40aa-8459-5f776f88554d") failed: Property not found. retry in 770.188229ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e027a9c4-2388-40aa-8459-5f776f88554d
15302024-12-19T05:53:11.603ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7701880a-5341-4c52-93af-e0d5f29a4650") failed: Property not found. retry in 571.290648ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7701880a-5341-4c52-93af-e0d5f29a4650
15312024-12-19T05:53:11.681ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_94497aa9-1336-4df1-af83-5ca2d4a43909") failed: Property not found. retry in 1.366100033s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_94497aa9-1336-4df1-af83-5ca2d4a43909
15322024-12-19T05:53:11.709ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c32c373d-ccc1-45e0-bb27-49a4415e7fca") failed: Property not found. retry in 781.842053ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c32c373d-ccc1-45e0-bb27-49a4415e7fca
15332024-12-19T05:53:11.737ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_f6dcc1d5-458d-4c06-aac2-ae852ccaf5f0") failed: Property not found. retry in 47.948652ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_f6dcc1d5-458d-4c06-aac2-ae852ccaf5f0
15342024-12-19T05:53:11.746ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_831f544f-98b3-466d-855d-ee48ae395f0b") failed: Property not found. retry in 1.496252301s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_831f544f-98b3-466d-855d-ee48ae395f0b
15352024-12-19T05:53:11.756ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_bb4845ab-0600-4d61-a9f2-eb93a7cc0896") failed: Property not found. retry in 523.540491ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_bb4845ab-0600-4d61-a9f2-eb93a7cc0896
15362024-12-19T05:53:11.789ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e6d0c6fc-9f27-4b59-8b64-52d8f20ddfd9") failed: Property not found. retry in 565.905456ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e6d0c6fc-9f27-4b59-8b64-52d8f20ddfd9
15372024-12-19T05:53:11.797ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_f6dcc1d5-458d-4c06-aac2-ae852ccaf5f0") failed: Property not found. retry in 80.997163ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_f6dcc1d5-458d-4c06-aac2-ae852ccaf5f0
15382024-12-19T05:53:11.855ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_503e10f4-0146-46a7-bcc4-a71beb2225b2") failed: Property not found. retry in 1.308172084s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_503e10f4-0146-46a7-bcc4-a71beb2225b2
15392024-12-19T05:53:11.890ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_f6dcc1d5-458d-4c06-aac2-ae852ccaf5f0") failed: Property not found. retry in 212.639558ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_f6dcc1d5-458d-4c06-aac2-ae852ccaf5f0
15402024-12-19T05:53:11.921ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fa00fdf3-10e6-4350-898d-2ec64b75259e") failed: Property not found. retry in 602.288696ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fa00fdf3-10e6-4350-898d-2ec64b75259e
15412024-12-19T05:53:11.951ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_bf630637-78f3-4e20-a86d-c4f19712ebb4") failed: Property not found. retry in 762.968887ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_bf630637-78f3-4e20-a86d-c4f19712ebb4
15422024-12-19T05:53:12.113ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_f6dcc1d5-458d-4c06-aac2-ae852ccaf5f0") failed: Property not found. retry in 248.283313ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_f6dcc1d5-458d-4c06-aac2-ae852ccaf5f0
15432024-12-19T05:53:12.123ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6ae04bea-989b-4227-a44b-60ac3e1e9aa6") failed: Property not found. retry in 1.150617153s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6ae04bea-989b-4227-a44b-60ac3e1e9aa6
15442024-12-19T05:53:12.158ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_58ae657f-f744-4b0b-a838-01074a6743ed") failed: Property not found. retry in 1.027092322s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_58ae657f-f744-4b0b-a838-01074a6743ed
15452024-12-19T05:53:12.184ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7701880a-5341-4c52-93af-e0d5f29a4650") failed: Property not found. retry in 1.102767567s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7701880a-5341-4c52-93af-e0d5f29a4650
15462024-12-19T05:53:12.194ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4a60288a-de85-4cc2-97ae-0e9800cf70c5") failed: Property not found. retry in 704.959583ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4a60288a-de85-4cc2-97ae-0e9800cf70c5
15472024-12-19T05:53:12.202ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f534ccb4-1884-4b0c-b250-92aa7d3370a6") failed: Property not found. retry in 1.31888291s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f534ccb4-1884-4b0c-b250-92aa7d3370a6
15482024-12-19T05:53:12.288ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_bb4845ab-0600-4d61-a9f2-eb93a7cc0896") failed: Property not found. retry in 1.158955103s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_bb4845ab-0600-4d61-a9f2-eb93a7cc0896
15492024-12-19T05:53:12.295ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_75a56219-191b-4e5c-8eb1-d0e62e0c42f9") failed: Property not found. retry in 567.402627ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_75a56219-191b-4e5c-8eb1-d0e62e0c42f9
15502024-12-19T05:53:12.301ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1b05e3ee-34fc-4615-91df-a477e1a37258") failed: Property not found. retry in 1.073079837s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1b05e3ee-34fc-4615-91df-a477e1a37258
15512024-12-19T05:53:12.317ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1e0292d6-c327-472e-85e6-622aab78d10f") failed: Property not found. retry in 667.036474ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1e0292d6-c327-472e-85e6-622aab78d10f
15522024-12-19T05:53:12.356ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e027a9c4-2388-40aa-8459-5f776f88554d") failed: Property not found. retry in 1.226548515s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e027a9c4-2388-40aa-8459-5f776f88554d
15532024-12-19T05:53:12.365ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e6d0c6fc-9f27-4b59-8b64-52d8f20ddfd9") failed: Property not found. retry in 1.216452015s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e6d0c6fc-9f27-4b59-8b64-52d8f20ddfd9
15542024-12-19T05:53:12.374ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_f6dcc1d5-458d-4c06-aac2-ae852ccaf5f0") failed: Property not found. retry in 655.536895ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_f6dcc1d5-458d-4c06-aac2-ae852ccaf5f0
15552024-12-19T05:53:12.454ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5aa1584b-558f-482f-872a-fff1fa879759") failed: Property not found. retry in 1.080978604s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5aa1584b-558f-482f-872a-fff1fa879759
15562024-12-19T05:53:12.502ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c32c373d-ccc1-45e0-bb27-49a4415e7fca") failed: Property not found. retry in 1.046451878s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c32c373d-ccc1-45e0-bb27-49a4415e7fca
15572024-12-19T05:53:12.535ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fa00fdf3-10e6-4350-898d-2ec64b75259e") failed: Property not found. retry in 779.147904ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fa00fdf3-10e6-4350-898d-2ec64b75259e
15582024-12-19T05:53:12.725ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_bf630637-78f3-4e20-a86d-c4f19712ebb4") failed: Property not found. retry in 754.730746ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_bf630637-78f3-4e20-a86d-c4f19712ebb4
15592024-12-19T05:53:12.873ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_75a56219-191b-4e5c-8eb1-d0e62e0c42f9") failed: Property not found. retry in 593.414708ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_75a56219-191b-4e5c-8eb1-d0e62e0c42f9
15602024-12-19T05:53:12.912ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4a60288a-de85-4cc2-97ae-0e9800cf70c5") failed: Property not found. retry in 922.652127ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4a60288a-de85-4cc2-97ae-0e9800cf70c5
15612024-12-19T05:53:12.993ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1e0292d6-c327-472e-85e6-622aab78d10f") failed: Property not found. retry in 550.440741ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1e0292d6-c327-472e-85e6-622aab78d10f
15622024-12-19T05:53:13.041ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_f6dcc1d5-458d-4c06-aac2-ae852ccaf5f0") failed: Property not found. retry in 1.007300222s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_f6dcc1d5-458d-4c06-aac2-ae852ccaf5f0
15632024-12-19T05:53:13.058ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_94497aa9-1336-4df1-af83-5ca2d4a43909") failed: Property not found. retry in 956.877998ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_94497aa9-1336-4df1-af83-5ca2d4a43909
15642024-12-19T05:53:13.175ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_503e10f4-0146-46a7-bcc4-a71beb2225b2") failed: Property not found. retry in 907.581039ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_503e10f4-0146-46a7-bcc4-a71beb2225b2
15652024-12-19T05:53:13.196ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_58ae657f-f744-4b0b-a838-01074a6743ed") failed: Property not found. retry in 1.273666121s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_58ae657f-f744-4b0b-a838-01074a6743ed
15662024-12-19T05:53:13.256ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_831f544f-98b3-466d-855d-ee48ae395f0b") failed: Property not found. retry in 806.084032ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_831f544f-98b3-466d-855d-ee48ae395f0b
15672024-12-19T05:53:13.287ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6ae04bea-989b-4227-a44b-60ac3e1e9aa6") failed: Property not found. retry in 1.481643721s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6ae04bea-989b-4227-a44b-60ac3e1e9aa6
15682024-12-19T05:53:13.297ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7701880a-5341-4c52-93af-e0d5f29a4650") failed: Property not found. retry in 574.087973ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7701880a-5341-4c52-93af-e0d5f29a4650
15692024-12-19T05:53:13.326ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fa00fdf3-10e6-4350-898d-2ec64b75259e") failed: Property not found. retry in 905.093706ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fa00fdf3-10e6-4350-898d-2ec64b75259e
15702024-12-19T05:53:13.386ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1b05e3ee-34fc-4615-91df-a477e1a37258") failed: Property not found. retry in 1.043592949s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1b05e3ee-34fc-4615-91df-a477e1a37258
15712024-12-19T05:53:13.462ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_bb4845ab-0600-4d61-a9f2-eb93a7cc0896") failed: Property not found. retry in 506.955982ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_bb4845ab-0600-4d61-a9f2-eb93a7cc0896
15722024-12-19T05:53:13.481ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_75a56219-191b-4e5c-8eb1-d0e62e0c42f9") failed: Property not found. retry in 768.771968ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_75a56219-191b-4e5c-8eb1-d0e62e0c42f9
15732024-12-19T05:53:13.494ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_bf630637-78f3-4e20-a86d-c4f19712ebb4") failed: Property not found. retry in 1.072494522s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_bf630637-78f3-4e20-a86d-c4f19712ebb4
15742024-12-19T05:53:13.534ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f534ccb4-1884-4b0c-b250-92aa7d3370a6") failed: Property not found. retry in 1.032793958s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f534ccb4-1884-4b0c-b250-92aa7d3370a6
15752024-12-19T05:53:13.551ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5aa1584b-558f-482f-872a-fff1fa879759") failed: Property not found. retry in 504.663711ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5aa1584b-558f-482f-872a-fff1fa879759
15762024-12-19T05:53:13.564ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1e0292d6-c327-472e-85e6-622aab78d10f") failed: Property not found. retry in 1.476830375s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1e0292d6-c327-472e-85e6-622aab78d10f
15772024-12-19T05:53:13.575ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c32c373d-ccc1-45e0-bb27-49a4415e7fca") failed: Property not found. retry in 612.962629ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c32c373d-ccc1-45e0-bb27-49a4415e7fca
15782024-12-19T05:53:13.600ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e6d0c6fc-9f27-4b59-8b64-52d8f20ddfd9") failed: Property not found. retry in 1.396107311s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e6d0c6fc-9f27-4b59-8b64-52d8f20ddfd9
15792024-12-19T05:53:13.614ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e027a9c4-2388-40aa-8459-5f776f88554d") failed: Property not found. retry in 1.151936925s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e027a9c4-2388-40aa-8459-5f776f88554d
15802024-12-19T05:53:13.846ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4a60288a-de85-4cc2-97ae-0e9800cf70c5") failed: Property not found. retry in 722.371002ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4a60288a-de85-4cc2-97ae-0e9800cf70c5
15812024-12-19T05:53:13.885ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7701880a-5341-4c52-93af-e0d5f29a4650") failed: Property not found. retry in 950.407367ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7701880a-5341-4c52-93af-e0d5f29a4650
15822024-12-19T05:53:13.982ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_bb4845ab-0600-4d61-a9f2-eb93a7cc0896") failed: Property not found. retry in 1.371882022s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_bb4845ab-0600-4d61-a9f2-eb93a7cc0896
15832024-12-19T05:53:14.027ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_94497aa9-1336-4df1-af83-5ca2d4a43909") failed: Property not found. retry in 1.122733047s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_94497aa9-1336-4df1-af83-5ca2d4a43909
15842024-12-19T05:53:14.059ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_f6dcc1d5-458d-4c06-aac2-ae852ccaf5f0") failed: Property not found. retry in 1.040662551s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_f6dcc1d5-458d-4c06-aac2-ae852ccaf5f0
15852024-12-19T05:53:14.069ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5aa1584b-558f-482f-872a-fff1fa879759") failed: Property not found. retry in 713.845719ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5aa1584b-558f-482f-872a-fff1fa879759
15862024-12-19T05:53:14.078ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_831f544f-98b3-466d-855d-ee48ae395f0b") failed: Property not found. retry in 578.395651ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_831f544f-98b3-466d-855d-ee48ae395f0b
15872024-12-19T05:53:14.094ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_503e10f4-0146-46a7-bcc4-a71beb2225b2") failed: Property not found. retry in 1.416672084s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_503e10f4-0146-46a7-bcc4-a71beb2225b2
15882024-12-19T05:53:14.203ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c32c373d-ccc1-45e0-bb27-49a4415e7fca") failed: Property not found. retry in 1.47877161s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c32c373d-ccc1-45e0-bb27-49a4415e7fca
15892024-12-19T05:53:14.245ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fa00fdf3-10e6-4350-898d-2ec64b75259e") failed: Property not found. retry in 1.206570408s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fa00fdf3-10e6-4350-898d-2ec64b75259e
15902024-12-19T05:53:14.263ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_75a56219-191b-4e5c-8eb1-d0e62e0c42f9") failed: Property not found. retry in 1.039173412s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_75a56219-191b-4e5c-8eb1-d0e62e0c42f9
15912024-12-19T05:53:14.443ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1b05e3ee-34fc-4615-91df-a477e1a37258") failed: Property not found. retry in 835.285734ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1b05e3ee-34fc-4615-91df-a477e1a37258
15922024-12-19T05:53:14.484ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_58ae657f-f744-4b0b-a838-01074a6743ed") failed: Property not found. retry in 1.037265722s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_58ae657f-f744-4b0b-a838-01074a6743ed
15932024-12-19T05:53:14.582ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f534ccb4-1884-4b0c-b250-92aa7d3370a6") failed: Property not found. retry in 745.330705ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f534ccb4-1884-4b0c-b250-92aa7d3370a6
15942024-12-19T05:53:14.595ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_bf630637-78f3-4e20-a86d-c4f19712ebb4") failed: Property not found. retry in 1.394684556s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_bf630637-78f3-4e20-a86d-c4f19712ebb4
15952024-12-19T05:53:14.607ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4a60288a-de85-4cc2-97ae-0e9800cf70c5") failed: Property not found. retry in 829.567376ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4a60288a-de85-4cc2-97ae-0e9800cf70c5
15962024-12-19T05:53:14.670ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_831f544f-98b3-466d-855d-ee48ae395f0b") failed: Property not found. retry in 1.487024533s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_831f544f-98b3-466d-855d-ee48ae395f0b
15972024-12-19T05:53:14.780ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e027a9c4-2388-40aa-8459-5f776f88554d") failed: Property not found. retry in 630.994879ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e027a9c4-2388-40aa-8459-5f776f88554d
15982024-12-19T05:53:14.790ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6ae04bea-989b-4227-a44b-60ac3e1e9aa6") failed: Property not found. retry in 786.978166ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6ae04bea-989b-4227-a44b-60ac3e1e9aa6
15992024-12-19T05:53:14.799ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5aa1584b-558f-482f-872a-fff1fa879759") failed: Property not found. retry in 1.241831192s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5aa1584b-558f-482f-872a-fff1fa879759
16002024-12-19T05:53:14.845ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7701880a-5341-4c52-93af-e0d5f29a4650") failed: Property not found. retry in 972.052392ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7701880a-5341-4c52-93af-e0d5f29a4650
16012024-12-19T05:53:15.008ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e6d0c6fc-9f27-4b59-8b64-52d8f20ddfd9") failed: Property not found. retry in 1.308034828s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e6d0c6fc-9f27-4b59-8b64-52d8f20ddfd9
16022024-12-19T05:53:15.054ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1e0292d6-c327-472e-85e6-622aab78d10f") failed: Property not found. retry in 1.457727859s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1e0292d6-c327-472e-85e6-622aab78d10f
16032024-12-19T05:53:15.117ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_f6dcc1d5-458d-4c06-aac2-ae852ccaf5f0") failed: Property not found. retry in 945.427404ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_f6dcc1d5-458d-4c06-aac2-ae852ccaf5f0
16042024-12-19T05:53:15.170ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_94497aa9-1336-4df1-af83-5ca2d4a43909") failed: Property not found. retry in 796.620508ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_94497aa9-1336-4df1-af83-5ca2d4a43909
16052024-12-19T05:53:15.289ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1b05e3ee-34fc-4615-91df-a477e1a37258") failed: Property not found. retry in 942.542898ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1b05e3ee-34fc-4615-91df-a477e1a37258
16062024-12-19T05:53:15.311ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_75a56219-191b-4e5c-8eb1-d0e62e0c42f9") failed: Property not found. retry in 1.346595725s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_75a56219-191b-4e5c-8eb1-d0e62e0c42f9
16072024-12-19T05:53:15.341ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f534ccb4-1884-4b0c-b250-92aa7d3370a6") failed: Property not found. retry in 539.713856ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f534ccb4-1884-4b0c-b250-92aa7d3370a6
16082024-12-19T05:53:15.366ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_bb4845ab-0600-4d61-a9f2-eb93a7cc0896") failed: Property not found. retry in 1.082897418s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_bb4845ab-0600-4d61-a9f2-eb93a7cc0896
16092024-12-19T05:53:15.426ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e027a9c4-2388-40aa-8459-5f776f88554d") failed: Property not found. retry in 1.361056207s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e027a9c4-2388-40aa-8459-5f776f88554d
16102024-12-19T05:53:15.451ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4a60288a-de85-4cc2-97ae-0e9800cf70c5") failed: Property not found. retry in 1.423826386s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4a60288a-de85-4cc2-97ae-0e9800cf70c5
16112024-12-19T05:53:15.465ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fa00fdf3-10e6-4350-898d-2ec64b75259e") failed: Property not found. retry in 1.310479735s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fa00fdf3-10e6-4350-898d-2ec64b75259e
16122024-12-19T05:53:15.521ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_503e10f4-0146-46a7-bcc4-a71beb2225b2") failed: Property not found. retry in 838.218882ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_503e10f4-0146-46a7-bcc4-a71beb2225b2
16132024-12-19T05:53:15.533ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_58ae657f-f744-4b0b-a838-01074a6743ed") failed: Property not found. retry in 703.572973ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_58ae657f-f744-4b0b-a838-01074a6743ed
16142024-12-19T05:53:15.588ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6ae04bea-989b-4227-a44b-60ac3e1e9aa6") failed: Property not found. retry in 664.152604ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6ae04bea-989b-4227-a44b-60ac3e1e9aa6
16152024-12-19T05:53:15.707ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c32c373d-ccc1-45e0-bb27-49a4415e7fca") failed: Property not found. retry in 953.398012ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c32c373d-ccc1-45e0-bb27-49a4415e7fca
16162024-12-19T05:53:15.830ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7701880a-5341-4c52-93af-e0d5f29a4650") failed: Property not found. retry in 1.070629924s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7701880a-5341-4c52-93af-e0d5f29a4650
16172024-12-19T05:53:15.896ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f534ccb4-1884-4b0c-b250-92aa7d3370a6") failed: Property not found. retry in 599.540583ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f534ccb4-1884-4b0c-b250-92aa7d3370a6
16182024-12-19T05:53:15.977ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_94497aa9-1336-4df1-af83-5ca2d4a43909") failed: Property not found. retry in 1.334180088s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_94497aa9-1336-4df1-af83-5ca2d4a43909
16192024-12-19T05:53:16.000ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_bf630637-78f3-4e20-a86d-c4f19712ebb4") failed: Property not found. retry in 1.395547496s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_bf630637-78f3-4e20-a86d-c4f19712ebb4
16202024-12-19T05:53:16.052ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5aa1584b-558f-482f-872a-fff1fa879759") failed: Property not found. retry in 1.176458626s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5aa1584b-558f-482f-872a-fff1fa879759
16212024-12-19T05:53:16.074ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_f6dcc1d5-458d-4c06-aac2-ae852ccaf5f0") failed: Property not found. retry in 1.193773229s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_f6dcc1d5-458d-4c06-aac2-ae852ccaf5f0
16222024-12-19T05:53:16.168ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_831f544f-98b3-466d-855d-ee48ae395f0b") failed: Property not found. retry in 875.272722ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_831f544f-98b3-466d-855d-ee48ae395f0b
16232024-12-19T05:53:16.242ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1b05e3ee-34fc-4615-91df-a477e1a37258") failed: Property not found. retry in 854.234438ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1b05e3ee-34fc-4615-91df-a477e1a37258
16242024-12-19T05:53:16.251ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_58ae657f-f744-4b0b-a838-01074a6743ed") failed: Property not found. retry in 862.813906ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_58ae657f-f744-4b0b-a838-01074a6743ed
16252024-12-19T05:53:16.261ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6ae04bea-989b-4227-a44b-60ac3e1e9aa6") failed: Property not found. retry in 1.277944233s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6ae04bea-989b-4227-a44b-60ac3e1e9aa6
16262024-12-19T05:53:16.327ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e6d0c6fc-9f27-4b59-8b64-52d8f20ddfd9") failed: Property not found. retry in 584.898449ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e6d0c6fc-9f27-4b59-8b64-52d8f20ddfd9
16272024-12-19T05:53:16.372ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_503e10f4-0146-46a7-bcc4-a71beb2225b2") failed: Property not found. retry in 1.304206126s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_503e10f4-0146-46a7-bcc4-a71beb2225b2
16282024-12-19T05:53:16.465ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_bb4845ab-0600-4d61-a9f2-eb93a7cc0896") failed: Property not found. retry in 1.421080817s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_bb4845ab-0600-4d61-a9f2-eb93a7cc0896
16292024-12-19T05:53:16.506ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f534ccb4-1884-4b0c-b250-92aa7d3370a6") failed: Property not found. retry in 560.028552ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f534ccb4-1884-4b0c-b250-92aa7d3370a6
16302024-12-19T05:53:16.520ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1e0292d6-c327-472e-85e6-622aab78d10f") failed: Property not found. retry in 1.464844552s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1e0292d6-c327-472e-85e6-622aab78d10f
16312024-12-19T05:53:16.675ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_75a56219-191b-4e5c-8eb1-d0e62e0c42f9") failed: Property not found. retry in 978.658521ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_75a56219-191b-4e5c-8eb1-d0e62e0c42f9
16322024-12-19T05:53:16.689ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c32c373d-ccc1-45e0-bb27-49a4415e7fca") failed: Property not found. retry in 827.497427ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c32c373d-ccc1-45e0-bb27-49a4415e7fca
16332024-12-19T05:53:16.789ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fa00fdf3-10e6-4350-898d-2ec64b75259e") failed: Property not found. retry in 1.324893474s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fa00fdf3-10e6-4350-898d-2ec64b75259e
16342024-12-19T05:53:16.802ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e027a9c4-2388-40aa-8459-5f776f88554d") failed: Property not found. retry in 1.324927176s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e027a9c4-2388-40aa-8459-5f776f88554d
16352024-12-19T05:53:16.888ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4a60288a-de85-4cc2-97ae-0e9800cf70c5") failed: Property not found. retry in 1.096077436s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4a60288a-de85-4cc2-97ae-0e9800cf70c5
16362024-12-19T05:53:16.913ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7701880a-5341-4c52-93af-e0d5f29a4650") failed: Property not found. retry in 561.600583ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7701880a-5341-4c52-93af-e0d5f29a4650
16372024-12-19T05:53:16.923ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e6d0c6fc-9f27-4b59-8b64-52d8f20ddfd9") failed: Property not found. retry in 1.36666981s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e6d0c6fc-9f27-4b59-8b64-52d8f20ddfd9
16382024-12-19T05:53:17.059ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_831f544f-98b3-466d-855d-ee48ae395f0b") failed: Property not found. retry in 898.548169ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_831f544f-98b3-466d-855d-ee48ae395f0b
16392024-12-19T05:53:17.081ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f534ccb4-1884-4b0c-b250-92aa7d3370a6") failed: Property not found. retry in 1.305305915s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f534ccb4-1884-4b0c-b250-92aa7d3370a6
16402024-12-19T05:53:17.110ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1b05e3ee-34fc-4615-91df-a477e1a37258") failed: Property not found. retry in 724.157533ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1b05e3ee-34fc-4615-91df-a477e1a37258
16412024-12-19T05:53:17.128ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_58ae657f-f744-4b0b-a838-01074a6743ed") failed: Property not found. retry in 1.480913871s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_58ae657f-f744-4b0b-a838-01074a6743ed
16422024-12-19T05:53:17.243ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5aa1584b-558f-482f-872a-fff1fa879759") failed: Property not found. retry in 878.798873ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5aa1584b-558f-482f-872a-fff1fa879759
16432024-12-19T05:53:17.281ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_f6dcc1d5-458d-4c06-aac2-ae852ccaf5f0") failed: Property not found. retry in 1.009905553s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_f6dcc1d5-458d-4c06-aac2-ae852ccaf5f0
16442024-12-19T05:53:17.322ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_94497aa9-1336-4df1-af83-5ca2d4a43909") failed: Property not found. retry in 508.341744ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_94497aa9-1336-4df1-af83-5ca2d4a43909
16452024-12-19T05:53:17.409ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_bf630637-78f3-4e20-a86d-c4f19712ebb4") failed: Property not found. retry in 1.065532813s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_bf630637-78f3-4e20-a86d-c4f19712ebb4
16462024-12-19T05:53:17.490ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7701880a-5341-4c52-93af-e0d5f29a4650") failed: Property not found. retry in 901.79978ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7701880a-5341-4c52-93af-e0d5f29a4650
16472024-12-19T05:53:17.531ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c32c373d-ccc1-45e0-bb27-49a4415e7fca") failed: Property not found. retry in 1.167322042s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c32c373d-ccc1-45e0-bb27-49a4415e7fca
16482024-12-19T05:53:17.551ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6ae04bea-989b-4227-a44b-60ac3e1e9aa6") failed: Property not found. retry in 1.263258798s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6ae04bea-989b-4227-a44b-60ac3e1e9aa6
16492024-12-19T05:53:17.666ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_75a56219-191b-4e5c-8eb1-d0e62e0c42f9") failed: Property not found. retry in 662.612728ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_75a56219-191b-4e5c-8eb1-d0e62e0c42f9
16502024-12-19T05:53:17.688ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_503e10f4-0146-46a7-bcc4-a71beb2225b2") failed: Property not found. retry in 1.238321361s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_503e10f4-0146-46a7-bcc4-a71beb2225b2
16512024-12-19T05:53:17.846ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_94497aa9-1336-4df1-af83-5ca2d4a43909") failed: Property not found. retry in 1.273830036s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_94497aa9-1336-4df1-af83-5ca2d4a43909
16522024-12-19T05:53:17.861ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1b05e3ee-34fc-4615-91df-a477e1a37258") failed: Property not found. retry in 813.48933ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1b05e3ee-34fc-4615-91df-a477e1a37258
16532024-12-19T05:53:17.899ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_bb4845ab-0600-4d61-a9f2-eb93a7cc0896") failed: Property not found. retry in 1.386873354s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_bb4845ab-0600-4d61-a9f2-eb93a7cc0896
16542024-12-19T05:53:17.972ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_831f544f-98b3-466d-855d-ee48ae395f0b") failed: Property not found. retry in 720.70769ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_831f544f-98b3-466d-855d-ee48ae395f0b
16552024-12-19T05:53:18.000ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4a60288a-de85-4cc2-97ae-0e9800cf70c5") failed: Property not found. retry in 803.772669ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4a60288a-de85-4cc2-97ae-0e9800cf70c5
16562024-12-19T05:53:18.014ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1e0292d6-c327-472e-85e6-622aab78d10f") failed: Property not found. retry in 909.88935ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1e0292d6-c327-472e-85e6-622aab78d10f
16572024-12-19T05:53:18.131ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fa00fdf3-10e6-4350-898d-2ec64b75259e") failed: Property not found. retry in 1.017641032s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fa00fdf3-10e6-4350-898d-2ec64b75259e
16582024-12-19T05:53:18.146ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5aa1584b-558f-482f-872a-fff1fa879759") failed: Property not found. retry in 617.947439ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5aa1584b-558f-482f-872a-fff1fa879759
16592024-12-19T05:53:18.158ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e027a9c4-2388-40aa-8459-5f776f88554d") failed: Property not found. retry in 529.042253ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e027a9c4-2388-40aa-8459-5f776f88554d
16602024-12-19T05:53:18.303ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e6d0c6fc-9f27-4b59-8b64-52d8f20ddfd9") failed: Property not found. retry in 1.230157198s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e6d0c6fc-9f27-4b59-8b64-52d8f20ddfd9
16612024-12-19T05:53:18.317ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_f6dcc1d5-458d-4c06-aac2-ae852ccaf5f0") failed: Property not found. retry in 915.235374ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_f6dcc1d5-458d-4c06-aac2-ae852ccaf5f0
16622024-12-19T05:53:18.341ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_75a56219-191b-4e5c-8eb1-d0e62e0c42f9") failed: Property not found. retry in 884.083457ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_75a56219-191b-4e5c-8eb1-d0e62e0c42f9
16632024-12-19T05:53:18.398ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f534ccb4-1884-4b0c-b250-92aa7d3370a6") failed: Property not found. retry in 1.38577868s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f534ccb4-1884-4b0c-b250-92aa7d3370a6
16642024-12-19T05:53:18.410ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7701880a-5341-4c52-93af-e0d5f29a4650") failed: Property not found. retry in 1.021536375s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7701880a-5341-4c52-93af-e0d5f29a4650
16652024-12-19T05:53:18.486ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_bf630637-78f3-4e20-a86d-c4f19712ebb4") failed: Property not found. retry in 522.641019ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_bf630637-78f3-4e20-a86d-c4f19712ebb4
16662024-12-19T05:53:18.619ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_58ae657f-f744-4b0b-a838-01074a6743ed") failed: Property not found. retry in 702.067877ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_58ae657f-f744-4b0b-a838-01074a6743ed
16672024-12-19T05:53:18.690ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1b05e3ee-34fc-4615-91df-a477e1a37258") failed: Property not found. retry in 1.458620588s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1b05e3ee-34fc-4615-91df-a477e1a37258
16682024-12-19T05:53:18.699ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e027a9c4-2388-40aa-8459-5f776f88554d") failed: Property not found. retry in 851.13984ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e027a9c4-2388-40aa-8459-5f776f88554d
16692024-12-19T05:53:18.706ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_831f544f-98b3-466d-855d-ee48ae395f0b") failed: Property not found. retry in 676.104443ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_831f544f-98b3-466d-855d-ee48ae395f0b
16702024-12-19T05:53:18.714ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c32c373d-ccc1-45e0-bb27-49a4415e7fca") failed: Property not found. retry in 1.49087654s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c32c373d-ccc1-45e0-bb27-49a4415e7fca
16712024-12-19T05:53:18.773ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5aa1584b-558f-482f-872a-fff1fa879759") failed: Property not found. retry in 726.373601ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5aa1584b-558f-482f-872a-fff1fa879759
16722024-12-19T05:53:18.811ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4a60288a-de85-4cc2-97ae-0e9800cf70c5") failed: Property not found. retry in 1.110115153s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4a60288a-de85-4cc2-97ae-0e9800cf70c5
16732024-12-19T05:53:18.822ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6ae04bea-989b-4227-a44b-60ac3e1e9aa6") failed: Property not found. retry in 1.394035656s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6ae04bea-989b-4227-a44b-60ac3e1e9aa6
16742024-12-19T05:53:18.934ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1e0292d6-c327-472e-85e6-622aab78d10f") failed: Property not found. retry in 992.770605ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1e0292d6-c327-472e-85e6-622aab78d10f
16752024-12-19T05:53:18.943ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_503e10f4-0146-46a7-bcc4-a71beb2225b2") failed: Property not found. retry in 818.956687ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_503e10f4-0146-46a7-bcc4-a71beb2225b2
16762024-12-19T05:53:19.019ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_bf630637-78f3-4e20-a86d-c4f19712ebb4") failed: Property not found. retry in 978.503904ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_bf630637-78f3-4e20-a86d-c4f19712ebb4
16772024-12-19T05:53:19.131ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_94497aa9-1336-4df1-af83-5ca2d4a43909") failed: Property not found. retry in 1.467824249s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_94497aa9-1336-4df1-af83-5ca2d4a43909
16782024-12-19T05:53:19.160ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fa00fdf3-10e6-4350-898d-2ec64b75259e") failed: Property not found. retry in 1.144205853s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fa00fdf3-10e6-4350-898d-2ec64b75259e
16792024-12-19T05:53:19.235ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_75a56219-191b-4e5c-8eb1-d0e62e0c42f9") failed: Property not found. retry in 613.595956ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_75a56219-191b-4e5c-8eb1-d0e62e0c42f9
16802024-12-19T05:53:19.242ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_f6dcc1d5-458d-4c06-aac2-ae852ccaf5f0") failed: Property not found. retry in 1.267884533s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_f6dcc1d5-458d-4c06-aac2-ae852ccaf5f0
16812024-12-19T05:53:19.296ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_bb4845ab-0600-4d61-a9f2-eb93a7cc0896") failed: Property not found. retry in 612.381147ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_bb4845ab-0600-4d61-a9f2-eb93a7cc0896
16822024-12-19T05:53:19.331ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_58ae657f-f744-4b0b-a838-01074a6743ed") failed: Property not found. retry in 1.184161861s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_58ae657f-f744-4b0b-a838-01074a6743ed
16832024-12-19T05:53:19.400ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_831f544f-98b3-466d-855d-ee48ae395f0b") failed: Property not found. retry in 567.672088ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_831f544f-98b3-466d-855d-ee48ae395f0b
16842024-12-19T05:53:19.441ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7701880a-5341-4c52-93af-e0d5f29a4650") failed: Property not found. retry in 1.453714597s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7701880a-5341-4c52-93af-e0d5f29a4650
16852024-12-19T05:53:19.508ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5aa1584b-558f-482f-872a-fff1fa879759") failed: Property not found. retry in 918.56937ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5aa1584b-558f-482f-872a-fff1fa879759
16862024-12-19T05:53:19.543ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e6d0c6fc-9f27-4b59-8b64-52d8f20ddfd9") failed: Property not found. retry in 1.100713974s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e6d0c6fc-9f27-4b59-8b64-52d8f20ddfd9
16872024-12-19T05:53:19.559ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e027a9c4-2388-40aa-8459-5f776f88554d") failed: Property not found. retry in 1.196471521s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e027a9c4-2388-40aa-8459-5f776f88554d
16882024-12-19T05:53:19.772ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_503e10f4-0146-46a7-bcc4-a71beb2225b2") failed: Property not found. retry in 551.074378ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_503e10f4-0146-46a7-bcc4-a71beb2225b2
16892024-12-19T05:53:19.796ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f534ccb4-1884-4b0c-b250-92aa7d3370a6") failed: Property not found. retry in 908.115307ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f534ccb4-1884-4b0c-b250-92aa7d3370a6
16902024-12-19T05:53:19.857ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_75a56219-191b-4e5c-8eb1-d0e62e0c42f9") failed: Property not found. retry in 648.483756ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_75a56219-191b-4e5c-8eb1-d0e62e0c42f9
16912024-12-19T05:53:19.917ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_bb4845ab-0600-4d61-a9f2-eb93a7cc0896") failed: Property not found. retry in 583.175211ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_bb4845ab-0600-4d61-a9f2-eb93a7cc0896
16922024-12-19T05:53:19.930ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4a60288a-de85-4cc2-97ae-0e9800cf70c5") failed: Property not found. retry in 569.839725ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4a60288a-de85-4cc2-97ae-0e9800cf70c5
16932024-12-19T05:53:19.937ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1e0292d6-c327-472e-85e6-622aab78d10f") failed: Property not found. retry in 1.257789677s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1e0292d6-c327-472e-85e6-622aab78d10f
16942024-12-19T05:53:19.979ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_831f544f-98b3-466d-855d-ee48ae395f0b") failed: Property not found. retry in 1.143713044s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_831f544f-98b3-466d-855d-ee48ae395f0b
16952024-12-19T05:53:20.008ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_bf630637-78f3-4e20-a86d-c4f19712ebb4") failed: Property not found. retry in 1.070599642s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_bf630637-78f3-4e20-a86d-c4f19712ebb4
16962024-12-19T05:53:20.160ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1b05e3ee-34fc-4615-91df-a477e1a37258") failed: Property not found. retry in 908.510659ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1b05e3ee-34fc-4615-91df-a477e1a37258
16972024-12-19T05:53:20.216ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c32c373d-ccc1-45e0-bb27-49a4415e7fca") failed: Property not found. retry in 1.350034673s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c32c373d-ccc1-45e0-bb27-49a4415e7fca
16982024-12-19T05:53:20.225ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6ae04bea-989b-4227-a44b-60ac3e1e9aa6") failed: Property not found. retry in 1.492188897s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6ae04bea-989b-4227-a44b-60ac3e1e9aa6
16992024-12-19T05:53:20.318ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fa00fdf3-10e6-4350-898d-2ec64b75259e") failed: Property not found. retry in 632.717401ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fa00fdf3-10e6-4350-898d-2ec64b75259e
17002024-12-19T05:53:20.334ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_503e10f4-0146-46a7-bcc4-a71beb2225b2") failed: Property not found. retry in 1.378743291s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_503e10f4-0146-46a7-bcc4-a71beb2225b2
17012024-12-19T05:53:20.510ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4a60288a-de85-4cc2-97ae-0e9800cf70c5") failed: Property not found. retry in 837.821052ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4a60288a-de85-4cc2-97ae-0e9800cf70c5
17022024-12-19T05:53:20.556ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_58ae657f-f744-4b0b-a838-01074a6743ed") failed: Property not found. retry in 1.38805803s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_58ae657f-f744-4b0b-a838-01074a6743ed
17032024-12-19T05:53:20.567ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_f6dcc1d5-458d-4c06-aac2-ae852ccaf5f0") failed: Property not found. retry in 504.19838ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_f6dcc1d5-458d-4c06-aac2-ae852ccaf5f0
17042024-12-19T05:53:21.979ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_nexus_1b05e3ee-34fc-4615-91df-a477e1a37258
17052024-12-19T05:53:21.979ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_831f544f-98b3-466d-855d-ee48ae395f0b
17062024-12-19T05:53:21.979ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_4a60288a-de85-4cc2-97ae-0e9800cf70c5
17072024-12-19T05:53:21.979ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_6ae04bea-989b-4227-a44b-60ac3e1e9aa6
17082024-12-19T05:53:21.979ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_external_dns_75a56219-191b-4e5c-8eb1-d0e62e0c42f9
17092024-12-19T05:53:21.979ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_pantry_94497aa9-1336-4df1-af83-5ca2d4a43909
17102024-12-19T05:53:21.979ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_nexus_1e0292d6-c327-472e-85e6-622aab78d10f
17112024-12-19T05:53:21.979ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_58ae657f-f744-4b0b-a838-01074a6743ed
17122024-12-19T05:53:21.979ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_e6d0c6fc-9f27-4b59-8b64-52d8f20ddfd9
17132024-12-19T05:53:21.979ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_f534ccb4-1884-4b0c-b250-92aa7d3370a6
17142024-12-19T05:53:21.979ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_external_dns_bb4845ab-0600-4d61-a9f2-eb93a7cc0896
17152024-12-19T05:53:21.979ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_clickhouse_f6dcc1d5-458d-4c06-aac2-ae852ccaf5f0
17162024-12-19T05:53:21.979ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_pantry_7701880a-5341-4c52-93af-e0d5f29a4650
17172024-12-19T05:53:21.979ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_503e10f4-0146-46a7-bcc4-a71beb2225b2
17182024-12-19T05:53:21.979ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_pantry_5aa1584b-558f-482f-872a-fff1fa879759
17192024-12-19T05:53:21.979ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_e027a9c4-2388-40aa-8459-5f776f88554d
17202024-12-19T05:53:21.979ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_fa00fdf3-10e6-4350-898d-2ec64b75259e
17212024-12-19T05:53:21.979ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_nexus_c32c373d-ccc1-45e0-bb27-49a4415e7fca
17222024-12-19T05:53:21.979ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_oximeter_bf630637-78f3-4e20-a86d-c4f19712ebb4
17232024-12-19T05:53:21.980ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/e0de026f-6896-43b8-9686-b840d0967c1e/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
17242024-12-19T05:53:21.982ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/d2802dae-55e1-4039-8308-ca231b2dc40c/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
17252024-12-19T05:53:21.987ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41417150 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:55778 req_id = 8c77d36f-9ece-44c0-a82e-0fe42f639ec9 response_code = 204 uri = /omicron-zones
17262024-12-19T05:53:21.995ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1415
17272024-12-19T05:53:22.216ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:790
17282024-12-19T05:53:22.217ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::c]:12221 file = sled-agent/src/rack_setup/service.rs:802
17292024-12-19T05:53:22.265ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, rib_priority: None, vlan_id: None, }, ], switch: Switch0, tx_eq: None, uplink_port_fec: Some( None, ), uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:1016
17302024-12-19T05:53:23.720ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 150.344914022s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = a9851483-adb5-4271-9f27-41db71133b55
17312024-12-19T05:53:24.178ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:56182
17322024-12-19T05:53:24.178ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 161 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:56182 req_id = ffdaafc9-0ac6-4df2-b9bd-0240667a5a13 response_code = 200 uri = /baseboard
17332024-12-19T05:53:24.878ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/0a0969bd-a4d0-497b-839e-e0d088b15b4e/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17342024-12-19T05:53:24.949ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/0a0969bd-a4d0-497b-839e-e0d088b15b4e/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17352024-12-19T05:53:25.027ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/0a0969bd-a4d0-497b-839e-e0d088b15b4e/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17362024-12-19T05:53:25.195ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/0a0969bd-a4d0-497b-839e-e0d088b15b4e/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17372024-12-19T05:53:25.360ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/0a0969bd-a4d0-497b-839e-e0d088b15b4e/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17382024-12-19T05:53:25.534ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/0a0969bd-a4d0-497b-839e-e0d088b15b4e/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17392024-12-19T05:53:25.804ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/0a0969bd-a4d0-497b-839e-e0d088b15b4e/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17402024-12-19T05:53:26.044ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/0a0969bd-a4d0-497b-839e-e0d088b15b4e/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17412024-12-19T05:53:26.374ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/0a0969bd-a4d0-497b-839e-e0d088b15b4e/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17422024-12-19T05:53:26.734ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/0a0969bd-a4d0-497b-839e-e0d088b15b4e/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17432024-12-19T05:53:27.238ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/0a0969bd-a4d0-497b-839e-e0d088b15b4e/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17442024-12-19T05:53:27.870ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/0a0969bd-a4d0-497b-839e-e0d088b15b4e/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17452024-12-19T05:53:28.472ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/0a0969bd-a4d0-497b-839e-e0d088b15b4e/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17462024-12-19T05:53:29.802ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "215d608f-2845-41f8-8742-c2b820aa09ff", "content-length": "173", "date": "Thu, 19 Dec 2024 05:53:29 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"0a0969bd-a4d0-497b-839e-e0d088b15b4e\"", request_id: "215d608f-2845-41f8-8742-c2b820aa09ff" } file = sled-agent/src/rack_setup/service.rs:1078
17472024-12-19T05:53:30.614ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "0b5cd12b-5801-4c34-8ba5-bd21173bf005", "content-length": "173", "date": "Thu, 19 Dec 2024 05:53:30 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"0a0969bd-a4d0-497b-839e-e0d088b15b4e\"", request_id: "0b5cd12b-5801-4c34-8ba5-bd21173bf005" } file = sled-agent/src/rack_setup/service.rs:1078
17482024-12-19T05:53:31.407ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "742aff31-4a25-4088-a3a5-7961e487ed1e", "content-length": "173", "date": "Thu, 19 Dec 2024 05:53:30 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"0a0969bd-a4d0-497b-839e-e0d088b15b4e\"", request_id: "742aff31-4a25-4088-a3a5-7961e487ed1e" } file = sled-agent/src/rack_setup/service.rs:1078
17492024-12-19T05:53:33.196ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "03ed38e0-4edd-40f7-8acc-102621aec175", "content-length": "173", "date": "Thu, 19 Dec 2024 05:53:32 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"a9851483-adb5-4271-9f27-41db71133b55\"", request_id: "03ed38e0-4edd-40f7-8acc-102621aec175" } file = sled-agent/src/rack_setup/service.rs:1078
17502024-12-19T05:53:36.153ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "6aea5bcc-b7b3-49db-ba24-2a57a357aed5", "content-length": "173", "date": "Thu, 19 Dec 2024 05:53:35 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"a9851483-adb5-4271-9f27-41db71133b55\"", request_id: "6aea5bcc-b7b3-49db-ba24-2a57a357aed5" } file = sled-agent/src/rack_setup/service.rs:1078
17512024-12-19T05:53:38.623ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "f16a5046-3198-4998-824c-d76201bc0c76", "content-length": "173", "date": "Thu, 19 Dec 2024 05:53:38 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"a9851483-adb5-4271-9f27-41db71133b55\"", request_id: "f16a5046-3198-4998-824c-d76201bc0c76" } file = sled-agent/src/rack_setup/service.rs:1078
17522024-12-19T05:53:42.438ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "b6630e10-5f8b-49be-8f9c-f7355743b7f3", "content-length": "173", "date": "Thu, 19 Dec 2024 05:53:42 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"a9851483-adb5-4271-9f27-41db71133b55\"", request_id: "b6630e10-5f8b-49be-8f9c-f7355743b7f3" } file = sled-agent/src/rack_setup/service.rs:1078
17532024-12-19T05:53:45.959ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "62d38fd1-869f-42b6-bc73-c66a79549db8", "content-length": "173", "date": "Thu, 19 Dec 2024 05:53:45 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"a9851483-adb5-4271-9f27-41db71133b55\"", request_id: "62d38fd1-869f-42b6-bc73-c66a79549db8" } file = sled-agent/src/rack_setup/service.rs:1078
17542024-12-19T05:53:48.257ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "b4265bae-c6ab-4970-87ea-ca91f3f1fe7b", "content-length": "173", "date": "Thu, 19 Dec 2024 05:53:48 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"a9851483-adb5-4271-9f27-41db71133b55\"", request_id: "b4265bae-c6ab-4970-87ea-ca91f3f1fe7b" } file = sled-agent/src/rack_setup/service.rs:1078
17552024-12-19T05:53:52.802ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "e5dc52d8-2f0d-457f-9b83-6d1756e816b4", "content-length": "173", "date": "Thu, 19 Dec 2024 05:53:52 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"a9851483-adb5-4271-9f27-41db71133b55\"", request_id: "e5dc52d8-2f0d-457f-9b83-6d1756e816b4" } file = sled-agent/src/rack_setup/service.rs:1078
17562024-12-19T05:53:54.223ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:57577
17572024-12-19T05:53:54.223ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 28 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:57577 req_id = 72a5795a-ea19-442c-97e0-ee289d51e487 response_code = 200 uri = /baseboard
17582024-12-19T05:53:59.455ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "df502dc5-8ba0-455a-ad6f-ad496665634b", "content-length": "173", "date": "Thu, 19 Dec 2024 05:53:59 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"a9851483-adb5-4271-9f27-41db71133b55\"", request_id: "df502dc5-8ba0-455a-ad6f-ad496665634b" } file = sled-agent/src/rack_setup/service.rs:1078
17592024-12-19T05:54:00.640ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:500 new_generation = 1 old_generation = 1 sled_id = a9851483-adb5-4271-9f27-41db71133b55
17602024-12-19T05:54:00.728ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58121
17612024-12-19T05:54:00.729ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
17622024-12-19T05:54:00.729ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
17632024-12-19T05:54:00.729ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/e0de026f-6896-43b8-9686-b840d0967c1e/config/omicron-zones.json file = common/src/ledger.rs:177
17642024-12-19T05:54:00.730ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/d2802dae-55e1-4039-8308-ca231b2dc40c/config/omicron-zones.json file = common/src/ledger.rs:177
17652024-12-19T05:54:00.745ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f1c83160-c846-4e0a-a537-6a326722ac5a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17662024-12-19T05:54:00.745ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_f1c83160-c846-4e0a-a537-6a326722ac5a
17672024-12-19T05:54:00.770ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 436ef9e1-c612-46c3-866b-9e48c044fdf2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17682024-12-19T05:54:00.770ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_436ef9e1-c612-46c3-866b-9e48c044fdf2
17692024-12-19T05:54:00.797ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: defcb6a1-2bbe-47a6-a426-436ed60fd6fc (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17702024-12-19T05:54:00.797ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_defcb6a1-2bbe-47a6-a426-436ed60fd6fc
17712024-12-19T05:54:00.821ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a0552d97-e3e6-4586-a789-e6bcdec66672 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17722024-12-19T05:54:00.821ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_a0552d97-e3e6-4586-a789-e6bcdec66672
17732024-12-19T05:54:00.840ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 0cdd8476-a0d8-44ca-a74b-0704c56ede98 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17742024-12-19T05:54:00.840ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_0cdd8476-a0d8-44ca-a74b-0704c56ede98
17752024-12-19T05:54:00.859ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 0686bda3-5eb8-4859-ac7b-e5a6ceb8616d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17762024-12-19T05:54:00.859ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_0686bda3-5eb8-4859-ac7b-e5a6ceb8616d
17772024-12-19T05:54:00.879ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1fd2ac0f-93a9-44e1-a6b3-7ccfcdc6b252 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17782024-12-19T05:54:00.879ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_1fd2ac0f-93a9-44e1-a6b3-7ccfcdc6b252
17792024-12-19T05:54:00.897ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b5578c06-5ed8-4225-9470-d661174b141e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17802024-12-19T05:54:00.898ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_b5578c06-5ed8-4225-9470-d661174b141e
17812024-12-19T05:54:00.922ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c12c68d5-6ddb-4829-80b0-49f80baef150 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17822024-12-19T05:54:00.922ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_c12c68d5-6ddb-4829-80b0-49f80baef150
17832024-12-19T05:54:00.941ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 212049 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58121 req_id = e8d82551-3e20-4d17-86f8-95264a49e3a0 response_code = 200 uri = /inventory
17842024-12-19T05:54:01.067ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33316
17852024-12-19T05:54:01.067ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33316 req_id = 199441ab-a21b-49eb-8b6b-1ab6328b73aa response_code = 200 uri = /vpc-routes
17862024-12-19T05:54:01.086ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = a9851483-adb5-4271-9f27-41db71133b55 values = ExternalIpGatewayMap { mappings: {} }
17872024-12-19T05:54:01.086ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1288 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33316 req_id = 61829b53-a7cc-4ce9-9293-2b0cb227fa9b response_code = 204 uri = /eip-gateways
17882024-12-19T05:54:01.170ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59391
17892024-12-19T05:54:01.170ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 299 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59391 req_id = ea793e69-6bca-4623-8e83-e51e6263fa33 response_code = 200 uri = /v2p
17902024-12-19T05:54:01.237ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1468 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33316 req_id = 9d38ff32-d2bf-4903-96cb-ac440fa96eda response_code = 204 uri = /vpc-routes
17912024-12-19T05:54:02.099ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36375
17922024-12-19T05:54:02.099ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36375 req_id = dde5ef90-1668-4fe7-a531-bb06715596a6 response_code = 200 uri = /vpc-routes
17932024-12-19T05:54:02.116ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = a9851483-adb5-4271-9f27-41db71133b55 values = ExternalIpGatewayMap { mappings: {} }
17942024-12-19T05:54:02.116ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36375 req_id = 4fb5f482-d835-4cc1-b73e-45ac366ede35 response_code = 204 uri = /eip-gateways
17952024-12-19T05:54:02.128ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36375 req_id = b90c32e8-f61c-47bb-9390-664d3b493291 response_code = 204 uri = /vpc-routes
17962024-12-19T05:54:02.182ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62812
17972024-12-19T05:54:02.182ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62812 req_id = 5c03463c-b89a-44fb-a45b-1bf6f9a682bd response_code = 200 uri = /v2p
17982024-12-19T05:54:08.100ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43646
17992024-12-19T05:54:08.101ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 9a77c36e-7345-430e-9e83-8c3363325e9b, kind: Service { id: 75a56219-191b-4e5c-8eb1-d0e62e0c42f9 }, name: Name("external-dns-75a56219-191b-4e5c-8eb1-d0e62e0c42f9"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 10])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9edfb32a-e2bb-4e56-b9b4-ce860f893b5e, kind: Service { id: bb4845ab-0600-4d61-a9f2-eb93a7cc0896 }, name: Name("external-dns-bb4845ab-0600-4d61-a9f2-eb93a7cc0896"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 241])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 24da1f38-f5d2-4b50-a6f0-27b3479e0f93, kind: Service { id: 1b05e3ee-34fc-4615-91df-a477e1a37258 }, name: Name("nexus-1b05e3ee-34fc-4615-91df-a477e1a37258"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 52])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 37828052-0f7a-4cca-a068-121a8b67e439, kind: Service { id: c32c373d-ccc1-45e0-bb27-49a4415e7fca }, name: Name("nexus-c32c373d-ccc1-45e0-bb27-49a4415e7fca"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 144, 193])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a59ef66c-a1c5-4c9a-a337-f2d47efa332a, kind: Service { id: 1e0292d6-c327-472e-85e6-622aab78d10f }, name: Name("nexus-1e0292d6-c327-472e-85e6-622aab78d10f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 168, 229])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18002024-12-19T05:54:08.101ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18012024-12-19T05:54:08.101ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18022024-12-19T05:54:08.101ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
18032024-12-19T05:54:08.101ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18042024-12-19T05:54:08.101ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18052024-12-19T05:54:08.101ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18062024-12-19T05:54:08.101ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1076 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43646 req_id = ae643ed8-d362-4e85-b827-7b7a1380f596 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18072024-12-19T05:54:08.102ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:1088
18082024-12-19T05:54:08.105ZINFOSledAgent (RSS): Writing ledger to /pool/int/e0de026f-6896-43b8-9686-b840d0967c1e/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
18092024-12-19T05:54:08.105ZINFOSledAgent (RSS): Writing ledger to /pool/int/d2802dae-55e1-4039-8308-ca231b2dc40c/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
18102024-12-19T05:54:08.342ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44420
18112024-12-19T05:54:08.342ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
18122024-12-19T05:54:08.342ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
18132024-12-19T05:54:08.342ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/e0de026f-6896-43b8-9686-b840d0967c1e/config/omicron-zones.json file = common/src/ledger.rs:177
18142024-12-19T05:54:08.342ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/d2802dae-55e1-4039-8308-ca231b2dc40c/config/omicron-zones.json file = common/src/ledger.rs:177
18152024-12-19T05:54:08.355ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f1c83160-c846-4e0a-a537-6a326722ac5a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18162024-12-19T05:54:08.355ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_f1c83160-c846-4e0a-a537-6a326722ac5a
18172024-12-19T05:54:08.380ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 436ef9e1-c612-46c3-866b-9e48c044fdf2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18182024-12-19T05:54:08.380ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_436ef9e1-c612-46c3-866b-9e48c044fdf2
18192024-12-19T05:54:08.403ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: defcb6a1-2bbe-47a6-a426-436ed60fd6fc (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18202024-12-19T05:54:08.403ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_defcb6a1-2bbe-47a6-a426-436ed60fd6fc
18212024-12-19T05:54:08.430ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a0552d97-e3e6-4586-a789-e6bcdec66672 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18222024-12-19T05:54:08.430ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_a0552d97-e3e6-4586-a789-e6bcdec66672
18232024-12-19T05:54:08.451ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 0cdd8476-a0d8-44ca-a74b-0704c56ede98 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18242024-12-19T05:54:08.451ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_0cdd8476-a0d8-44ca-a74b-0704c56ede98
18252024-12-19T05:54:08.471ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 0686bda3-5eb8-4859-ac7b-e5a6ceb8616d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18262024-12-19T05:54:08.471ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_0686bda3-5eb8-4859-ac7b-e5a6ceb8616d
18272024-12-19T05:54:08.494ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1fd2ac0f-93a9-44e1-a6b3-7ccfcdc6b252 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18282024-12-19T05:54:08.494ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_1fd2ac0f-93a9-44e1-a6b3-7ccfcdc6b252
18292024-12-19T05:54:08.518ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b5578c06-5ed8-4225-9470-d661174b141e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18302024-12-19T05:54:08.518ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_b5578c06-5ed8-4225-9470-d661174b141e
18312024-12-19T05:54:08.541ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c12c68d5-6ddb-4829-80b0-49f80baef150 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18322024-12-19T05:54:08.541ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_c12c68d5-6ddb-4829-80b0-49f80baef150
18332024-12-19T05:54:08.553ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 211207 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44420 req_id = 623e8e10-04ff-4b4d-90d3-7321ed7a1bb1 response_code = 200 uri = /inventory
18342024-12-19T05:54:08.571ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34828
18352024-12-19T05:54:08.572ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 9a77c36e-7345-430e-9e83-8c3363325e9b, kind: Service { id: 75a56219-191b-4e5c-8eb1-d0e62e0c42f9 }, name: Name("external-dns-75a56219-191b-4e5c-8eb1-d0e62e0c42f9"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 10])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9edfb32a-e2bb-4e56-b9b4-ce860f893b5e, kind: Service { id: bb4845ab-0600-4d61-a9f2-eb93a7cc0896 }, name: Name("external-dns-bb4845ab-0600-4d61-a9f2-eb93a7cc0896"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 241])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 24da1f38-f5d2-4b50-a6f0-27b3479e0f93, kind: Service { id: 1b05e3ee-34fc-4615-91df-a477e1a37258 }, name: Name("nexus-1b05e3ee-34fc-4615-91df-a477e1a37258"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 52])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 37828052-0f7a-4cca-a068-121a8b67e439, kind: Service { id: c32c373d-ccc1-45e0-bb27-49a4415e7fca }, name: Name("nexus-c32c373d-ccc1-45e0-bb27-49a4415e7fca"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 144, 193])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a59ef66c-a1c5-4c9a-a337-f2d47efa332a, kind: Service { id: 1e0292d6-c327-472e-85e6-622aab78d10f }, name: Name("nexus-1e0292d6-c327-472e-85e6-622aab78d10f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 168, 229])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18362024-12-19T05:54:08.572ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18372024-12-19T05:54:08.572ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18382024-12-19T05:54:08.572ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
18392024-12-19T05:54:08.572ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18402024-12-19T05:54:08.572ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18412024-12-19T05:54:08.572ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18422024-12-19T05:54:08.572ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 327 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34828 req_id = facb4ca2-9266-467c-8dd1-266aca9739a8 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18432024-12-19T05:54:08.717ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48200
18442024-12-19T05:54:08.717ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 9a77c36e-7345-430e-9e83-8c3363325e9b, kind: Service { id: 75a56219-191b-4e5c-8eb1-d0e62e0c42f9 }, name: Name("external-dns-75a56219-191b-4e5c-8eb1-d0e62e0c42f9"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 10])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9edfb32a-e2bb-4e56-b9b4-ce860f893b5e, kind: Service { id: bb4845ab-0600-4d61-a9f2-eb93a7cc0896 }, name: Name("external-dns-bb4845ab-0600-4d61-a9f2-eb93a7cc0896"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 241])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 24da1f38-f5d2-4b50-a6f0-27b3479e0f93, kind: Service { id: 1b05e3ee-34fc-4615-91df-a477e1a37258 }, name: Name("nexus-1b05e3ee-34fc-4615-91df-a477e1a37258"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 52])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 37828052-0f7a-4cca-a068-121a8b67e439, kind: Service { id: c32c373d-ccc1-45e0-bb27-49a4415e7fca }, name: Name("nexus-c32c373d-ccc1-45e0-bb27-49a4415e7fca"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 144, 193])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a59ef66c-a1c5-4c9a-a337-f2d47efa332a, kind: Service { id: 1e0292d6-c327-472e-85e6-622aab78d10f }, name: Name("nexus-1e0292d6-c327-472e-85e6-622aab78d10f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 168, 229])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18452024-12-19T05:54:08.717ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18462024-12-19T05:54:08.717ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18472024-12-19T05:54:08.717ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
18482024-12-19T05:54:08.717ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18492024-12-19T05:54:08.717ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18502024-12-19T05:54:08.717ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18512024-12-19T05:54:08.717ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 238 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48200 req_id = 470fd482-1465-422f-830a-a34c237ce1d9 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18522024-12-19T05:54:09.027ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46997
18532024-12-19T05:54:09.027ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46997 req_id = 9ad7cb17-ae8c-44a7-82d1-ad8b8fbd980f response_code = 200 uri = /vpc-routes
18542024-12-19T05:54:09.047ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = a9851483-adb5-4271-9f27-41db71133b55 values = ExternalIpGatewayMap { mappings: {} }
18552024-12-19T05:54:09.047ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46997 req_id = bb54a0e2-c298-47fa-a3d3-15e96e2a413f response_code = 204 uri = /eip-gateways
18562024-12-19T05:54:09.062ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46997 req_id = 0eb3a92d-0230-400c-b465-b6ab319110c3 response_code = 204 uri = /vpc-routes
18572024-12-19T05:54:09.211ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59336
18582024-12-19T05:54:09.211ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 9a77c36e-7345-430e-9e83-8c3363325e9b, kind: Service { id: 75a56219-191b-4e5c-8eb1-d0e62e0c42f9 }, name: Name("external-dns-75a56219-191b-4e5c-8eb1-d0e62e0c42f9"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 10])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9edfb32a-e2bb-4e56-b9b4-ce860f893b5e, kind: Service { id: bb4845ab-0600-4d61-a9f2-eb93a7cc0896 }, name: Name("external-dns-bb4845ab-0600-4d61-a9f2-eb93a7cc0896"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 241])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 24da1f38-f5d2-4b50-a6f0-27b3479e0f93, kind: Service { id: 1b05e3ee-34fc-4615-91df-a477e1a37258 }, name: Name("nexus-1b05e3ee-34fc-4615-91df-a477e1a37258"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 52])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 37828052-0f7a-4cca-a068-121a8b67e439, kind: Service { id: c32c373d-ccc1-45e0-bb27-49a4415e7fca }, name: Name("nexus-c32c373d-ccc1-45e0-bb27-49a4415e7fca"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 144, 193])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a59ef66c-a1c5-4c9a-a337-f2d47efa332a, kind: Service { id: 1e0292d6-c327-472e-85e6-622aab78d10f }, name: Name("nexus-1e0292d6-c327-472e-85e6-622aab78d10f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 168, 229])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18592024-12-19T05:54:09.211ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18602024-12-19T05:54:09.211ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18612024-12-19T05:54:09.212ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
18622024-12-19T05:54:09.212ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18632024-12-19T05:54:09.212ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18642024-12-19T05:54:09.212ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18652024-12-19T05:54:09.212ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 253 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59336 req_id = 58f9215c-a69f-4425-9d1b-4fb9116c2da4 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18662024-12-19T05:54:09.253ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47236
18672024-12-19T05:54:09.254ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 196 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47236 req_id = 82900656-3940-4ced-82f7-b4318417e027 response_code = 200 uri = /v2p
18682024-12-19T05:54:09.311ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55351
18692024-12-19T05:54:09.313ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
18702024-12-19T05:54:09.395ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
18712024-12-19T05:54:09.455ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 144068 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:55351 req_id = 8ef8cdbc-3bd5-4098-a7cd-a32fdd94fffb response_code = 204 uri = /switch-ports
18722024-12-19T05:54:09.456ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 235 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55351 req_id = 2298dd9a-cdbf-4909-84f0-84b8639e411d response_code = 200 uri = /network-bootstore-config
18732024-12-19T05:54:09.554ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
18742024-12-19T05:54:09.554ZINFOSledAgent (bootstore): Writing ledger to /pool/int/e0de026f-6896-43b8-9686-b840d0967c1e/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
18752024-12-19T05:54:09.556ZINFOSledAgent (bootstore): Writing ledger to /pool/int/d2802dae-55e1-4039-8308-ca231b2dc40c/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
18762024-12-19T05:54:09.556ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
18772024-12-19T05:54:09.556ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2354 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55351 req_id = 1d5dbc1e-7290-46f9-989d-fda9aa563d29 response_code = 204 uri = /network-bootstore-config
18782024-12-19T05:54:11.341ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
18792024-12-19T05:54:16.149ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36611
18802024-12-19T05:54:16.150ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36611 req_id = d5e144be-408d-43d5-8546-f6f9b14347a9 response_code = 200 uri = /vpc-routes
18812024-12-19T05:54:16.198ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = a9851483-adb5-4271-9f27-41db71133b55 values = ExternalIpGatewayMap { mappings: {} }
18822024-12-19T05:54:16.198ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36611 req_id = 1f68a6a2-27aa-487a-bb69-bae4f71ae8d6 response_code = 204 uri = /eip-gateways
18832024-12-19T05:54:16.207ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 217 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36611 req_id = a5556315-8251-41f0-b9a1-2a58209ca23d response_code = 204 uri = /vpc-routes
18842024-12-19T05:54:24.268ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:63932
18852024-12-19T05:54:24.268ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:63932 req_id = 42e1b8a4-4488-4708-afd6-769be308d875 response_code = 200 uri = /baseboard
18862024-12-19T05:54:31.255ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48828
18872024-12-19T05:54:31.255ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48828 req_id = f1ca8420-2bb2-48cd-ae2c-084164e36a1f response_code = 200 uri = /vpc-routes
18882024-12-19T05:54:31.327ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57745
18892024-12-19T05:54:31.327ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57745 req_id = 65c10f6e-0046-498f-9641-b112392850b5 response_code = 200 uri = /v2p
18902024-12-19T05:54:31.370ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = a9851483-adb5-4271-9f27-41db71133b55 values = ExternalIpGatewayMap { mappings: {} }
18912024-12-19T05:54:31.370ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48828 req_id = a72200cd-7905-4543-b16d-fc66ed3e9db0 response_code = 204 uri = /eip-gateways
18922024-12-19T05:54:31.482ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48828 req_id = 8845677a-9bba-4ad2-8240-3887cd0570f1 response_code = 204 uri = /vpc-routes
18932024-12-19T05:54:31.570ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47592
18942024-12-19T05:54:31.570ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
18952024-12-19T05:54:31.605ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
18962024-12-19T05:54:31.659ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88461 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:47592 req_id = 4b59ce1d-e19c-4bde-8ac2-b26dd9109bc4 response_code = 204 uri = /switch-ports
18972024-12-19T05:54:31.662ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47592 req_id = 8a956970-7232-4b07-952a-e2b85c767017 response_code = 200 uri = /network-bootstore-config
18982024-12-19T05:54:32.217ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38669
18992024-12-19T05:54:32.217ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38669 req_id = 0cbc2823-81d7-4562-bdde-8c7d50e6600c response_code = 200 uri = /vpc-routes
19002024-12-19T05:54:32.255ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = a9851483-adb5-4271-9f27-41db71133b55 values = ExternalIpGatewayMap { mappings: {} }
19012024-12-19T05:54:32.255ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38669 req_id = 4c5febb4-2e81-49bb-b121-9a7c075baa3c response_code = 204 uri = /eip-gateways
19022024-12-19T05:54:32.350ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41343
19032024-12-19T05:54:32.350ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41343 req_id = 215ec88c-071c-4f3e-823d-670eb970f09b response_code = 200 uri = /v2p
19042024-12-19T05:54:32.457ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38669 req_id = 8ec53a41-dd60-40b8-93fc-62eb57113912 response_code = 204 uri = /vpc-routes
19052024-12-19T05:54:32.563ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49775
19062024-12-19T05:54:32.563ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19072024-12-19T05:54:32.599ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19082024-12-19T05:54:32.651ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88376 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:49775 req_id = 697d030e-772e-422b-a308-195d618e83c6 response_code = 204 uri = /switch-ports
19092024-12-19T05:54:32.652ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49775 req_id = 5f8a4fe1-13dd-452c-8010-18b41fd7a656 response_code = 200 uri = /network-bootstore-config
19102024-12-19T05:54:39.080ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41635
19112024-12-19T05:54:39.080ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41635 req_id = 178ea8f1-31f7-42b0-968e-64ffc113d9ac response_code = 200 uri = /vpc-routes
19122024-12-19T05:54:39.109ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = a9851483-adb5-4271-9f27-41db71133b55 values = ExternalIpGatewayMap { mappings: {} }
19132024-12-19T05:54:39.109ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41635 req_id = ac4900a2-c05e-4f0c-9e10-096a6d7f5a6f response_code = 204 uri = /eip-gateways
19142024-12-19T05:54:39.125ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41635 req_id = 72c155f0-26eb-4642-83cf-317da9c509e7 response_code = 204 uri = /vpc-routes
19152024-12-19T05:54:39.246ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64078
19162024-12-19T05:54:39.247ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19172024-12-19T05:54:39.289ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19182024-12-19T05:54:39.355ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108959 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:64078 req_id = 11fdae44-b8c7-491c-baf6-c398cda0ca45 response_code = 204 uri = /switch-ports
19192024-12-19T05:54:39.356ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53082
19202024-12-19T05:54:39.356ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 183 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53082 req_id = 1e9582ec-47e2-4541-838e-ac67609cbff5 response_code = 200 uri = /v2p
19212024-12-19T05:54:39.356ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 219 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64078 req_id = 0f27a078-17b5-48c3-9823-d464d8a7544e response_code = 200 uri = /network-bootstore-config
19222024-12-19T05:54:54.301ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:48920
19232024-12-19T05:54:54.301ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:48920 req_id = a475a38e-237e-4b89-a2a1-143fc4516f63 response_code = 200 uri = /baseboard
19242024-12-19T05:55:01.107ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40565
19252024-12-19T05:55:01.107ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40565 req_id = d406dd77-8cdd-42e2-93c2-f8a87c9dfdfc response_code = 200 uri = /vpc-routes
19262024-12-19T05:55:01.212ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = a9851483-adb5-4271-9f27-41db71133b55 values = ExternalIpGatewayMap { mappings: {} }
19272024-12-19T05:55:01.213ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40565 req_id = fe8f83a1-9d46-4343-8d3e-86d04e8f4450 response_code = 204 uri = /eip-gateways
19282024-12-19T05:55:01.222ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 176 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40565 req_id = b6f1cd9d-91d6-47c0-8da7-27fb5b741dde response_code = 204 uri = /vpc-routes
19292024-12-19T05:55:01.273ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54190
19302024-12-19T05:55:01.273ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54190 req_id = 1380a441-82f0-4d10-bb42-85cf81bfc96b response_code = 200 uri = /v2p
19312024-12-19T05:55:01.287ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39041
19322024-12-19T05:55:01.287ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19332024-12-19T05:55:01.325ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19342024-12-19T05:55:01.382ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94783 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:39041 req_id = ebb9a230-7bf8-44ff-a50b-d908130defef response_code = 204 uri = /switch-ports
19352024-12-19T05:55:01.382ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39041 req_id = 11e839fa-1c1f-46e6-be1b-f95ba116b0cd response_code = 200 uri = /network-bootstore-config
19362024-12-19T05:55:02.123ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36705
19372024-12-19T05:55:02.123ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36705 req_id = 8bc15c0a-b2e8-49a2-9268-651910082d87 response_code = 200 uri = /vpc-routes
19382024-12-19T05:55:02.173ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = a9851483-adb5-4271-9f27-41db71133b55 values = ExternalIpGatewayMap { mappings: {} }
19392024-12-19T05:55:02.173ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36705 req_id = c070292b-2933-4f97-bbc8-c4e5f08717ad response_code = 204 uri = /eip-gateways
19402024-12-19T05:55:02.207ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64724
19412024-12-19T05:55:02.207ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64724 req_id = 1b76ba48-e16d-4f68-9e6c-7259ab2cbc51 response_code = 200 uri = /v2p
19422024-12-19T05:55:02.217ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 171 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36705 req_id = bf0577bd-8901-4555-9087-c7de7a42993d response_code = 204 uri = /vpc-routes
19432024-12-19T05:55:02.239ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40653
19442024-12-19T05:55:02.239ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19452024-12-19T05:55:02.280ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19462024-12-19T05:55:02.337ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97873 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:40653 req_id = 15caeb7f-2994-4280-87ef-4905db41e307 response_code = 204 uri = /switch-ports
19472024-12-19T05:55:02.337ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40653 req_id = b038e115-9e7c-4cc7-a06e-50bf8441c321 response_code = 200 uri = /network-bootstore-config
19482024-12-19T05:55:08.944ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40355
19492024-12-19T05:55:08.945ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40355 req_id = 64aea54b-eb24-44fe-805a-db9eb2a648da response_code = 200 uri = /vpc-routes
19502024-12-19T05:55:08.990ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = a9851483-adb5-4271-9f27-41db71133b55 values = ExternalIpGatewayMap { mappings: {} }
19512024-12-19T05:55:08.990ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40355 req_id = 42c7e5ba-cf7c-43a0-b144-ae75efc048c8 response_code = 204 uri = /eip-gateways
19522024-12-19T05:55:09.000ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 184 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40355 req_id = 2ae08b3f-d469-4ec8-97bf-5712d55a119a response_code = 204 uri = /vpc-routes
19532024-12-19T05:55:09.048ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46488
19542024-12-19T05:55:09.048ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46488 req_id = a26dff9b-24a2-4a5a-9e99-a7cf6f4c4db0 response_code = 200 uri = /v2p
19552024-12-19T05:55:09.159ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44079
19562024-12-19T05:55:09.159ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19572024-12-19T05:55:09.200ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19582024-12-19T05:55:09.260ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100932 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:44079 req_id = f41b7a8f-1f9b-491b-8ad7-bafb95a2f4b3 response_code = 204 uri = /switch-ports
19592024-12-19T05:55:09.260ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44079 req_id = 151bb28a-189d-401f-af8f-b85871049c92 response_code = 200 uri = /network-bootstore-config
19602024-12-19T05:55:24.335ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:48238
19612024-12-19T05:55:24.335ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:48238 req_id = 81d2b152-3def-4c9b-a29b-19463ab4af50 response_code = 200 uri = /baseboard
19622024-12-19T05:55:31.272ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45408
19632024-12-19T05:55:31.272ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45408 req_id = bf74a970-d89c-4a6a-a9dc-c848340826b6 response_code = 200 uri = /vpc-routes
19642024-12-19T05:55:31.398ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64504
19652024-12-19T05:55:31.398ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64504 req_id = 701f9090-0211-4988-a151-008a26c718e7 response_code = 200 uri = /v2p
19662024-12-19T05:55:31.414ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = a9851483-adb5-4271-9f27-41db71133b55 values = ExternalIpGatewayMap { mappings: {} }
19672024-12-19T05:55:31.414ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45408 req_id = ed491d6f-6456-4db8-8944-0b29522032d6 response_code = 204 uri = /eip-gateways
19682024-12-19T05:55:31.423ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45408 req_id = f76e5d54-ea7d-46de-b38d-c35c3a3f4573 response_code = 204 uri = /vpc-routes
19692024-12-19T05:55:31.753ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60701
19702024-12-19T05:55:31.753ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19712024-12-19T05:55:31.790ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19722024-12-19T05:55:31.847ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94640 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:60701 req_id = 628781c0-ea41-4f3d-83c5-3426cfcc4b68 response_code = 204 uri = /switch-ports
19732024-12-19T05:55:31.848ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 190 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60701 req_id = 07c6afe1-4b97-4746-bb96-787ef3471f95 response_code = 200 uri = /network-bootstore-config
19742024-12-19T05:55:32.224ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44942
19752024-12-19T05:55:32.224ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44942 req_id = 5ea3c7ef-daa5-4c4a-a337-39e3958601cb response_code = 200 uri = /vpc-routes
19762024-12-19T05:55:32.281ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = a9851483-adb5-4271-9f27-41db71133b55 values = ExternalIpGatewayMap { mappings: {} }
19772024-12-19T05:55:32.281ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44942 req_id = c505213a-e3e3-4b26-8d11-20917372c944 response_code = 204 uri = /eip-gateways
19782024-12-19T05:55:32.291ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 216 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44942 req_id = 8d3f1de7-0d03-4438-8ff5-6faa01531fbc response_code = 204 uri = /vpc-routes
19792024-12-19T05:55:32.405ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62958
19802024-12-19T05:55:32.405ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62958 req_id = 62b495fd-f99d-40df-aa39-d1c84d24651c response_code = 200 uri = /v2p
19812024-12-19T05:55:32.529ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38483
19822024-12-19T05:55:32.530ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19832024-12-19T05:55:32.568ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19842024-12-19T05:55:32.620ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90348 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:38483 req_id = bf465727-16bc-49d2-9c5d-68066b67ccf0 response_code = 204 uri = /switch-ports
19852024-12-19T05:55:32.620ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38483 req_id = e7999a99-782a-4555-9a6a-789925dcb6ad response_code = 200 uri = /network-bootstore-config
19862024-12-19T05:55:39.081ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43736
19872024-12-19T05:55:39.082ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43736 req_id = 3ebbc267-ea52-4f79-8623-757ac685071e response_code = 200 uri = /vpc-routes
19882024-12-19T05:55:39.102ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = a9851483-adb5-4271-9f27-41db71133b55 values = ExternalIpGatewayMap { mappings: {} }
19892024-12-19T05:55:39.102ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43736 req_id = 6ae4eccf-a371-4bc9-be15-0f34f8ced1bd response_code = 204 uri = /eip-gateways
19902024-12-19T05:55:39.130ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38180
19912024-12-19T05:55:39.130ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38180 req_id = ebf07793-3ff9-4e6f-a45d-37c62258d2d5 response_code = 200 uri = /v2p
19922024-12-19T05:55:39.220ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 239 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43736 req_id = 6afea9fd-b0f5-42b0-9417-f51b58ceda14 response_code = 204 uri = /vpc-routes
19932024-12-19T05:55:39.419ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39436
19942024-12-19T05:55:39.419ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19952024-12-19T05:55:39.460ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19962024-12-19T05:55:39.522ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102527 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:39436 req_id = 69042f6c-ac94-442f-a86b-58bea53ba122 response_code = 204 uri = /switch-ports
19972024-12-19T05:55:39.522ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39436 req_id = 7a9fa63c-520f-422c-9864-65f7ca5be987 response_code = 200 uri = /network-bootstore-config
19982024-12-19T05:55:54.368ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:34667
19992024-12-19T05:55:54.368ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:34667 req_id = 7588404e-b1da-49c2-b7e5-fdc817729c1a response_code = 200 uri = /baseboard
20002024-12-19T05:56:01.203ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43450
20012024-12-19T05:56:01.204ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43450 req_id = 1b7ec707-3b37-4cca-b79a-e640f928c459 response_code = 200 uri = /v2p
20022024-12-19T05:56:01.261ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39133
20032024-12-19T05:56:01.261ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 29 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39133 req_id = e892e3af-d538-48b5-9bb2-438a03691f5c response_code = 200 uri = /vpc-routes
20042024-12-19T05:56:01.310ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = a9851483-adb5-4271-9f27-41db71133b55 values = ExternalIpGatewayMap { mappings: {} }
20052024-12-19T05:56:01.310ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39133 req_id = 0862df5d-7394-4049-a1a6-52c50a279e10 response_code = 204 uri = /eip-gateways
20062024-12-19T05:56:01.320ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 233 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39133 req_id = c47d7977-906b-4aef-acf1-a08baeb630ad response_code = 204 uri = /vpc-routes
20072024-12-19T05:56:01.551ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47738
20082024-12-19T05:56:01.551ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20092024-12-19T05:56:01.587ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20102024-12-19T05:56:01.638ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87175 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:47738 req_id = a5ea3108-7f1b-4e37-ac8a-fc8f56d95882 response_code = 204 uri = /switch-ports
20112024-12-19T05:56:01.638ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47738 req_id = 5ce465cb-f181-40f6-b861-ba247a320638 response_code = 200 uri = /network-bootstore-config
20122024-12-19T05:56:02.231ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59227
20132024-12-19T05:56:02.231ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59227 req_id = e98d2fa1-38c7-40f7-8801-8d5ccc20b867 response_code = 200 uri = /vpc-routes
20142024-12-19T05:56:02.248ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = a9851483-adb5-4271-9f27-41db71133b55 values = ExternalIpGatewayMap { mappings: {} }
20152024-12-19T05:56:02.248ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59227 req_id = 56c866a1-e457-4c84-b0bd-af31b3a5703e response_code = 204 uri = /eip-gateways
20162024-12-19T05:56:02.258ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 185 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59227 req_id = ac9a2e6b-5e83-4b1c-95d6-99ebe588afd2 response_code = 204 uri = /vpc-routes
20172024-12-19T05:56:02.351ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62937
20182024-12-19T05:56:02.351ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20192024-12-19T05:56:02.391ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20202024-12-19T05:56:02.446ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94798 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:62937 req_id = 9e3519c8-2246-4b91-9123-e527c0e3d8df response_code = 204 uri = /switch-ports
20212024-12-19T05:56:02.446ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48199
20222024-12-19T05:56:02.446ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48199 req_id = 59297e8e-673b-4fdd-bc9b-5761b9ec74e8 response_code = 200 uri = /v2p
20232024-12-19T05:56:02.446ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 226 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62937 req_id = dfe8e744-5195-460e-a298-aa49c5fff5a6 response_code = 200 uri = /network-bootstore-config
20242024-12-19T05:56:08.912ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53422
20252024-12-19T05:56:08.912ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53422 req_id = 22fa2615-994d-4b56-b5f7-9e97c5ca4df2 response_code = 200 uri = /vpc-routes
20262024-12-19T05:56:08.933ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = a9851483-adb5-4271-9f27-41db71133b55 values = ExternalIpGatewayMap { mappings: {} }
20272024-12-19T05:56:08.933ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53422 req_id = f2e0fb61-fc58-489d-9faf-6aec211d73f3 response_code = 204 uri = /eip-gateways
20282024-12-19T05:56:08.960ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53435
20292024-12-19T05:56:08.960ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53435 req_id = 8ebedcdf-f324-4990-b5ac-fde52d7c94be response_code = 200 uri = /v2p
20302024-12-19T05:56:08.971ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 270 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53422 req_id = 9d28f97d-c186-4253-ae6b-c9a84631fa63 response_code = 204 uri = /vpc-routes
20312024-12-19T05:56:09.041ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57549
20322024-12-19T05:56:09.041ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20332024-12-19T05:56:09.078ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20342024-12-19T05:56:09.133ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92463 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:57549 req_id = 8f1ee9f5-84fa-4cc1-ace6-6fe85aeb8d02 response_code = 204 uri = /switch-ports
20352024-12-19T05:56:09.133ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57549 req_id = c103ce68-a84f-4126-bb16-6be4dbf1320f response_code = 200 uri = /network-bootstore-config
20362024-12-19T05:56:24.401ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:55163
20372024-12-19T05:56:24.402ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:55163 req_id = e3311aeb-2595-4d35-9eef-15b2e68e7233 response_code = 200 uri = /baseboard
20382024-12-19T05:56:29.998ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:34192 remote_addr = [fd00:1122:3344:101::d]:58608 sled_id = a9851483-adb5-4271-9f27-41db71133b55
20392024-12-19T05:56:30.052ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53907 local_addr = [fd00:1122:3344:101::1]:34192 method = GET remote_addr = [fd00:1122:3344:101::d]:58608 req_id = 681065e8-f7bd-42cf-aba2-2d6241d34e81 response_code = 200 sled_id = a9851483-adb5-4271-9f27-41db71133b55 uri = /a9851483-adb5-4271-9f27-41db71133b55
20402024-12-19T05:56:31.310ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59104
20412024-12-19T05:56:31.310ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59104 req_id = c2067180-50c0-41ab-9319-e7eda621d5ab response_code = 200 uri = /vpc-routes
20422024-12-19T05:56:31.330ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = a9851483-adb5-4271-9f27-41db71133b55 values = ExternalIpGatewayMap { mappings: {} }
20432024-12-19T05:56:31.330ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59104 req_id = 3f8ea480-371a-471c-81d9-2f0a1e659b38 response_code = 204 uri = /eip-gateways
20442024-12-19T05:56:31.448ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 298 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59104 req_id = e877976a-a61c-4eea-b724-10e751eba865 response_code = 204 uri = /vpc-routes
20452024-12-19T05:56:31.459ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56814
20462024-12-19T05:56:31.459ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56814 req_id = 68f7dca9-e826-4670-9dac-75d734882671 response_code = 200 uri = /v2p
20472024-12-19T05:56:31.461ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62799
20482024-12-19T05:56:31.461ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20492024-12-19T05:56:31.501ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20502024-12-19T05:56:31.558ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96827 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:62799 req_id = 50f450b8-0a72-4cea-b8c0-3e6e77648965 response_code = 204 uri = /switch-ports
20512024-12-19T05:56:31.558ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 213 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62799 req_id = 4f475bed-c29d-4445-aea6-0827623acdb4 response_code = 200 uri = /network-bootstore-config
20522024-12-19T05:56:32.269ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36666
20532024-12-19T05:56:32.270ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36666 req_id = 858119de-f375-4ca6-8e9c-7e183aea8a9f response_code = 200 uri = /v2p
20542024-12-19T05:56:32.350ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38835
20552024-12-19T05:56:32.350ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38835 req_id = 91d27a20-8dcf-46c3-bf98-62f3794ee0ac response_code = 200 uri = /vpc-routes
20562024-12-19T05:56:32.367ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = a9851483-adb5-4271-9f27-41db71133b55 values = ExternalIpGatewayMap { mappings: {} }
20572024-12-19T05:56:32.367ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38835 req_id = d2a03100-8a8f-4ca0-bc4f-cc974617e15e response_code = 204 uri = /eip-gateways
20582024-12-19T05:56:32.377ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 256 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38835 req_id = 6c7471d8-608b-41b7-be95-2c7a418bb1dd response_code = 204 uri = /vpc-routes
20592024-12-19T05:56:32.479ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35049
20602024-12-19T05:56:32.479ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20612024-12-19T05:56:32.514ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20622024-12-19T05:56:32.568ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89531 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:35049 req_id = 1cb208b8-7c21-4467-8fe3-f11516a08bf9 response_code = 204 uri = /switch-ports
20632024-12-19T05:56:32.569ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35049 req_id = d9ea2211-2096-4896-bbca-a34c3fe9572d response_code = 200 uri = /network-bootstore-config
20642024-12-19T05:56:39.255ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42508
20652024-12-19T05:56:39.255ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42508 req_id = 50c62135-1626-44a4-8e90-ad0024db0e53 response_code = 200 uri = /vpc-routes
20662024-12-19T05:56:39.277ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = a9851483-adb5-4271-9f27-41db71133b55 values = ExternalIpGatewayMap { mappings: {} }
20672024-12-19T05:56:39.277ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42508 req_id = 2dd6b67d-1694-4d5f-aa3b-eb904c4472d6 response_code = 204 uri = /eip-gateways
20682024-12-19T05:56:39.288ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 210 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42508 req_id = 7c20563b-47ec-474b-8623-74d2ba8f31b6 response_code = 204 uri = /vpc-routes
20692024-12-19T05:56:39.364ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57624
20702024-12-19T05:56:39.365ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57624 req_id = 1aca9bc4-e161-4809-9d91-f1fc3d15be0a response_code = 200 uri = /v2p
20712024-12-19T05:56:39.565ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38871
20722024-12-19T05:56:39.565ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20732024-12-19T05:56:39.606ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20742024-12-19T05:56:39.665ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99957 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:38871 req_id = 2bcf1df5-e64e-4072-b916-823d58f527fa response_code = 204 uri = /switch-ports
20752024-12-19T05:56:39.665ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38871 req_id = 340c744f-674a-47ce-b130-15d5b7c9891d response_code = 200 uri = /network-bootstore-config
20762024-12-19T05:56:54.434ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:33958
20772024-12-19T05:56:54.435ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:33958 req_id = 28004023-0180-406d-ac44-13226d0f3098 response_code = 200 uri = /baseboard
20782024-12-19T05:57:00.005ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7668 local_addr = [fd00:1122:3344:101::1]:34192 method = GET remote_addr = [fd00:1122:3344:101::d]:58608 req_id = a2a0065a-e6a1-461a-b3fa-ae39effcccc4 response_code = 200 sled_id = a9851483-adb5-4271-9f27-41db71133b55 uri = /a9851483-adb5-4271-9f27-41db71133b55
20792024-12-19T05:57:01.077ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53758
20802024-12-19T05:57:01.078ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53758 req_id = 39c416c8-a10c-40bb-86ef-9fb2f54c0e02 response_code = 200 uri = /vpc-routes
20812024-12-19T05:57:01.128ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = a9851483-adb5-4271-9f27-41db71133b55 values = ExternalIpGatewayMap { mappings: {} }
20822024-12-19T05:57:01.128ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53758 req_id = 67bcfac0-1ece-4376-8862-677521b2db32 response_code = 204 uri = /eip-gateways
20832024-12-19T05:57:01.137ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 239 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53758 req_id = add42b40-b3fb-40e0-9369-935cd89aab0d response_code = 204 uri = /vpc-routes
20842024-12-19T05:57:01.196ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55899
20852024-12-19T05:57:01.196ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20862024-12-19T05:57:01.235ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20872024-12-19T05:57:01.293ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96950 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:55899 req_id = 5282a6d4-12b3-4fa6-be72-e6e734250607 response_code = 204 uri = /switch-ports
20882024-12-19T05:57:01.293ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63759
20892024-12-19T05:57:01.293ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55899 req_id = 2bf54d3b-e8cb-40f0-9982-4e5a2a27eddc response_code = 200 uri = /network-bootstore-config
20902024-12-19T05:57:01.293ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 274 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63759 req_id = 62b33180-7355-4979-a415-3111294e7c62 response_code = 200 uri = /v2p
20912024-12-19T05:57:02.116ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37416
20922024-12-19T05:57:02.117ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37416 req_id = b3ef2da7-b591-4cbf-94ed-96c1027a9e8e response_code = 200 uri = /vpc-routes
20932024-12-19T05:57:02.166ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = a9851483-adb5-4271-9f27-41db71133b55 values = ExternalIpGatewayMap { mappings: {} }
20942024-12-19T05:57:02.166ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37416 req_id = eeb614b7-9ecc-4e30-95b6-49bcf9d3d94e response_code = 204 uri = /eip-gateways
20952024-12-19T05:57:02.181ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60543
20962024-12-19T05:57:02.181ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60543 req_id = ef7d9959-9ae4-4a9e-8018-d5068d4b1e7f response_code = 200 uri = /v2p
20972024-12-19T05:57:02.190ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37416 req_id = c1290528-b69f-4ed6-8c3e-83e9c0e0ef98 response_code = 204 uri = /vpc-routes
20982024-12-19T05:57:02.230ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64679
20992024-12-19T05:57:02.230ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21002024-12-19T05:57:02.267ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21012024-12-19T05:57:02.322ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91896 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:64679 req_id = 28e16536-ec2a-4118-8da6-df143a8f0394 response_code = 204 uri = /switch-ports
21022024-12-19T05:57:02.322ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64679 req_id = 148a31e0-4514-49c4-90be-016ab12c99eb response_code = 200 uri = /network-bootstore-config
21032024-12-19T05:57:08.957ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44560
21042024-12-19T05:57:08.957ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44560 req_id = 866946ca-e679-4a72-b5d9-bb020be62b18 response_code = 200 uri = /vpc-routes
21052024-12-19T05:57:08.999ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34285
21062024-12-19T05:57:09.000ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34285 req_id = 7cb19002-2fd3-4c66-91b0-7483a76f7e76 response_code = 200 uri = /v2p
21072024-12-19T05:57:09.003ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = a9851483-adb5-4271-9f27-41db71133b55 values = ExternalIpGatewayMap { mappings: {} }
21082024-12-19T05:57:09.003ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44560 req_id = 16e0f627-276b-4a1c-8285-8c7443b6681c response_code = 204 uri = /eip-gateways
21092024-12-19T05:57:09.013ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 225 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44560 req_id = 4cd785ef-6413-47c7-9a06-cf661e1257f6 response_code = 204 uri = /vpc-routes
21102024-12-19T05:57:09.127ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63929
21112024-12-19T05:57:09.127ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21122024-12-19T05:57:09.170ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21132024-12-19T05:57:09.231ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104605 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:63929 req_id = b369e7db-10a2-4124-97fd-2b1780dce213 response_code = 204 uri = /switch-ports
21142024-12-19T05:57:09.232ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63929 req_id = 4bcd9f79-6885-4c67-8ef4-f40f79968576 response_code = 200 uri = /network-bootstore-config
21152024-12-19T05:57:24.468ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:52104
21162024-12-19T05:57:24.468ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:52104 req_id = b9aa21fc-e4d4-464a-93a7-d2860d1c0719 response_code = 200 uri = /baseboard
21172024-12-19T05:57:30.005ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7054 local_addr = [fd00:1122:3344:101::1]:34192 method = GET remote_addr = [fd00:1122:3344:101::d]:58608 req_id = 85a73a79-ba8d-4768-ad24-0366113be803 response_code = 200 sled_id = a9851483-adb5-4271-9f27-41db71133b55 uri = /a9851483-adb5-4271-9f27-41db71133b55
21182024-12-19T05:57:31.210ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47119
21192024-12-19T05:57:31.211ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47119 req_id = e0749586-7c90-41f1-84a5-ba023269e40f response_code = 200 uri = /vpc-routes
21202024-12-19T05:57:31.268ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = a9851483-adb5-4271-9f27-41db71133b55 values = ExternalIpGatewayMap { mappings: {} }
21212024-12-19T05:57:31.268ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47119 req_id = ba64f51d-e38c-4860-b7f6-4141da68def3 response_code = 204 uri = /eip-gateways
21222024-12-19T05:57:31.278ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 260 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47119 req_id = 8abb969f-5d35-41e0-be3a-f2ebb9b7697b response_code = 204 uri = /vpc-routes
21232024-12-19T05:57:31.450ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46132
21242024-12-19T05:57:31.450ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46132 req_id = 71e1acc4-c8dd-4105-a1aa-cb0874ba7cac response_code = 200 uri = /v2p
21252024-12-19T05:57:31.631ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37509
21262024-12-19T05:57:31.631ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21272024-12-19T05:57:31.670ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21282024-12-19T05:57:31.730ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98626 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:37509 req_id = 545ec7dd-538b-4dfa-884d-8258dcd9d483 response_code = 204 uri = /switch-ports
21292024-12-19T05:57:31.733ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37509 req_id = 4edc3852-c3e9-45d9-9da2-5c4ade14130d response_code = 200 uri = /network-bootstore-config
21302024-12-19T05:57:32.239ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42989
21312024-12-19T05:57:32.239ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42989 req_id = 6cfedaf8-2ca8-4e03-ba5e-86b8fe993810 response_code = 200 uri = /vpc-routes
21322024-12-19T05:57:32.355ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54312
21332024-12-19T05:57:32.355ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54312 req_id = 8628a9c3-4dd6-4ea4-9100-65fb8a2405f0 response_code = 200 uri = /v2p
21342024-12-19T05:57:32.433ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = a9851483-adb5-4271-9f27-41db71133b55 values = ExternalIpGatewayMap { mappings: {} }
21352024-12-19T05:57:32.433ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42989 req_id = bdb76cca-5e86-4a69-9322-df5cbcbfe76d response_code = 204 uri = /eip-gateways
21362024-12-19T05:57:32.443ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42989 req_id = bf0e31df-87a4-41a0-bc78-ab1ce67addd8 response_code = 204 uri = /vpc-routes
21372024-12-19T05:57:32.454ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38168
21382024-12-19T05:57:32.454ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21392024-12-19T05:57:32.491ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21402024-12-19T05:57:32.549ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94358 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:38168 req_id = b1f6d739-1fa8-4ee0-96ac-e0708d06295b response_code = 204 uri = /switch-ports
21412024-12-19T05:57:32.549ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38168 req_id = d1f8f6dd-a140-417f-abcd-153a7232ae1a response_code = 200 uri = /network-bootstore-config
21422024-12-19T05:57:39.097ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41079
21432024-12-19T05:57:39.098ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41079 req_id = a85e1b25-c478-45b3-8e6c-a4a3f3095557 response_code = 200 uri = /vpc-routes
21442024-12-19T05:57:39.113ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = a9851483-adb5-4271-9f27-41db71133b55 values = ExternalIpGatewayMap { mappings: {} }
21452024-12-19T05:57:39.113ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41079 req_id = 3b42a650-224d-4cfd-876d-bb601e1876c8 response_code = 204 uri = /eip-gateways
21462024-12-19T05:57:39.130ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51398
21472024-12-19T05:57:39.131ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51398 req_id = 7843f09c-57c0-4702-8d9e-7938bfdd2168 response_code = 200 uri = /v2p
21482024-12-19T05:57:39.136ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 256 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41079 req_id = ffe2081f-ad65-45dd-ae33-01b044f573f8 response_code = 204 uri = /vpc-routes
21492024-12-19T05:57:39.291ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44332
21502024-12-19T05:57:39.291ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21512024-12-19T05:57:39.333ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21522024-12-19T05:57:39.393ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101913 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:44332 req_id = f085f9c9-65d9-4240-b2a4-0dfa3ea78ac7 response_code = 204 uri = /switch-ports
21532024-12-19T05:57:39.393ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44332 req_id = 8ba5487e-b7ce-4526-b2fd-a7bdec087e29 response_code = 200 uri = /network-bootstore-config
21542024-12-19T05:57:54.501ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49898
21552024-12-19T05:57:54.501ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49898 req_id = 470a2953-a5ec-44e1-a664-50f25ff22093 response_code = 200 uri = /baseboard
21562024-12-19T05:58:00.006ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8051 local_addr = [fd00:1122:3344:101::1]:34192 method = GET remote_addr = [fd00:1122:3344:101::d]:58608 req_id = d8d2c380-55e4-48c5-9ef4-83657f0738f3 response_code = 200 sled_id = a9851483-adb5-4271-9f27-41db71133b55 uri = /a9851483-adb5-4271-9f27-41db71133b55
21572024-12-19T05:58:01.086ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58721
21582024-12-19T05:58:01.087ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58721 req_id = 9c8acf64-2c09-402c-9dc9-9a233c0ba132 response_code = 200 uri = /vpc-routes
21592024-12-19T05:58:01.134ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = a9851483-adb5-4271-9f27-41db71133b55 values = ExternalIpGatewayMap { mappings: {} }
21602024-12-19T05:58:01.134ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58721 req_id = c1d3a074-b9d8-4439-b7fe-f2ab69effbd0 response_code = 204 uri = /eip-gateways
21612024-12-19T05:58:01.145ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 266 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58721 req_id = 4e7963a5-4296-4b0a-8541-b5aff53a7675 response_code = 204 uri = /vpc-routes
21622024-12-19T05:58:01.278ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47401
21632024-12-19T05:58:01.278ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47401 req_id = b96388e2-86a4-494d-87ba-72f476457ca2 response_code = 200 uri = /v2p
21642024-12-19T05:58:01.383ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:32773
21652024-12-19T05:58:01.383ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21662024-12-19T05:58:01.424ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21672024-12-19T05:58:01.478ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94415 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:32773 req_id = f5963a13-b067-4ea1-814a-778bf923b98d response_code = 204 uri = /switch-ports
21682024-12-19T05:58:01.478ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:32773 req_id = 3e649378-203c-4021-9093-a0323eea34cf response_code = 200 uri = /network-bootstore-config
21692024-12-19T05:58:02.110ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57940
21702024-12-19T05:58:02.110ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57940 req_id = df9aa80d-f9d2-4619-85ce-0dc158537afb response_code = 200 uri = /vpc-routes
21712024-12-19T05:58:02.128ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = a9851483-adb5-4271-9f27-41db71133b55 values = ExternalIpGatewayMap { mappings: {} }
21722024-12-19T05:58:02.128ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57940 req_id = 64932aae-b76b-4ad6-97db-0a8b50c49bb6 response_code = 204 uri = /eip-gateways
21732024-12-19T05:58:02.138ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 167 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57940 req_id = 10444542-a6a8-41fe-bd9e-d62fcd323c3c response_code = 204 uri = /vpc-routes
21742024-12-19T05:58:02.201ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39717
21752024-12-19T05:58:02.201ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39717 req_id = 36fde6c6-7eb8-4f74-a25c-aef805126a11 response_code = 200 uri = /v2p
21762024-12-19T05:58:02.204ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37763
21772024-12-19T05:58:02.204ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21782024-12-19T05:58:02.244ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21792024-12-19T05:58:02.300ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95863 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:37763 req_id = 2099eaba-7619-4145-a383-e6cea473b9f2 response_code = 204 uri = /switch-ports
21802024-12-19T05:58:02.300ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37763 req_id = 1899bc6c-00dd-40ea-8d93-961912876c4b response_code = 200 uri = /network-bootstore-config
21812024-12-19T05:58:08.946ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51262
21822024-12-19T05:58:08.947ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 254 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51262 req_id = 8d6978f0-9b9c-4779-b8c1-9ecddc8b4955 response_code = 200 uri = /v2p
21832024-12-19T05:58:08.996ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63050
21842024-12-19T05:58:08.996ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63050 req_id = 1c61c4ad-103f-45a4-960e-df8ea8166163 response_code = 200 uri = /vpc-routes
21852024-12-19T05:58:09.012ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = a9851483-adb5-4271-9f27-41db71133b55 values = ExternalIpGatewayMap { mappings: {} }
21862024-12-19T05:58:09.012ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63050 req_id = c0758b07-c5eb-4ca1-8f54-209db29d9b23 response_code = 204 uri = /eip-gateways
21872024-12-19T05:58:09.021ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 228 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63050 req_id = caa5990c-f2fb-44c7-a82b-c9eaee63c3e3 response_code = 204 uri = /vpc-routes
21882024-12-19T05:58:09.164ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36401
21892024-12-19T05:58:09.164ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21902024-12-19T05:58:09.208ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21912024-12-19T05:58:09.268ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103666 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:36401 req_id = dc3a4a81-af31-4bef-afe7-b71590424ba3 response_code = 204 uri = /switch-ports
21922024-12-19T05:58:09.268ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36401 req_id = 1f540faf-0c80-490f-8521-299142a62517 response_code = 200 uri = /network-bootstore-config
21932024-12-19T05:58:24.534ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:40378
21942024-12-19T05:58:24.534ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:40378 req_id = 7e6a0494-65a0-4b9b-a8f5-8b0f079c16df response_code = 200 uri = /baseboard
21952024-12-19T05:58:30.005ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7250 local_addr = [fd00:1122:3344:101::1]:34192 method = GET remote_addr = [fd00:1122:3344:101::d]:58608 req_id = 85c6beee-b004-4c86-81b0-1e4b71b1e33a response_code = 200 sled_id = a9851483-adb5-4271-9f27-41db71133b55 uri = /a9851483-adb5-4271-9f27-41db71133b55
21962024-12-19T05:58:31.165ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63173
21972024-12-19T05:58:31.165ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63173 req_id = 558cb87b-27ff-4e48-816d-9c6c9e501079 response_code = 200 uri = /vpc-routes
21982024-12-19T05:58:31.400ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63160
21992024-12-19T05:58:31.400ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63160 req_id = c4e42b8c-9fa3-4d71-a2f3-6c9346b758df response_code = 200 uri = /v2p
22002024-12-19T05:58:31.454ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = a9851483-adb5-4271-9f27-41db71133b55 values = ExternalIpGatewayMap { mappings: {} }
22012024-12-19T05:58:31.454ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63173 req_id = 45f41558-8fdc-4df6-9de1-aca4eb137b0c response_code = 204 uri = /eip-gateways
22022024-12-19T05:58:31.464ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 287 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63173 req_id = bc47f3c2-7f97-4185-b879-fa36bda5fc17 response_code = 204 uri = /vpc-routes
22032024-12-19T05:58:31.485ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48628
22042024-12-19T05:58:31.485ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22052024-12-19T05:58:31.528ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22062024-12-19T05:58:31.587ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101737 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:48628 req_id = 0291a9a0-98ab-402a-ae29-d4f68bd7495c response_code = 204 uri = /switch-ports
22072024-12-19T05:58:31.587ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48628 req_id = 1d83256e-994c-4aea-b678-aafbc2b9b9da response_code = 200 uri = /network-bootstore-config
22082024-12-19T05:58:31.753ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47674
22092024-12-19T05:58:31.753ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 9a77c36e-7345-430e-9e83-8c3363325e9b, kind: Service { id: 75a56219-191b-4e5c-8eb1-d0e62e0c42f9 }, name: Name("external-dns-75a56219-191b-4e5c-8eb1-d0e62e0c42f9"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 10])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9edfb32a-e2bb-4e56-b9b4-ce860f893b5e, kind: Service { id: bb4845ab-0600-4d61-a9f2-eb93a7cc0896 }, name: Name("external-dns-bb4845ab-0600-4d61-a9f2-eb93a7cc0896"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 241])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 24da1f38-f5d2-4b50-a6f0-27b3479e0f93, kind: Service { id: 1b05e3ee-34fc-4615-91df-a477e1a37258 }, name: Name("nexus-1b05e3ee-34fc-4615-91df-a477e1a37258"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 52])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 37828052-0f7a-4cca-a068-121a8b67e439, kind: Service { id: c32c373d-ccc1-45e0-bb27-49a4415e7fca }, name: Name("nexus-c32c373d-ccc1-45e0-bb27-49a4415e7fca"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 144, 193])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a59ef66c-a1c5-4c9a-a337-f2d47efa332a, kind: Service { id: 1e0292d6-c327-472e-85e6-622aab78d10f }, name: Name("nexus-1e0292d6-c327-472e-85e6-622aab78d10f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 168, 229])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
22102024-12-19T05:58:31.753ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22112024-12-19T05:58:31.753ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22122024-12-19T05:58:31.753ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
22132024-12-19T05:58:31.754ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22142024-12-19T05:58:31.754ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22152024-12-19T05:58:31.754ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22162024-12-19T05:58:31.754ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 299 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47674 req_id = 7109431c-7248-4960-8692-5ec301100c57 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
22172024-12-19T05:58:32.226ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37459
22182024-12-19T05:58:32.226ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37459 req_id = 631d1e68-4594-4b73-b2b3-a05352ecafa0 response_code = 200 uri = /vpc-routes
22192024-12-19T05:58:32.286ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = a9851483-adb5-4271-9f27-41db71133b55 values = ExternalIpGatewayMap { mappings: {} }
22202024-12-19T05:58:32.286ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37459 req_id = 93298151-1fe6-4dad-91ef-0e58ae678a96 response_code = 204 uri = /eip-gateways
22212024-12-19T05:58:32.295ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 194 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37459 req_id = 01109808-4f7f-431c-afe6-9676a5f4c0c1 response_code = 204 uri = /vpc-routes
22222024-12-19T05:58:32.347ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52171
22232024-12-19T05:58:32.347ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22242024-12-19T05:58:32.393ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22252024-12-19T05:58:32.459ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112074 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:52171 req_id = 15578ed4-f5ec-4fb2-bb3e-b5593ce5d76d response_code = 204 uri = /switch-ports
22262024-12-19T05:58:32.459ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36154
22272024-12-19T05:58:32.459ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 191 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36154 req_id = 079a2f8a-b83a-4c3c-9e2d-cc6da33f50a6 response_code = 200 uri = /v2p
22282024-12-19T05:58:32.459ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 221 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52171 req_id = 86e75970-f51f-432b-9329-0febcbfb8867 response_code = 200 uri = /network-bootstore-config
22292024-12-19T05:58:32.610ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45706
22302024-12-19T05:58:32.611ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 9a77c36e-7345-430e-9e83-8c3363325e9b, kind: Service { id: 75a56219-191b-4e5c-8eb1-d0e62e0c42f9 }, name: Name("external-dns-75a56219-191b-4e5c-8eb1-d0e62e0c42f9"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 10])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9edfb32a-e2bb-4e56-b9b4-ce860f893b5e, kind: Service { id: bb4845ab-0600-4d61-a9f2-eb93a7cc0896 }, name: Name("external-dns-bb4845ab-0600-4d61-a9f2-eb93a7cc0896"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 241])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 24da1f38-f5d2-4b50-a6f0-27b3479e0f93, kind: Service { id: 1b05e3ee-34fc-4615-91df-a477e1a37258 }, name: Name("nexus-1b05e3ee-34fc-4615-91df-a477e1a37258"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 52])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 37828052-0f7a-4cca-a068-121a8b67e439, kind: Service { id: c32c373d-ccc1-45e0-bb27-49a4415e7fca }, name: Name("nexus-c32c373d-ccc1-45e0-bb27-49a4415e7fca"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 144, 193])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a59ef66c-a1c5-4c9a-a337-f2d47efa332a, kind: Service { id: 1e0292d6-c327-472e-85e6-622aab78d10f }, name: Name("nexus-1e0292d6-c327-472e-85e6-622aab78d10f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 168, 229])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
22312024-12-19T05:58:32.611ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22322024-12-19T05:58:32.611ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22332024-12-19T05:58:32.611ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
22342024-12-19T05:58:32.611ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22352024-12-19T05:58:32.611ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22362024-12-19T05:58:32.611ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22372024-12-19T05:58:32.611ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 457 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45706 req_id = 908f52c6-75ce-42cd-acfe-8e6cbab381b0 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
22382024-12-19T05:58:39.100ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52546
22392024-12-19T05:58:39.100ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52546 req_id = 0b8c9387-9d7b-47f7-87a0-d73cf6d5bdd0 response_code = 200 uri = /vpc-routes
22402024-12-19T05:58:39.128ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47276
22412024-12-19T05:58:39.128ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47276 req_id = 8c7b5cdc-1699-4abc-a5cf-eb559eda03e3 response_code = 200 uri = /v2p
22422024-12-19T05:58:39.145ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = a9851483-adb5-4271-9f27-41db71133b55 values = ExternalIpGatewayMap { mappings: {} }
22432024-12-19T05:58:39.145ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52546 req_id = a003bc3a-d946-4605-a3bd-f52f6740b6aa response_code = 204 uri = /eip-gateways
22442024-12-19T05:58:39.154ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52546 req_id = 09959bad-de24-429d-a0cd-75e2d2b16f1f response_code = 204 uri = /vpc-routes
22452024-12-19T05:58:39.307ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38224
22462024-12-19T05:58:39.307ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 9a77c36e-7345-430e-9e83-8c3363325e9b, kind: Service { id: 75a56219-191b-4e5c-8eb1-d0e62e0c42f9 }, name: Name("external-dns-75a56219-191b-4e5c-8eb1-d0e62e0c42f9"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 10])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9edfb32a-e2bb-4e56-b9b4-ce860f893b5e, kind: Service { id: bb4845ab-0600-4d61-a9f2-eb93a7cc0896 }, name: Name("external-dns-bb4845ab-0600-4d61-a9f2-eb93a7cc0896"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 241])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 24da1f38-f5d2-4b50-a6f0-27b3479e0f93, kind: Service { id: 1b05e3ee-34fc-4615-91df-a477e1a37258 }, name: Name("nexus-1b05e3ee-34fc-4615-91df-a477e1a37258"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 52])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 37828052-0f7a-4cca-a068-121a8b67e439, kind: Service { id: c32c373d-ccc1-45e0-bb27-49a4415e7fca }, name: Name("nexus-c32c373d-ccc1-45e0-bb27-49a4415e7fca"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 144, 193])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a59ef66c-a1c5-4c9a-a337-f2d47efa332a, kind: Service { id: 1e0292d6-c327-472e-85e6-622aab78d10f }, name: Name("nexus-1e0292d6-c327-472e-85e6-622aab78d10f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 168, 229])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
22472024-12-19T05:58:39.307ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22482024-12-19T05:58:39.307ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22492024-12-19T05:58:39.307ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
22502024-12-19T05:58:39.307ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22512024-12-19T05:58:39.307ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22522024-12-19T05:58:39.307ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22532024-12-19T05:58:39.307ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38224 req_id = 02cb853f-aaa8-45f0-9482-dc240c783d61 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
22542024-12-19T05:58:39.308ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61544
22552024-12-19T05:58:39.308ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22562024-12-19T05:58:39.348ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22572024-12-19T05:58:39.408ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99849 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:61544 req_id = 8e91027a-171d-41e1-b863-82d67e98bee2 response_code = 204 uri = /switch-ports
22582024-12-19T05:58:39.408ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 195 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61544 req_id = 97881941-e778-4e62-b3e6-e7f098c2515b response_code = 200 uri = /network-bootstore-config
22592024-12-19T05:58:54.567ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:48547
22602024-12-19T05:58:54.567ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:48547 req_id = 1ac8c6b7-822b-4bbb-9b3b-8598492d1279 response_code = 200 uri = /baseboard
22612024-12-19T05:58:56.813ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:197
22622024-12-19T05:58:56.813ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
22632024-12-19T05:58:56.849ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1939, tv_nsec: 563466851 } time_to_next_cleanup = 599.99999505s
22642024-12-19T05:59:00.005ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7211 local_addr = [fd00:1122:3344:101::1]:34192 method = GET remote_addr = [fd00:1122:3344:101::d]:58608 req_id = fbd82fb2-80b8-4afe-b972-0d0df9441528 response_code = 200 sled_id = a9851483-adb5-4271-9f27-41db71133b55 uri = /a9851483-adb5-4271-9f27-41db71133b55
22652024-12-19T05:59:01.132ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44784
22662024-12-19T05:59:01.133ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44784 req_id = 4cfa6552-0295-4ea0-b7ee-0e541c62b9b2 response_code = 200 uri = /vpc-routes
22672024-12-19T05:59:01.179ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = a9851483-adb5-4271-9f27-41db71133b55 values = ExternalIpGatewayMap { mappings: {} }
22682024-12-19T05:59:01.179ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44784 req_id = 56205e9e-12c8-429a-a05e-2a3f2b43639b response_code = 204 uri = /eip-gateways
22692024-12-19T05:59:01.191ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 243 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44784 req_id = 839c37a0-3f18-4c9d-87e6-c6829eb4b9e0 response_code = 204 uri = /vpc-routes
22702024-12-19T05:59:01.263ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57836
22712024-12-19T05:59:01.263ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22722024-12-19T05:59:01.303ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22732024-12-19T05:59:01.360ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97092 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:57836 req_id = ccb32e77-c03c-4bdf-a87c-74df0353ab7a response_code = 204 uri = /switch-ports
22742024-12-19T05:59:01.360ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64354
22752024-12-19T05:59:01.360ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 234 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57836 req_id = 12a83875-f9ac-476d-bfca-e4b7715cc4f7 response_code = 200 uri = /network-bootstore-config
22762024-12-19T05:59:01.362ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 232 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64354 req_id = 9ac885c5-fd26-4e05-908e-ea62b3ba92ad response_code = 200 uri = /v2p
22772024-12-19T05:59:02.043ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34022
22782024-12-19T05:59:02.043ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34022 req_id = 58a781d3-e198-4142-9a2d-925db194225d response_code = 200 uri = /vpc-routes
22792024-12-19T05:59:02.061ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = a9851483-adb5-4271-9f27-41db71133b55 values = ExternalIpGatewayMap { mappings: {} }
22802024-12-19T05:59:02.061ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34022 req_id = 497a122d-e3ec-4ee2-b48d-1e7d67330d72 response_code = 204 uri = /eip-gateways
22812024-12-19T05:59:02.071ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 229 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34022 req_id = 2e6fd0a6-fda2-4eb2-92b2-d4659619b71b response_code = 204 uri = /vpc-routes
22822024-12-19T05:59:02.189ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54796
22832024-12-19T05:59:02.189ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54796 req_id = aa471533-b2d5-4347-b973-e1e53eb1e80a response_code = 200 uri = /v2p
22842024-12-19T05:59:02.191ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64494
22852024-12-19T05:59:02.191ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22862024-12-19T05:59:02.232ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22872024-12-19T05:59:02.290ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98605 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:64494 req_id = 01f07bc5-b135-4578-a7fa-61853332c55d response_code = 204 uri = /switch-ports
22882024-12-19T05:59:02.290ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64494 req_id = e15f5b6b-dbb5-4a3e-a5d7-8c092d8bf38a response_code = 200 uri = /network-bootstore-config
22892024-12-19T05:59:08.939ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38881
22902024-12-19T05:59:08.939ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38881 req_id = d8005db2-8aff-4fe4-8310-872ef769347a response_code = 200 uri = /vpc-routes
22912024-12-19T05:59:08.954ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = a9851483-adb5-4271-9f27-41db71133b55 values = ExternalIpGatewayMap { mappings: {} }
22922024-12-19T05:59:08.954ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38881 req_id = 863eceea-7072-4ac0-b7e2-e67d11be4710 response_code = 204 uri = /eip-gateways
22932024-12-19T05:59:08.963ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 210 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38881 req_id = 32d2c8ed-4de7-42cb-a79e-ab567d7d7079 response_code = 204 uri = /vpc-routes
22942024-12-19T05:59:09.018ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44945
22952024-12-19T05:59:09.018ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44945 req_id = 21491a6c-0dc0-41f8-8cb2-3ed835e3a223 response_code = 200 uri = /v2p
22962024-12-19T05:59:09.063ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55286
22972024-12-19T05:59:09.064ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22982024-12-19T05:59:09.103ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22992024-12-19T05:59:09.161ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97607 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:55286 req_id = f76b6eef-dc2a-400a-b17e-f2b3742c1428 response_code = 204 uri = /switch-ports
23002024-12-19T05:59:09.168ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55286 req_id = 89ae45a0-047b-46cc-9fa7-af5ce609b30a response_code = 200 uri = /network-bootstore-config
23012024-12-19T05:59:11.340ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
23022024-12-19T05:59:24.599ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:57742
23032024-12-19T05:59:24.599ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:57742 req_id = f2dffacd-8bc8-4e9a-bda2-51f1192bd92e response_code = 200 uri = /baseboard
23042024-12-19T05:59:30.005ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7583 local_addr = [fd00:1122:3344:101::1]:34192 method = GET remote_addr = [fd00:1122:3344:101::d]:58608 req_id = bbecc5f1-4423-427f-aa8b-66d3d21dd489 response_code = 200 sled_id = a9851483-adb5-4271-9f27-41db71133b55 uri = /a9851483-adb5-4271-9f27-41db71133b55
23052024-12-19T05:59:31.236ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43644
23062024-12-19T05:59:31.236ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43644 req_id = 37f0102c-6564-4d3a-8aa5-5d116c2d250d response_code = 200 uri = /v2p
23072024-12-19T05:59:31.420ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36300
23082024-12-19T05:59:31.420ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36300 req_id = b4543804-965e-4e5f-b019-9a626f3130d6 response_code = 200 uri = /vpc-routes
23092024-12-19T05:59:31.462ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = a9851483-adb5-4271-9f27-41db71133b55 values = ExternalIpGatewayMap { mappings: {} }
23102024-12-19T05:59:31.462ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36300 req_id = d9c8d479-3a70-4d69-a4e2-2cb3694a1a3a response_code = 204 uri = /eip-gateways
23112024-12-19T05:59:31.472ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 254 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36300 req_id = 69d889c1-f856-4fff-adc9-d474db612243 response_code = 204 uri = /vpc-routes
23122024-12-19T05:59:31.529ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38724
23132024-12-19T05:59:31.529ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23142024-12-19T05:59:31.573ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23152024-12-19T05:59:31.631ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101395 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:38724 req_id = 66397554-719f-4cbd-8010-fba74c00b8e1 response_code = 204 uri = /switch-ports
23162024-12-19T05:59:31.633ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38724 req_id = f7f81593-8064-47e4-8dde-6d05aec060b0 response_code = 200 uri = /network-bootstore-config
23172024-12-19T05:59:32.245ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53284
23182024-12-19T05:59:32.245ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53284 req_id = f2d36901-6227-43ab-b248-6242ebc75fe1 response_code = 200 uri = /vpc-routes
23192024-12-19T05:59:32.288ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = a9851483-adb5-4271-9f27-41db71133b55 values = ExternalIpGatewayMap { mappings: {} }
23202024-12-19T05:59:32.288ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53284 req_id = fec798ef-27cd-4821-8a67-533bba2eac4c response_code = 204 uri = /eip-gateways
23212024-12-19T05:59:32.297ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 312 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53284 req_id = 06b35755-8a37-4320-b564-3974c0fb47d7 response_code = 204 uri = /vpc-routes
23222024-12-19T05:59:32.354ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37149
23232024-12-19T05:59:32.354ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37149 req_id = 63ac39f1-4c43-49dd-91e1-f9a072a9aa60 response_code = 200 uri = /v2p
23242024-12-19T05:59:32.453ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38880
23252024-12-19T05:59:32.453ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23262024-12-19T05:59:32.496ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23272024-12-19T05:59:32.556ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103111 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:38880 req_id = 27f3fa83-3de0-4291-9ce5-3f3973105b3e response_code = 204 uri = /switch-ports
23282024-12-19T05:59:32.556ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38880 req_id = 722d285b-f0dc-4354-b8be-140a510e820f response_code = 200 uri = /network-bootstore-config
23292024-12-19T05:59:39.146ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51487
23302024-12-19T05:59:39.146ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51487 req_id = fee52254-d2d4-4471-9ff6-40feed8f7485 response_code = 200 uri = /vpc-routes
23312024-12-19T05:59:39.204ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = a9851483-adb5-4271-9f27-41db71133b55 values = ExternalIpGatewayMap { mappings: {} }
23322024-12-19T05:59:39.204ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51487 req_id = 4c22a084-0028-455c-b247-1e54cc4d79c8 response_code = 204 uri = /eip-gateways
23332024-12-19T05:59:39.215ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 820 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51487 req_id = 3ab82e87-601f-4404-a094-e92a14fe2cc0 response_code = 204 uri = /vpc-routes
23342024-12-19T05:59:39.392ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40770
23352024-12-19T05:59:39.393ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40770 req_id = a0f474d7-8577-496c-9a54-cce4f164d709 response_code = 200 uri = /v2p
23362024-12-19T05:59:39.405ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54857
23372024-12-19T05:59:39.405ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23382024-12-19T05:59:39.447ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23392024-12-19T05:59:39.505ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99819 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:54857 req_id = 2b604e97-5683-4ae0-8bc3-52a74f8bf2cb response_code = 204 uri = /switch-ports
23402024-12-19T05:59:39.505ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54857 req_id = 532c5fa0-b64b-480f-87ff-12ee92d384a1 response_code = 200 uri = /network-bootstore-config
23412024-12-19T05:59:54.632ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:52345
23422024-12-19T05:59:54.632ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:52345 req_id = 674ec8f8-d1bc-444f-93a0-22f0bb82ab51 response_code = 200 uri = /baseboard
23432024-12-19T06:00:00.005ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7469 local_addr = [fd00:1122:3344:101::1]:34192 method = GET remote_addr = [fd00:1122:3344:101::d]:58608 req_id = a0e54671-0c25-408f-bfec-bd894de89590 response_code = 200 sled_id = a9851483-adb5-4271-9f27-41db71133b55 uri = /a9851483-adb5-4271-9f27-41db71133b55
23442024-12-19T06:00:01.113ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53598
23452024-12-19T06:00:01.113ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53598 req_id = 20d1f832-bf72-419e-b76c-00edd175caf3 response_code = 200 uri = /vpc-routes
23462024-12-19T06:00:01.172ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = a9851483-adb5-4271-9f27-41db71133b55 values = ExternalIpGatewayMap { mappings: {} }
23472024-12-19T06:00:01.172ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53598 req_id = 18fed6f7-0cb1-44fc-ba5f-42268017d0c6 response_code = 204 uri = /eip-gateways
23482024-12-19T06:00:01.186ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 285 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53598 req_id = f9c7ddd1-7144-4a11-b429-9e0017bb78fa response_code = 204 uri = /vpc-routes
23492024-12-19T06:00:01.192ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38028
23502024-12-19T06:00:01.193ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38028 req_id = 8990b34b-69e4-43b3-865e-6db07ad036a8 response_code = 200 uri = /v2p
23512024-12-19T06:00:01.241ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56164
23522024-12-19T06:00:01.241ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23532024-12-19T06:00:01.303ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23542024-12-19T06:00:01.431ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 189654 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:56164 req_id = d99fd690-0c78-47fb-9c27-f9c5f555be73 response_code = 204 uri = /switch-ports
23552024-12-19T06:00:01.431ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 251 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56164 req_id = c8e94828-b37e-424b-ade1-0727a8895441 response_code = 200 uri = /network-bootstore-config
23562024-12-19T06:00:02.190ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64693
23572024-12-19T06:00:02.190ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64693 req_id = 5a004c79-1f11-48da-af4c-362bf4326957 response_code = 200 uri = /vpc-routes
23582024-12-19T06:00:02.205ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44413
23592024-12-19T06:00:02.205ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44413 req_id = daf5ac8b-5a7d-4e57-a7a1-7bd9b9849ec1 response_code = 200 uri = /v2p
23602024-12-19T06:00:02.237ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = a9851483-adb5-4271-9f27-41db71133b55 values = ExternalIpGatewayMap { mappings: {} }
23612024-12-19T06:00:02.237ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64693 req_id = c0eb1882-d2ba-4e61-bc05-7829380244bb response_code = 204 uri = /eip-gateways
23622024-12-19T06:00:02.247ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 277 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64693 req_id = 61a2ff6a-1d5e-4925-8084-b2ce06b7ef08 response_code = 204 uri = /vpc-routes
23632024-12-19T06:00:02.299ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42639
23642024-12-19T06:00:02.299ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23652024-12-19T06:00:02.354ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23662024-12-19T06:00:02.473ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 174150 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:42639 req_id = b40352d5-e97f-44c2-8ac9-ba24163c1cd6 response_code = 204 uri = /switch-ports
23672024-12-19T06:00:02.473ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42639 req_id = e895ee04-bf47-4a25-9dc7-d7101eff9d6c response_code = 200 uri = /network-bootstore-config
23682024-12-19T06:00:08.966ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59093
23692024-12-19T06:00:08.967ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59093 req_id = 0cc20f5a-bbcd-44ef-b270-ae2cdf998881 response_code = 200 uri = /vpc-routes
23702024-12-19T06:00:09.020ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = a9851483-adb5-4271-9f27-41db71133b55 values = ExternalIpGatewayMap { mappings: {} }
23712024-12-19T06:00:09.020ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59093 req_id = da2a20e2-5f55-46e8-8773-3871e3840e40 response_code = 204 uri = /eip-gateways
23722024-12-19T06:00:09.030ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 295 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59093 req_id = 7fcf3121-6501-40c6-854b-88ccdc0c131b response_code = 204 uri = /vpc-routes
23732024-12-19T06:00:09.043ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58453
23742024-12-19T06:00:09.043ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23752024-12-19T06:00:09.087ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23762024-12-19T06:00:09.150ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106937 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:58453 req_id = 5ea8a2bd-2f2c-442a-9733-8198e70b3ef9 response_code = 204 uri = /switch-ports
23772024-12-19T06:00:09.150ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51568
23782024-12-19T06:00:09.151ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 189 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51568 req_id = 975b864d-f998-418f-a12b-103ffcf7448a response_code = 200 uri = /v2p
23792024-12-19T06:00:09.151ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 209 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58453 req_id = 6c324827-6077-4a0c-925f-20b3b9f5e15c response_code = 200 uri = /network-bootstore-config
23802024-12-19T06:00:24.666ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:56198
23812024-12-19T06:00:24.666ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:56198 req_id = 69addb84-08c4-41cd-b3b3-907582e180d8 response_code = 200 uri = /baseboard
23822024-12-19T06:00:30.004ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7466 local_addr = [fd00:1122:3344:101::1]:34192 method = GET remote_addr = [fd00:1122:3344:101::d]:58608 req_id = ec87ff48-322d-43fc-a43e-da72d676d4a6 response_code = 200 sled_id = a9851483-adb5-4271-9f27-41db71133b55 uri = /a9851483-adb5-4271-9f27-41db71133b55
23832024-12-19T06:00:31.243ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43965
23842024-12-19T06:00:31.244ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43965 req_id = b1a3002d-bb0b-4551-9ae8-8ec93380f8b4 response_code = 200 uri = /vpc-routes
23852024-12-19T06:00:31.275ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = a9851483-adb5-4271-9f27-41db71133b55 values = ExternalIpGatewayMap { mappings: {} }
23862024-12-19T06:00:31.275ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43965 req_id = 6e4c1756-6554-49e0-8e74-68e41e3af50e response_code = 204 uri = /eip-gateways
23872024-12-19T06:00:31.290ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 353 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43965 req_id = 1a922d65-dfc4-4c47-acf0-20353d379523 response_code = 204 uri = /vpc-routes
23882024-12-19T06:00:31.394ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57803
23892024-12-19T06:00:31.394ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57803 req_id = ed90d26e-597a-4bcf-a800-1cb01154505c response_code = 200 uri = /v2p
23902024-12-19T06:00:31.418ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40389
23912024-12-19T06:00:31.419ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23922024-12-19T06:00:31.456ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23932024-12-19T06:00:31.509ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90876 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:40389 req_id = 63e972c0-d81d-474f-8299-9955d63b15e8 response_code = 204 uri = /switch-ports
23942024-12-19T06:00:31.510ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 236 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40389 req_id = 3ff2af65-bb9b-4511-846b-e4e66a0cc702 response_code = 200 uri = /network-bootstore-config
23952024-12-19T06:00:32.208ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49676
23962024-12-19T06:00:32.208ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49676 req_id = 441f9d32-5c93-4029-98b4-1ac9a93e1211 response_code = 200 uri = /vpc-routes
23972024-12-19T06:00:32.231ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = a9851483-adb5-4271-9f27-41db71133b55 values = ExternalIpGatewayMap { mappings: {} }
23982024-12-19T06:00:32.231ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49676 req_id = 60490bc6-ff81-4a16-9032-1821a24c7677 response_code = 204 uri = /eip-gateways
23992024-12-19T06:00:32.247ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 202 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49676 req_id = 258105c7-6edc-4dea-a62e-dcfe3f2865ce response_code = 204 uri = /vpc-routes
24002024-12-19T06:00:32.402ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56474
24012024-12-19T06:00:32.402ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56474 req_id = 2a86c40b-dbb9-4852-8df0-87fd62d62ddd response_code = 200 uri = /v2p
24022024-12-19T06:00:32.449ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47582
24032024-12-19T06:00:32.449ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24042024-12-19T06:00:32.490ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24052024-12-19T06:00:32.547ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97737 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:47582 req_id = 43438d5e-30d4-450a-85e3-3ba3c788fb77 response_code = 204 uri = /switch-ports
24062024-12-19T06:00:32.547ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47582 req_id = 52edad63-0041-4550-98cb-be6a9c35f3fe response_code = 200 uri = /network-bootstore-config
24072024-12-19T06:00:39.085ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62691
24082024-12-19T06:00:39.085ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62691 req_id = d9352629-f092-463e-8320-4d1f7814526f response_code = 200 uri = /vpc-routes
24092024-12-19T06:00:39.134ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = a9851483-adb5-4271-9f27-41db71133b55 values = ExternalIpGatewayMap { mappings: {} }
24102024-12-19T06:00:39.134ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62691 req_id = 70002a1f-fb75-4b0d-af35-a88c95797af5 response_code = 204 uri = /eip-gateways
24112024-12-19T06:00:39.198ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39590
24122024-12-19T06:00:39.198ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39590 req_id = 9efad4a9-35a3-4f18-a16e-e4e81add985d response_code = 200 uri = /v2p
24132024-12-19T06:00:39.208ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62691 req_id = bcaa10d0-f3d2-4352-8271-846ce82c3d75 response_code = 204 uri = /vpc-routes
24142024-12-19T06:00:39.277ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45503
24152024-12-19T06:00:39.277ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24162024-12-19T06:00:39.319ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24172024-12-19T06:00:39.376ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98681 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:45503 req_id = 3dba8a81-ec5d-43c2-9ab6-d3f43e0c0741 response_code = 204 uri = /switch-ports
24182024-12-19T06:00:39.376ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 192 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45503 req_id = cbb951c5-b0ae-4595-aa61-6ea42b761006 response_code = 200 uri = /network-bootstore-config
24192024-12-19T06:00:54.699ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:46671
24202024-12-19T06:00:54.699ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:46671 req_id = 47af974a-370a-4f1f-a8f7-cea241799dbb response_code = 200 uri = /baseboard
24212024-12-19T06:01:00.005ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7965 local_addr = [fd00:1122:3344:101::1]:34192 method = GET remote_addr = [fd00:1122:3344:101::d]:58608 req_id = 2659c9e0-07c5-4a12-b326-16bc35dee636 response_code = 200 sled_id = a9851483-adb5-4271-9f27-41db71133b55 uri = /a9851483-adb5-4271-9f27-41db71133b55
24222024-12-19T06:01:01.113ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:32873
24232024-12-19T06:01:01.113ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:32873 req_id = 12e1ba5c-7644-49a3-830a-4d7b1616cc18 response_code = 200 uri = /vpc-routes
24242024-12-19T06:01:01.156ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = a9851483-adb5-4271-9f27-41db71133b55 values = ExternalIpGatewayMap { mappings: {} }
24252024-12-19T06:01:01.156ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:32873 req_id = dfc789fb-8497-4b0c-b383-f08f1a67b569 response_code = 204 uri = /eip-gateways
24262024-12-19T06:01:01.165ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 248 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:32873 req_id = 5b56ad4e-5eab-497a-a497-fab1c872ed32 response_code = 204 uri = /vpc-routes
24272024-12-19T06:01:01.172ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49872
24282024-12-19T06:01:01.173ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24292024-12-19T06:01:01.215ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24302024-12-19T06:01:01.275ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102528 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:49872 req_id = 924ae4d6-9018-4963-a029-9cb45b171b21 response_code = 204 uri = /switch-ports
24312024-12-19T06:01:01.275ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46481
24322024-12-19T06:01:01.276ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 271 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49872 req_id = f4ae05b2-a5c4-4021-a039-05660d729f63 response_code = 200 uri = /network-bootstore-config
24332024-12-19T06:01:01.276ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 220 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46481 req_id = 0d588e9e-cc19-4653-81a1-41fd50f57a50 response_code = 200 uri = /v2p
24342024-12-19T06:01:02.117ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45332
24352024-12-19T06:01:02.117ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45332 req_id = 153d958b-c991-4641-b9d9-56377d093741 response_code = 200 uri = /vpc-routes
24362024-12-19T06:01:02.160ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = a9851483-adb5-4271-9f27-41db71133b55 values = ExternalIpGatewayMap { mappings: {} }
24372024-12-19T06:01:02.160ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45332 req_id = 114156a7-ae7a-48fd-b1f1-f60da77ab931 response_code = 204 uri = /eip-gateways
24382024-12-19T06:01:02.192ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41478
24392024-12-19T06:01:02.192ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41478 req_id = 6daddb5b-839b-4a58-8edc-0281d6d41ed7 response_code = 200 uri = /v2p
24402024-12-19T06:01:02.202ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45332 req_id = 5d67921f-2489-4939-b9dc-f47ab9315cf7 response_code = 204 uri = /vpc-routes
24412024-12-19T06:01:02.288ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42686
24422024-12-19T06:01:02.288ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24432024-12-19T06:01:02.328ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24442024-12-19T06:01:02.388ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99606 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:42686 req_id = 43c81c2e-6787-4e45-81d2-14ddb1f33a3c response_code = 204 uri = /switch-ports
24452024-12-19T06:01:02.388ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42686 req_id = d90d69c6-0bab-4341-9282-264f260a6156 response_code = 200 uri = /network-bootstore-config
24462024-12-19T06:01:08.917ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42080
24472024-12-19T06:01:08.917ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42080 req_id = 908c0adb-6309-4b11-9576-90aa61435d60 response_code = 200 uri = /vpc-routes
24482024-12-19T06:01:08.967ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = a9851483-adb5-4271-9f27-41db71133b55 values = ExternalIpGatewayMap { mappings: {} }
24492024-12-19T06:01:08.967ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42080 req_id = f0e626d2-fc45-4017-928c-b94fa7e8f044 response_code = 204 uri = /eip-gateways
24502024-12-19T06:01:08.975ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 254 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42080 req_id = 2232e65f-cf7a-4fdd-b1a1-704d38e6979c response_code = 204 uri = /vpc-routes
24512024-12-19T06:01:08.996ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38670
24522024-12-19T06:01:08.997ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38670 req_id = dbcb7af8-0a69-448b-8e66-d7ddd6a949af response_code = 200 uri = /v2p
24532024-12-19T06:01:09.042ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48141
24542024-12-19T06:01:09.043ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24552024-12-19T06:01:09.081ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24562024-12-19T06:01:09.142ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99825 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48141 req_id = f1df0962-9c99-4e4a-b11a-c33f6bbf2cca response_code = 204 uri = /switch-ports
24572024-12-19T06:01:09.143ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48141 req_id = a714d397-5cd9-42e9-8747-719c8360bea5 response_code = 200 uri = /network-bootstore-config
24582024-12-19T06:01:24.733ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:39302
24592024-12-19T06:01:24.733ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:39302 req_id = 0a5c47e4-637a-469a-b541-ffe006ef003b response_code = 200 uri = /baseboard
24602024-12-19T06:01:30.004ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7226 local_addr = [fd00:1122:3344:101::1]:34192 method = GET remote_addr = [fd00:1122:3344:101::d]:58608 req_id = dfb8cb5e-3fce-4fe3-b752-25a2419057fc response_code = 200 sled_id = a9851483-adb5-4271-9f27-41db71133b55 uri = /a9851483-adb5-4271-9f27-41db71133b55
24612024-12-19T06:01:31.232ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34019
24622024-12-19T06:01:31.233ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34019 req_id = 25ddf6d7-1b64-418b-a9e2-b035fee5fc7e response_code = 200 uri = /vpc-routes
24632024-12-19T06:01:31.283ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = a9851483-adb5-4271-9f27-41db71133b55 values = ExternalIpGatewayMap { mappings: {} }
24642024-12-19T06:01:31.283ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34019 req_id = e4907e5b-4217-4c18-98ad-21c206e68e69 response_code = 204 uri = /eip-gateways
24652024-12-19T06:01:31.389ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52495
24662024-12-19T06:01:31.389ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52495 req_id = e6c882f7-b4ce-4107-b07d-bd5b1e6f5fdf response_code = 200 uri = /v2p
24672024-12-19T06:01:31.396ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34019 req_id = e4ac4023-8242-4b17-b45d-18af130dd3fd response_code = 204 uri = /vpc-routes
24682024-12-19T06:01:31.577ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54206
24692024-12-19T06:01:31.577ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24702024-12-19T06:01:31.616ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24712024-12-19T06:01:31.673ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96328 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:54206 req_id = c6f5a13b-2470-4891-bbf5-28e5865cce67 response_code = 204 uri = /switch-ports
24722024-12-19T06:01:31.674ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 221 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54206 req_id = f55bde56-dac1-4e4c-88c2-dc1b48eefc71 response_code = 200 uri = /network-bootstore-config
24732024-12-19T06:01:32.174ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35446
24742024-12-19T06:01:32.174ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35446 req_id = f61dde61-3908-471f-a1ca-b6ac9ebb0d3f response_code = 200 uri = /vpc-routes
24752024-12-19T06:01:32.232ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = a9851483-adb5-4271-9f27-41db71133b55 values = ExternalIpGatewayMap { mappings: {} }
24762024-12-19T06:01:32.232ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35446 req_id = 8d1a93b4-661a-4020-8fb0-287064db77c0 response_code = 204 uri = /eip-gateways
24772024-12-19T06:01:32.241ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 246 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35446 req_id = b13a75b6-3b9e-46d4-83bb-942053adc8c3 response_code = 204 uri = /vpc-routes
24782024-12-19T06:01:32.343ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36599
24792024-12-19T06:01:32.343ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36599 req_id = 8ca7f3ab-4bf4-471c-9984-cee581cca9c4 response_code = 200 uri = /v2p
24802024-12-19T06:01:32.412ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34799
24812024-12-19T06:01:32.413ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24822024-12-19T06:01:32.451ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24832024-12-19T06:01:32.506ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93443 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:34799 req_id = 65426974-6d59-4edc-aae9-57cde2fb097a response_code = 204 uri = /switch-ports
24842024-12-19T06:01:32.506ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34799 req_id = d80905dd-c157-4fb7-9b0f-514393f4379a response_code = 200 uri = /network-bootstore-config
24852024-12-19T06:01:39.043ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38639
24862024-12-19T06:01:39.043ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38639 req_id = f14158b1-d37e-4c6a-a666-5c3d956d6560 response_code = 200 uri = /vpc-routes
24872024-12-19T06:01:39.091ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = a9851483-adb5-4271-9f27-41db71133b55 values = ExternalIpGatewayMap { mappings: {} }
24882024-12-19T06:01:39.091ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38639 req_id = bfe22172-e269-4dba-b04a-87fdb8d28abd response_code = 204 uri = /eip-gateways
24892024-12-19T06:01:39.101ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38639 req_id = 7fccf67d-a318-4b00-afbf-d1a8af91a7ae response_code = 204 uri = /vpc-routes
24902024-12-19T06:01:39.207ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36597
24912024-12-19T06:01:39.208ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36597 req_id = 6ef39893-b168-46a5-ba6d-b2e7a577d0c5 response_code = 200 uri = /v2p
24922024-12-19T06:01:39.245ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55750
24932024-12-19T06:01:39.245ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24942024-12-19T06:01:39.286ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24952024-12-19T06:01:39.345ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100817 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:55750 req_id = 08830711-2fc3-4780-8da6-cb196428139c response_code = 204 uri = /switch-ports
24962024-12-19T06:01:39.346ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55750 req_id = 2d967090-b11d-4555-b511-56a21bbd116b response_code = 200 uri = /network-bootstore-config
24972024-12-19T06:01:54.767ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49667
24982024-12-19T06:01:54.767ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49667 req_id = 62b29329-9a5f-4d51-8515-8fed6dfa71cb response_code = 200 uri = /baseboard
24992024-12-19T06:02:00.005ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8609 local_addr = [fd00:1122:3344:101::1]:34192 method = GET remote_addr = [fd00:1122:3344:101::d]:58608 req_id = 6ca0f5be-2e61-4afd-b0c1-c7eaf6d70ec9 response_code = 200 sled_id = a9851483-adb5-4271-9f27-41db71133b55 uri = /a9851483-adb5-4271-9f27-41db71133b55
25002024-12-19T06:02:01.128ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33859
25012024-12-19T06:02:01.129ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33859 req_id = 393acaf8-1059-4d8b-9030-bdb16e3a4001 response_code = 200 uri = /vpc-routes
25022024-12-19T06:02:01.170ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = a9851483-adb5-4271-9f27-41db71133b55 values = ExternalIpGatewayMap { mappings: {} }
25032024-12-19T06:02:01.170ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33859 req_id = 61bec047-c3da-4fb0-a2c3-d4a0e3b5a1d3 response_code = 204 uri = /eip-gateways
25042024-12-19T06:02:01.251ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49276
25052024-12-19T06:02:01.251ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49276 req_id = 00e9e5f3-56ab-45d5-84ca-d45924467e7a response_code = 200 uri = /v2p
25062024-12-19T06:02:01.255ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 217 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33859 req_id = 7812d1ea-490a-483c-9450-b8cf3b115035 response_code = 204 uri = /vpc-routes
25072024-12-19T06:02:01.367ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54810
25082024-12-19T06:02:01.367ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25092024-12-19T06:02:01.401ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25102024-12-19T06:02:01.456ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89161 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:54810 req_id = 6873a8ee-d7a6-4911-adc0-cbf764ca330b response_code = 204 uri = /switch-ports
25112024-12-19T06:02:01.456ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54810 req_id = f70ff1fc-81ee-40bd-b51e-df22ccb5a117 response_code = 200 uri = /network-bootstore-config
25122024-12-19T06:02:02.095ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34157
25132024-12-19T06:02:02.095ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34157 req_id = bd8f9163-a58f-4e67-bbc8-9985486b3abd response_code = 200 uri = /vpc-routes
25142024-12-19T06:02:02.139ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = a9851483-adb5-4271-9f27-41db71133b55 values = ExternalIpGatewayMap { mappings: {} }
25152024-12-19T06:02:02.139ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34157 req_id = 3d669aeb-6818-444f-82c7-560c78e2f6f8 response_code = 204 uri = /eip-gateways
25162024-12-19T06:02:02.148ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 223 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34157 req_id = a9c0995f-1763-46dc-8836-bf5ec448c1d5 response_code = 204 uri = /vpc-routes
25172024-12-19T06:02:02.189ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62596
25182024-12-19T06:02:02.189ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62596 req_id = aa762d20-59f0-4d59-bbcf-872e09c33bf7 response_code = 200 uri = /v2p
25192024-12-19T06:02:02.202ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49476
25202024-12-19T06:02:02.202ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25212024-12-19T06:02:02.242ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25222024-12-19T06:02:02.301ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98732 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:49476 req_id = 2373eb19-cd58-4417-9526-9a941ed2fdc9 response_code = 204 uri = /switch-ports
25232024-12-19T06:02:02.301ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49476 req_id = 66c4f72c-fad5-4053-9d89-a009124ef3c2 response_code = 200 uri = /network-bootstore-config
25242024-12-19T06:02:08.931ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37291
25252024-12-19T06:02:08.931ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37291 req_id = 32d32329-da23-4713-9d99-4927c1dc91ca response_code = 200 uri = /vpc-routes
25262024-12-19T06:02:08.979ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = a9851483-adb5-4271-9f27-41db71133b55 values = ExternalIpGatewayMap { mappings: {} }
25272024-12-19T06:02:08.979ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37291 req_id = 3bea9d9d-1b8d-43b2-818e-e6ddba3ea475 response_code = 204 uri = /eip-gateways
25282024-12-19T06:02:08.988ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 232 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37291 req_id = 6d32c9fb-48dc-4c72-9c16-da015c71a825 response_code = 204 uri = /vpc-routes
25292024-12-19T06:02:09.084ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40847
25302024-12-19T06:02:09.084ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25312024-12-19T06:02:09.126ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25322024-12-19T06:02:09.188ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104094 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:40847 req_id = 6d763b0c-c545-41de-a00f-b42cea1aee17 response_code = 204 uri = /switch-ports
25332024-12-19T06:02:09.188ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63611
25342024-12-19T06:02:09.189ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 169 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63611 req_id = 7916384d-be83-4b74-8179-c8d52a4717f8 response_code = 200 uri = /v2p
25352024-12-19T06:02:09.189ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 212 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40847 req_id = 43eea9c4-11e8-4df9-a945-de2f9e76405c response_code = 200 uri = /network-bootstore-config
25362024-12-19T06:02:24.801ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:48130
25372024-12-19T06:02:24.801ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:48130 req_id = dddbe681-c163-4f62-be2e-d2243533e93b response_code = 200 uri = /baseboard
25382024-12-19T06:02:30.004ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7348 local_addr = [fd00:1122:3344:101::1]:34192 method = GET remote_addr = [fd00:1122:3344:101::d]:58608 req_id = 792cf747-b953-4af1-a17a-0ae9748e163b response_code = 200 sled_id = a9851483-adb5-4271-9f27-41db71133b55 uri = /a9851483-adb5-4271-9f27-41db71133b55
25392024-12-19T06:02:31.365ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60886
25402024-12-19T06:02:31.365ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60886 req_id = 2f31b50d-005c-40b8-8257-ce07cd14af48 response_code = 200 uri = /vpc-routes
25412024-12-19T06:02:31.418ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = a9851483-adb5-4271-9f27-41db71133b55 values = ExternalIpGatewayMap { mappings: {} }
25422024-12-19T06:02:31.418ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60886 req_id = 22406ee9-bcb0-46e8-beb5-6f63e64b3eec response_code = 204 uri = /eip-gateways
25432024-12-19T06:02:31.426ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 244 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60886 req_id = 28842463-fe98-42a1-b262-506807e63e33 response_code = 204 uri = /vpc-routes
25442024-12-19T06:02:31.437ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55613
25452024-12-19T06:02:31.437ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25462024-12-19T06:02:31.475ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25472024-12-19T06:02:31.529ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91902 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:55613 req_id = e2eb7294-0954-4808-933d-e016f6daa4fd response_code = 204 uri = /switch-ports
25482024-12-19T06:02:31.529ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58745
25492024-12-19T06:02:31.529ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58745 req_id = b667704c-e410-44af-b5dc-91255e90968d response_code = 200 uri = /v2p
25502024-12-19T06:02:31.529ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 214 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55613 req_id = 074a5c39-9d85-44d4-9f0b-fcc4711fce2b response_code = 200 uri = /network-bootstore-config
25512024-12-19T06:02:32.235ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60809
25522024-12-19T06:02:32.236ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34297
25532024-12-19T06:02:32.236ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34297 req_id = b7dd6d33-bfbb-4fa4-b6ae-e876da508b38 response_code = 200 uri = /v2p
25542024-12-19T06:02:32.236ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60809 req_id = 209062e3-0c7a-4e62-b7ea-106197f71544 response_code = 200 uri = /vpc-routes
25552024-12-19T06:02:32.256ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = a9851483-adb5-4271-9f27-41db71133b55 values = ExternalIpGatewayMap { mappings: {} }
25562024-12-19T06:02:32.256ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60809 req_id = cc2204c0-8425-4470-a204-bf326b641f2b response_code = 204 uri = /eip-gateways
25572024-12-19T06:02:32.265ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 238 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60809 req_id = a81afbdb-45d2-4855-9ad4-bf76496202af response_code = 204 uri = /vpc-routes
25582024-12-19T06:02:32.351ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59914
25592024-12-19T06:02:32.351ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25602024-12-19T06:02:32.390ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25612024-12-19T06:02:32.443ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92850 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:59914 req_id = 4a847f11-384d-4321-86ca-d33e8c8e56dc response_code = 204 uri = /switch-ports
25622024-12-19T06:02:32.444ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59914 req_id = 09d14499-970d-493c-9323-35d87c830196 response_code = 200 uri = /network-bootstore-config
25632024-12-19T06:02:38.964ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64862
25642024-12-19T06:02:38.964ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64862 req_id = 76aa1fbf-d3ed-4e9c-8fcf-6ae94be09bee response_code = 200 uri = /vpc-routes
25652024-12-19T06:02:39.017ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = a9851483-adb5-4271-9f27-41db71133b55 values = ExternalIpGatewayMap { mappings: {} }
25662024-12-19T06:02:39.017ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64862 req_id = 9a8d306b-bcf1-44dd-bdb2-59ce5daf5bff response_code = 204 uri = /eip-gateways
25672024-12-19T06:02:39.026ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 209 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64862 req_id = 0b0b7060-f77a-43b6-972f-716f7c4d5c20 response_code = 204 uri = /vpc-routes
25682024-12-19T06:02:39.163ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61354
25692024-12-19T06:02:39.163ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61354 req_id = 960a2a21-76bf-4bce-a9ff-3bffc9adf1c1 response_code = 200 uri = /v2p
25702024-12-19T06:02:39.220ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60352
25712024-12-19T06:02:39.220ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25722024-12-19T06:02:39.259ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25732024-12-19T06:02:39.318ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97858 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:60352 req_id = 378283b2-9bf1-4cd1-937d-471b1b5374eb response_code = 204 uri = /switch-ports
25742024-12-19T06:02:39.318ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60352 req_id = 47aacde4-ab23-43b9-8986-b6697eba0291 response_code = 200 uri = /network-bootstore-config
25752024-12-19T06:02:54.834ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:57923
25762024-12-19T06:02:54.834ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:57923 req_id = 296d419e-d40e-4244-9283-eec479dbca7d response_code = 200 uri = /baseboard
25772024-12-19T06:03:00.004ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7519 local_addr = [fd00:1122:3344:101::1]:34192 method = GET remote_addr = [fd00:1122:3344:101::d]:58608 req_id = 6f0bb380-535d-411d-a562-5458334d54d2 response_code = 200 sled_id = a9851483-adb5-4271-9f27-41db71133b55 uri = /a9851483-adb5-4271-9f27-41db71133b55
25782024-12-19T06:03:01.181ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40488
25792024-12-19T06:03:01.181ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40488 req_id = a3e2dfd3-b02c-463a-9305-dbe47aff02f6 response_code = 200 uri = /vpc-routes
25802024-12-19T06:03:01.224ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = a9851483-adb5-4271-9f27-41db71133b55 values = ExternalIpGatewayMap { mappings: {} }
25812024-12-19T06:03:01.224ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40488 req_id = cebcba10-4e77-4f41-b8af-cebb582f2661 response_code = 204 uri = /eip-gateways
25822024-12-19T06:03:01.243ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43227
25832024-12-19T06:03:01.243ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43227 req_id = 7d60c7ba-51f7-477f-88d6-2f1b718c55b7 response_code = 200 uri = /v2p
25842024-12-19T06:03:01.246ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 250 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40488 req_id = 704510cc-d148-4044-855c-84069e77ac57 response_code = 204 uri = /vpc-routes
25852024-12-19T06:03:01.259ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47100
25862024-12-19T06:03:01.259ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25872024-12-19T06:03:01.301ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25882024-12-19T06:03:01.361ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102241 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:47100 req_id = 9fbb63bd-ca05-49c4-b626-f9a31d96a1ea response_code = 204 uri = /switch-ports
25892024-12-19T06:03:01.361ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 189 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47100 req_id = c52242c1-bafd-4205-98c5-8e02a1ce9df6 response_code = 200 uri = /network-bootstore-config
25902024-12-19T06:03:02.125ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39196
25912024-12-19T06:03:02.125ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39196 req_id = 86d46f24-5539-4101-8976-705199a457a7 response_code = 200 uri = /vpc-routes
25922024-12-19T06:03:02.171ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = a9851483-adb5-4271-9f27-41db71133b55 values = ExternalIpGatewayMap { mappings: {} }
25932024-12-19T06:03:02.171ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39196 req_id = 73bf8747-d438-4121-9b31-34965671531b response_code = 204 uri = /eip-gateways
25942024-12-19T06:03:02.181ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 184 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39196 req_id = 143d4ec3-2fdb-4b23-a609-93411f679bf0 response_code = 204 uri = /vpc-routes
25952024-12-19T06:03:02.184ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36872
25962024-12-19T06:03:02.185ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36872 req_id = 25f9bde5-5254-4b79-8499-169d01655d19 response_code = 200 uri = /v2p
25972024-12-19T06:03:02.218ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51039
25982024-12-19T06:03:02.218ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25992024-12-19T06:03:02.256ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26002024-12-19T06:03:02.313ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95895 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:51039 req_id = 55a4bd20-4d2b-4ebf-a346-5817dbae6e64 response_code = 204 uri = /switch-ports
26012024-12-19T06:03:02.314ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51039 req_id = aea1e558-08ef-4f17-b615-c950efea4e95 response_code = 200 uri = /network-bootstore-config
26022024-12-19T06:03:08.993ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65068
26032024-12-19T06:03:08.993ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65068 req_id = 855f7969-6e12-4a29-8ba4-201a1f33543c response_code = 200 uri = /vpc-routes
26042024-12-19T06:03:09.017ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33372
26052024-12-19T06:03:09.017ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33372 req_id = 1b6691f6-bf37-4fd8-88dd-6138be5cfeed response_code = 200 uri = /v2p
26062024-12-19T06:03:09.037ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = a9851483-adb5-4271-9f27-41db71133b55 values = ExternalIpGatewayMap { mappings: {} }
26072024-12-19T06:03:09.037ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:65068 req_id = 97a3a851-4f4c-45d6-ac88-f59a0d42feb8 response_code = 204 uri = /eip-gateways
26082024-12-19T06:03:09.048ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 225 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:65068 req_id = 7aa87d87-aa06-4f79-a18d-92057d807231 response_code = 204 uri = /vpc-routes
26092024-12-19T06:03:09.091ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58622
26102024-12-19T06:03:09.091ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26112024-12-19T06:03:09.131ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26122024-12-19T06:03:09.190ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99296 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:58622 req_id = 9cd36d6a-6312-433c-9022-366bb105ce18 response_code = 204 uri = /switch-ports
26132024-12-19T06:03:09.191ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58622 req_id = 3ba6336b-7681-439d-a4e6-46df674a08af response_code = 200 uri = /network-bootstore-config
26142024-12-19T06:03:24.867ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:56702
26152024-12-19T06:03:24.867ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:56702 req_id = f2683e8d-b803-40a9-bc9b-7c96c0a0761e response_code = 200 uri = /baseboard
26162024-12-19T06:03:30.006ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9399 local_addr = [fd00:1122:3344:101::1]:34192 method = GET remote_addr = [fd00:1122:3344:101::d]:58608 req_id = e881c126-2db5-4725-8090-6f98c6a44806 response_code = 200 sled_id = a9851483-adb5-4271-9f27-41db71133b55 uri = /a9851483-adb5-4271-9f27-41db71133b55
26172024-12-19T06:03:31.277ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51397
26182024-12-19T06:03:31.277ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51397 req_id = c3cec805-392e-42fe-8619-b3c994d89413 response_code = 200 uri = /vpc-routes
26192024-12-19T06:03:31.340ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = a9851483-adb5-4271-9f27-41db71133b55 values = ExternalIpGatewayMap { mappings: {} }
26202024-12-19T06:03:31.340ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51397 req_id = 4e10a913-8672-4186-a7ce-e34b1cfae932 response_code = 204 uri = /eip-gateways
26212024-12-19T06:03:31.350ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 260 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51397 req_id = 2c0112cd-f2cc-44db-a050-280d94cfcc7f response_code = 204 uri = /vpc-routes
26222024-12-19T06:03:31.463ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35695
26232024-12-19T06:03:31.463ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
26242024-12-19T06:03:31.463ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
26252024-12-19T06:03:31.463ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/e0de026f-6896-43b8-9686-b840d0967c1e/config/omicron-zones.json file = common/src/ledger.rs:177
26262024-12-19T06:03:31.463ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43357
26272024-12-19T06:03:31.464ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43357 req_id = face3852-02b2-434a-bff3-5240058c8a60 response_code = 200 uri = /v2p
26282024-12-19T06:03:31.465ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/d2802dae-55e1-4039-8308-ca231b2dc40c/config/omicron-zones.json file = common/src/ledger.rs:177
26292024-12-19T06:03:31.480ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f1c83160-c846-4e0a-a537-6a326722ac5a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26302024-12-19T06:03:31.480ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_f1c83160-c846-4e0a-a537-6a326722ac5a
26312024-12-19T06:03:31.486ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43990
26322024-12-19T06:03:31.486ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26332024-12-19T06:03:31.511ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 436ef9e1-c612-46c3-866b-9e48c044fdf2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26342024-12-19T06:03:31.511ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_436ef9e1-c612-46c3-866b-9e48c044fdf2
26352024-12-19T06:03:31.532ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26362024-12-19T06:03:31.541ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: defcb6a1-2bbe-47a6-a426-436ed60fd6fc (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26372024-12-19T06:03:31.542ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_defcb6a1-2bbe-47a6-a426-436ed60fd6fc
26382024-12-19T06:03:31.574ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a0552d97-e3e6-4586-a789-e6bcdec66672 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26392024-12-19T06:03:31.574ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_a0552d97-e3e6-4586-a789-e6bcdec66672
26402024-12-19T06:03:31.603ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 0cdd8476-a0d8-44ca-a74b-0704c56ede98 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26412024-12-19T06:03:31.604ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_0cdd8476-a0d8-44ca-a74b-0704c56ede98
26422024-12-19T06:03:31.609ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123411 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:43990 req_id = b2c47dba-6cee-4c3e-95c6-775ec565cd9a response_code = 204 uri = /switch-ports
26432024-12-19T06:03:31.610ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43990 req_id = 42dcc165-1b9c-4efc-8c5b-df48a1646387 response_code = 200 uri = /network-bootstore-config
26442024-12-19T06:03:31.629ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 0686bda3-5eb8-4859-ac7b-e5a6ceb8616d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26452024-12-19T06:03:31.629ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_0686bda3-5eb8-4859-ac7b-e5a6ceb8616d
26462024-12-19T06:03:31.654ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1fd2ac0f-93a9-44e1-a6b3-7ccfcdc6b252 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26472024-12-19T06:03:31.654ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_1fd2ac0f-93a9-44e1-a6b3-7ccfcdc6b252
26482024-12-19T06:03:31.680ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b5578c06-5ed8-4225-9470-d661174b141e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26492024-12-19T06:03:31.680ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_b5578c06-5ed8-4225-9470-d661174b141e
26502024-12-19T06:03:31.685ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38402
26512024-12-19T06:03:31.686ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 9a77c36e-7345-430e-9e83-8c3363325e9b, kind: Service { id: 75a56219-191b-4e5c-8eb1-d0e62e0c42f9 }, name: Name("external-dns-75a56219-191b-4e5c-8eb1-d0e62e0c42f9"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 10])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9edfb32a-e2bb-4e56-b9b4-ce860f893b5e, kind: Service { id: bb4845ab-0600-4d61-a9f2-eb93a7cc0896 }, name: Name("external-dns-bb4845ab-0600-4d61-a9f2-eb93a7cc0896"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 241])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 24da1f38-f5d2-4b50-a6f0-27b3479e0f93, kind: Service { id: 1b05e3ee-34fc-4615-91df-a477e1a37258 }, name: Name("nexus-1b05e3ee-34fc-4615-91df-a477e1a37258"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 52])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 37828052-0f7a-4cca-a068-121a8b67e439, kind: Service { id: c32c373d-ccc1-45e0-bb27-49a4415e7fca }, name: Name("nexus-c32c373d-ccc1-45e0-bb27-49a4415e7fca"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 144, 193])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a59ef66c-a1c5-4c9a-a337-f2d47efa332a, kind: Service { id: 1e0292d6-c327-472e-85e6-622aab78d10f }, name: Name("nexus-1e0292d6-c327-472e-85e6-622aab78d10f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 168, 229])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
26522024-12-19T06:03:31.686ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26532024-12-19T06:03:31.686ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26542024-12-19T06:03:31.686ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
26552024-12-19T06:03:31.686ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26562024-12-19T06:03:31.686ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26572024-12-19T06:03:31.686ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26582024-12-19T06:03:31.686ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 479 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38402 req_id = 52804f30-fd11-4416-8035-ec9bef39a620 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
26592024-12-19T06:03:31.705ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c12c68d5-6ddb-4829-80b0-49f80baef150 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26602024-12-19T06:03:31.705ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_c12c68d5-6ddb-4829-80b0-49f80baef150
26612024-12-19T06:03:31.719ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 255917 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35695 req_id = c23251e4-5cff-49a6-9a60-4f59afb6105f response_code = 200 uri = /inventory
26622024-12-19T06:03:32.340ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64653
26632024-12-19T06:03:32.341ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64653 req_id = 92c7dfab-5a0a-49da-a9c9-f6c5d8d66661 response_code = 200 uri = /v2p
26642024-12-19T06:03:32.378ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63751
26652024-12-19T06:03:32.378ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63751 req_id = 93bcbfd3-37c7-4090-912b-da6d5c3cb217 response_code = 200 uri = /vpc-routes
26662024-12-19T06:03:32.423ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = a9851483-adb5-4271-9f27-41db71133b55 values = ExternalIpGatewayMap { mappings: {} }
26672024-12-19T06:03:32.423ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63751 req_id = 83a81724-9d9f-4f84-862b-bac0b03cf684 response_code = 204 uri = /eip-gateways
26682024-12-19T06:03:32.426ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50656
26692024-12-19T06:03:32.426ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 9a77c36e-7345-430e-9e83-8c3363325e9b, kind: Service { id: 75a56219-191b-4e5c-8eb1-d0e62e0c42f9 }, name: Name("external-dns-75a56219-191b-4e5c-8eb1-d0e62e0c42f9"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 10])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9edfb32a-e2bb-4e56-b9b4-ce860f893b5e, kind: Service { id: bb4845ab-0600-4d61-a9f2-eb93a7cc0896 }, name: Name("external-dns-bb4845ab-0600-4d61-a9f2-eb93a7cc0896"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 241])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 24da1f38-f5d2-4b50-a6f0-27b3479e0f93, kind: Service { id: 1b05e3ee-34fc-4615-91df-a477e1a37258 }, name: Name("nexus-1b05e3ee-34fc-4615-91df-a477e1a37258"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 52])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 37828052-0f7a-4cca-a068-121a8b67e439, kind: Service { id: c32c373d-ccc1-45e0-bb27-49a4415e7fca }, name: Name("nexus-c32c373d-ccc1-45e0-bb27-49a4415e7fca"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 144, 193])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a59ef66c-a1c5-4c9a-a337-f2d47efa332a, kind: Service { id: 1e0292d6-c327-472e-85e6-622aab78d10f }, name: Name("nexus-1e0292d6-c327-472e-85e6-622aab78d10f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 168, 229])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
26702024-12-19T06:03:32.426ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26712024-12-19T06:03:32.426ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26722024-12-19T06:03:32.426ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
26732024-12-19T06:03:32.426ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26742024-12-19T06:03:32.426ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26752024-12-19T06:03:32.426ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26762024-12-19T06:03:32.426ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 273 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50656 req_id = 521f92aa-564e-4d19-bddb-9e8ad8373eda response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
26772024-12-19T06:03:32.551ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46402
26782024-12-19T06:03:32.551ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
26792024-12-19T06:03:32.551ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
26802024-12-19T06:03:32.551ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/e0de026f-6896-43b8-9686-b840d0967c1e/config/omicron-zones.json file = common/src/ledger.rs:177
26812024-12-19T06:03:32.551ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/d2802dae-55e1-4039-8308-ca231b2dc40c/config/omicron-zones.json file = common/src/ledger.rs:177
26822024-12-19T06:03:32.559ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 837 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63751 req_id = d74e8bbe-2285-4ec8-ad1f-2c7bba5d27c6 response_code = 204 uri = /vpc-routes
26832024-12-19T06:03:32.568ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f1c83160-c846-4e0a-a537-6a326722ac5a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26842024-12-19T06:03:32.568ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_f1c83160-c846-4e0a-a537-6a326722ac5a
26852024-12-19T06:03:32.575ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60313
26862024-12-19T06:03:32.575ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26872024-12-19T06:03:32.600ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 436ef9e1-c612-46c3-866b-9e48c044fdf2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26882024-12-19T06:03:32.600ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_436ef9e1-c612-46c3-866b-9e48c044fdf2
26892024-12-19T06:03:32.620ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26902024-12-19T06:03:32.630ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: defcb6a1-2bbe-47a6-a426-436ed60fd6fc (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26912024-12-19T06:03:32.630ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_defcb6a1-2bbe-47a6-a426-436ed60fd6fc
26922024-12-19T06:03:32.655ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a0552d97-e3e6-4586-a789-e6bcdec66672 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26932024-12-19T06:03:32.655ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_a0552d97-e3e6-4586-a789-e6bcdec66672
26942024-12-19T06:03:32.681ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 0cdd8476-a0d8-44ca-a74b-0704c56ede98 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26952024-12-19T06:03:32.681ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_0cdd8476-a0d8-44ca-a74b-0704c56ede98
26962024-12-19T06:03:32.688ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112426 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:60313 req_id = 675e7a6f-04a3-4a2a-bdf3-190efd68c66e response_code = 204 uri = /switch-ports
26972024-12-19T06:03:32.688ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60313 req_id = 52c68274-46aa-4ee9-bd35-0f0e30e9e663 response_code = 200 uri = /network-bootstore-config
26982024-12-19T06:03:32.707ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 0686bda3-5eb8-4859-ac7b-e5a6ceb8616d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26992024-12-19T06:03:32.707ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_0686bda3-5eb8-4859-ac7b-e5a6ceb8616d
27002024-12-19T06:03:32.731ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1fd2ac0f-93a9-44e1-a6b3-7ccfcdc6b252 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27012024-12-19T06:03:32.731ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_1fd2ac0f-93a9-44e1-a6b3-7ccfcdc6b252
27022024-12-19T06:03:32.754ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b5578c06-5ed8-4225-9470-d661174b141e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27032024-12-19T06:03:32.754ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_b5578c06-5ed8-4225-9470-d661174b141e
27042024-12-19T06:03:32.778ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c12c68d5-6ddb-4829-80b0-49f80baef150 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27052024-12-19T06:03:32.778ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_c12c68d5-6ddb-4829-80b0-49f80baef150
27062024-12-19T06:03:32.792ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 240767 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46402 req_id = 7e2d453c-d063-48bb-8b08-57246d3e5061 response_code = 200 uri = /inventory
27072024-12-19T06:03:38.989ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49443
27082024-12-19T06:03:38.989ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49443 req_id = 849b4b77-4594-449c-84a5-6fdea168ad14 response_code = 200 uri = /vpc-routes
27092024-12-19T06:03:39.044ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = a9851483-adb5-4271-9f27-41db71133b55 values = ExternalIpGatewayMap { mappings: {} }
27102024-12-19T06:03:39.044ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49443 req_id = 9e0a8cf4-7baf-45a7-b59f-ef328d27f858 response_code = 204 uri = /eip-gateways
27112024-12-19T06:03:39.053ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 190 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49443 req_id = 48d52b26-da87-487a-bd3d-a1c445d46d50 response_code = 204 uri = /vpc-routes
27122024-12-19T06:03:39.246ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34521
27132024-12-19T06:03:39.246ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34521 req_id = 170aa722-27c8-43f8-99f6-72d584e933f0 response_code = 200 uri = /v2p
27142024-12-19T06:03:39.322ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41662
27152024-12-19T06:03:39.322ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
27162024-12-19T06:03:39.322ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
27172024-12-19T06:03:39.322ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/e0de026f-6896-43b8-9686-b840d0967c1e/config/omicron-zones.json file = common/src/ledger.rs:177
27182024-12-19T06:03:39.323ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/d2802dae-55e1-4039-8308-ca231b2dc40c/config/omicron-zones.json file = common/src/ledger.rs:177
27192024-12-19T06:03:39.329ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37690
27202024-12-19T06:03:39.329ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27212024-12-19T06:03:39.337ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f1c83160-c846-4e0a-a537-6a326722ac5a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27222024-12-19T06:03:39.337ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_f1c83160-c846-4e0a-a537-6a326722ac5a
27232024-12-19T06:03:39.366ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 436ef9e1-c612-46c3-866b-9e48c044fdf2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27242024-12-19T06:03:39.366ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_436ef9e1-c612-46c3-866b-9e48c044fdf2
27252024-12-19T06:03:39.372ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27262024-12-19T06:03:39.385ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34982
27272024-12-19T06:03:39.390ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 9a77c36e-7345-430e-9e83-8c3363325e9b, kind: Service { id: 75a56219-191b-4e5c-8eb1-d0e62e0c42f9 }, name: Name("external-dns-75a56219-191b-4e5c-8eb1-d0e62e0c42f9"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 10])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9edfb32a-e2bb-4e56-b9b4-ce860f893b5e, kind: Service { id: bb4845ab-0600-4d61-a9f2-eb93a7cc0896 }, name: Name("external-dns-bb4845ab-0600-4d61-a9f2-eb93a7cc0896"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 241])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 24da1f38-f5d2-4b50-a6f0-27b3479e0f93, kind: Service { id: 1b05e3ee-34fc-4615-91df-a477e1a37258 }, name: Name("nexus-1b05e3ee-34fc-4615-91df-a477e1a37258"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 52])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 37828052-0f7a-4cca-a068-121a8b67e439, kind: Service { id: c32c373d-ccc1-45e0-bb27-49a4415e7fca }, name: Name("nexus-c32c373d-ccc1-45e0-bb27-49a4415e7fca"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 144, 193])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a59ef66c-a1c5-4c9a-a337-f2d47efa332a, kind: Service { id: 1e0292d6-c327-472e-85e6-622aab78d10f }, name: Name("nexus-1e0292d6-c327-472e-85e6-622aab78d10f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 168, 229])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
27282024-12-19T06:03:39.390ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27292024-12-19T06:03:39.390ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27302024-12-19T06:03:39.390ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
27312024-12-19T06:03:39.390ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27322024-12-19T06:03:39.390ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27332024-12-19T06:03:39.390ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27342024-12-19T06:03:39.390ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 693 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34982 req_id = eef0ff06-e846-40b4-80e2-fbddd6dcd07e response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
27352024-12-19T06:03:39.393ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: defcb6a1-2bbe-47a6-a426-436ed60fd6fc (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27362024-12-19T06:03:39.393ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_defcb6a1-2bbe-47a6-a426-436ed60fd6fc
27372024-12-19T06:03:39.416ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a0552d97-e3e6-4586-a789-e6bcdec66672 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27382024-12-19T06:03:39.416ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_a0552d97-e3e6-4586-a789-e6bcdec66672
27392024-12-19T06:03:39.435ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106528 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:37690 req_id = 1a0caeea-0d61-4cb8-9431-0bbbd2fadf4e response_code = 204 uri = /switch-ports
27402024-12-19T06:03:39.436ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37690 req_id = 0f833adc-8564-4cba-809d-8f9b302a4efa response_code = 200 uri = /network-bootstore-config
27412024-12-19T06:03:39.440ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 0cdd8476-a0d8-44ca-a74b-0704c56ede98 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27422024-12-19T06:03:39.440ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_0cdd8476-a0d8-44ca-a74b-0704c56ede98
27432024-12-19T06:03:39.466ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 0686bda3-5eb8-4859-ac7b-e5a6ceb8616d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27442024-12-19T06:03:39.466ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_0686bda3-5eb8-4859-ac7b-e5a6ceb8616d
27452024-12-19T06:03:39.493ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1fd2ac0f-93a9-44e1-a6b3-7ccfcdc6b252 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27462024-12-19T06:03:39.493ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_1fd2ac0f-93a9-44e1-a6b3-7ccfcdc6b252
27472024-12-19T06:03:39.533ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b5578c06-5ed8-4225-9470-d661174b141e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27482024-12-19T06:03:39.533ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_b5578c06-5ed8-4225-9470-d661174b141e
27492024-12-19T06:03:39.568ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c12c68d5-6ddb-4829-80b0-49f80baef150 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27502024-12-19T06:03:39.568ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_c12c68d5-6ddb-4829-80b0-49f80baef150
27512024-12-19T06:03:39.585ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 262744 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41662 req_id = 1a23ee1a-cdba-4f20-ac3a-b1e4dfd05666 response_code = 200 uri = /inventory
27522024-12-19T06:03:54.899ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:41867
27532024-12-19T06:03:54.900ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:41867 req_id = 39c1d26d-3a5d-42a9-95d5-248cbdd540d1 response_code = 200 uri = /baseboard
27542024-12-19T06:04:00.003ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7488 local_addr = [fd00:1122:3344:101::1]:34192 method = GET remote_addr = [fd00:1122:3344:101::d]:58608 req_id = 0f9266bd-ba5c-4425-8ebf-2ad7c1e0f63e response_code = 200 sled_id = a9851483-adb5-4271-9f27-41db71133b55 uri = /a9851483-adb5-4271-9f27-41db71133b55
27552024-12-19T06:04:01.119ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58856
27562024-12-19T06:04:01.119ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58856 req_id = 25fe1267-b40c-4795-80ae-67057f09b80d response_code = 200 uri = /vpc-routes
27572024-12-19T06:04:01.162ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = a9851483-adb5-4271-9f27-41db71133b55 values = ExternalIpGatewayMap { mappings: {} }
27582024-12-19T06:04:01.162ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58856 req_id = a17db121-b45a-42aa-894b-1220350d8804 response_code = 204 uri = /eip-gateways
27592024-12-19T06:04:01.170ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 257 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58856 req_id = d2836bb0-3b18-4f87-9e9c-0e9dfe561e8b response_code = 204 uri = /vpc-routes
27602024-12-19T06:04:01.188ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35654
27612024-12-19T06:04:01.188ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35654 req_id = 9cd29699-7286-40dd-b51d-a08ee7e73ff2 response_code = 200 uri = /v2p
27622024-12-19T06:04:01.221ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35244
27632024-12-19T06:04:01.221ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27642024-12-19T06:04:01.258ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27652024-12-19T06:04:01.317ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96363 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:35244 req_id = 611cace2-6fba-400e-b59f-8e4c9958b890 response_code = 204 uri = /switch-ports
27662024-12-19T06:04:01.318ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35244 req_id = ad30b953-2e5f-4138-8f57-c51a214fa252 response_code = 200 uri = /network-bootstore-config
27672024-12-19T06:04:02.097ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44522
27682024-12-19T06:04:02.098ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44522 req_id = c273e6f9-bcea-4c0e-8520-34056e79bb65 response_code = 200 uri = /vpc-routes
27692024-12-19T06:04:02.141ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = a9851483-adb5-4271-9f27-41db71133b55 values = ExternalIpGatewayMap { mappings: {} }
27702024-12-19T06:04:02.141ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44522 req_id = a30f428b-d529-49ec-9fb9-2e71b9ec4367 response_code = 204 uri = /eip-gateways
27712024-12-19T06:04:02.150ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 219 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44522 req_id = c439d9c7-9953-4fbf-ba9c-d83e85e63c46 response_code = 204 uri = /vpc-routes
27722024-12-19T06:04:02.181ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39983
27732024-12-19T06:04:02.181ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39983 req_id = c91e2314-cfb0-4cb0-8f3c-2b55f6035374 response_code = 200 uri = /v2p
27742024-12-19T06:04:02.201ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42234
27752024-12-19T06:04:02.201ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27762024-12-19T06:04:02.243ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27772024-12-19T06:04:02.294ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93462 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:42234 req_id = 97053f1e-1ac9-4516-9a0a-395f714f2907 response_code = 204 uri = /switch-ports
27782024-12-19T06:04:02.295ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42234 req_id = e4925b8c-3638-4969-ab62-59a4242731fb response_code = 200 uri = /network-bootstore-config
27792024-12-19T06:04:08.936ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47639
27802024-12-19T06:04:08.936ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47639 req_id = 8ff5128d-cbda-4452-b57d-888dcdfb73f6 response_code = 200 uri = /vpc-routes
27812024-12-19T06:04:08.951ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = a9851483-adb5-4271-9f27-41db71133b55 values = ExternalIpGatewayMap { mappings: {} }
27822024-12-19T06:04:08.951ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47639 req_id = b7cb455e-057f-46e6-9ed9-9630eea5ce1a response_code = 204 uri = /eip-gateways
27832024-12-19T06:04:08.960ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 172 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47639 req_id = ca302c58-9940-4bdc-be64-3d8cab7e5cab response_code = 204 uri = /vpc-routes
27842024-12-19T06:04:09.044ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36125
27852024-12-19T06:04:09.044ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36125 req_id = 77212ec7-b79c-4f85-bfc8-2767168cba30 response_code = 200 uri = /v2p
27862024-12-19T06:04:09.057ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55449
27872024-12-19T06:04:09.057ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27882024-12-19T06:04:09.099ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27892024-12-19T06:04:09.160ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103337 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:55449 req_id = 9f09ef56-323e-43d7-8e81-aec6051cb23b response_code = 204 uri = /switch-ports
27902024-12-19T06:04:09.160ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55449 req_id = b7bc306f-bae6-4b05-8585-2402261ac3c0 response_code = 200 uri = /network-bootstore-config
27912024-12-19T06:04:11.340ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
27922024-12-19T06:04:24.931ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:33036
27932024-12-19T06:04:24.931ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:33036 req_id = 3ca672f9-995d-4fa4-8c5c-9bf4139ab94b response_code = 200 uri = /baseboard
27942024-12-19T06:04:30.004ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7804 local_addr = [fd00:1122:3344:101::1]:34192 method = GET remote_addr = [fd00:1122:3344:101::d]:58608 req_id = 8f0dc9f9-a01d-45c5-baf8-fb8e6bd94ddc response_code = 200 sled_id = a9851483-adb5-4271-9f27-41db71133b55 uri = /a9851483-adb5-4271-9f27-41db71133b55
27952024-12-19T06:04:31.221ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47948
27962024-12-19T06:04:31.221ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47948 req_id = 510539fb-355d-4bc8-a97e-628739b06b89 response_code = 200 uri = /vpc-routes
27972024-12-19T06:04:31.269ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = a9851483-adb5-4271-9f27-41db71133b55 values = ExternalIpGatewayMap { mappings: {} }
27982024-12-19T06:04:31.269ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47948 req_id = 63ca1207-827c-477d-8975-5e6691ef898f response_code = 204 uri = /eip-gateways
27992024-12-19T06:04:31.287ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 354 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47948 req_id = 16fbf9cb-1ad7-45ac-85cd-6efdd868949b response_code = 204 uri = /vpc-routes
28002024-12-19T06:04:31.384ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58181
28012024-12-19T06:04:31.385ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58181 req_id = 79a26155-c191-48aa-af1a-852420e262b5 response_code = 200 uri = /v2p
28022024-12-19T06:04:31.452ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40771
28032024-12-19T06:04:31.452ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
28042024-12-19T06:04:31.496ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
28052024-12-19T06:04:31.553ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101033 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:40771 req_id = 672f3b05-9ab7-4a74-a0d7-11a797d55fa1 response_code = 204 uri = /switch-ports
28062024-12-19T06:04:31.554ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40771 req_id = 80161128-5814-44f3-970f-4823b8d518b8 response_code = 200 uri = /network-bootstore-config
28072024-12-19T06:04:32.231ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42092
28082024-12-19T06:04:32.231ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42092 req_id = 3bc18752-ac23-4819-afde-7431e022602c response_code = 200 uri = /vpc-routes
28092024-12-19T06:04:32.278ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = a9851483-adb5-4271-9f27-41db71133b55 values = ExternalIpGatewayMap { mappings: {} }
28102024-12-19T06:04:32.278ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42092 req_id = 3d95ee96-a029-4871-933f-69e086832ec7 response_code = 204 uri = /eip-gateways
28112024-12-19T06:04:32.288ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38391
28122024-12-19T06:04:32.288ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38391 req_id = 6324f7ef-f045-4c47-9a41-a065c8339cb7 response_code = 200 uri = /v2p
28132024-12-19T06:04:32.294ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42092 req_id = dea29b18-a579-4037-9c7b-f2e78f1a9e8f response_code = 204 uri = /vpc-routes
28142024-12-19T06:04:32.368ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57879
28152024-12-19T06:04:32.368ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
28162024-12-19T06:04:32.407ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
28172024-12-19T06:04:32.465ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96467 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:57879 req_id = ca3fc420-5637-46e5-a074-997d7a546cd6 response_code = 204 uri = /switch-ports
28182024-12-19T06:04:32.465ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57879 req_id = d14bde63-f64c-4dc9-a7d8-b4e228324bcf response_code = 200 uri = /network-bootstore-config
28192024-12-19T06:04:39.061ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57245
28202024-12-19T06:04:39.061ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57245 req_id = c9c58670-0802-4049-81e7-9563af4d733d response_code = 200 uri = /vpc-routes
28212024-12-19T06:04:39.112ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = a9851483-adb5-4271-9f27-41db71133b55 values = ExternalIpGatewayMap { mappings: {} }
28222024-12-19T06:04:39.112ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57245 req_id = dfa3b1c3-81e2-43aa-b110-9aaec9f10480 response_code = 204 uri = /eip-gateways
28232024-12-19T06:04:39.176ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56944
28242024-12-19T06:04:39.176ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56944 req_id = f5a453b4-e153-4cb7-8c0d-03e4e0fc8ee1 response_code = 200 uri = /v2p
28252024-12-19T06:04:39.187ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 309 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57245 req_id = 6ac3ca53-5d52-47b4-9139-6d7641625aae response_code = 204 uri = /vpc-routes
28262024-12-19T06:04:39.212ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57996
28272024-12-19T06:04:39.212ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
28282024-12-19T06:04:39.249ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
28292024-12-19T06:04:39.306ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93902 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:57996 req_id = 036ee694-f8d9-4d1d-8899-600bb55abbea response_code = 204 uri = /switch-ports
28302024-12-19T06:04:39.307ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57996 req_id = c0a75062-ebbb-4fad-98ba-0b8c4284e3b7 response_code = 200 uri = /network-bootstore-config
28312024-12-19T06:04:45.211ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35094
28322024-12-19T06:04:45.211ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 223 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35094 req_id = 2b82fa16-e04c-4c0a-b961-d7fdc8101bbc response_code = 200 uri = /v2p
28332024-12-19T06:04:45.212ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:874 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(4164950) }
28342024-12-19T06:04:45.212ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35094 req_id = b669e2d4-67c5-4af2-9fb8-736f271e96b9 response_code = 204 uri = /v2p
28352024-12-19T06:04:45.412ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56035
28362024-12-19T06:04:45.415ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:555 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 54239c6d-f28a-47c8-8412-3581a2d9b5f4, kind: Instance { id: f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(4164950), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 54239c6d-f28a-47c8-8412-3581a2d9b5f4, kind: Instance { id: f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(4164950), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 54239c6d-f28a-47c8-8412-3581a2d9b5f4, kind: Instance { id: f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(4164950), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(4164950))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 54239c6d-f28a-47c8-8412-3581a2d9b5f4, kind: Instance { id: f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(4164950), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-eb82ef6fee3", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: ff616f83-1476-4fd8-bdb4-9da1f54423cc, read_only_parent: Some(Volume { block_size: 512, id: 50595d16-bd30-42ce-a81c-81401c71b96e, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 22dad3eb-d63f-4900-b305-6d9de7b17973, key: Some("mj5K8w7dZSF2audro+SkCYtvR54K4tjQtdAlRfSTfds="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::19]:19001", "[fd00:1122:3344:101::1a]:19002", "[fd00:1122:3344:101::12]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: ff616f83-1476-4fd8-bdb4-9da1f54423cc, key: Some("B/92KcmWuHbP8pTMtPK2G1Trn4zng9ONS1HgZvfSw1s="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::19]:19002", "[fd00:1122:3344:101::1a]:19003", "[fd00:1122:3344:101::18]:19000"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-eb82ef6fee3" }] }), cloud_init_bytes: Some(..) } instance_id = f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1 metadata = InstanceMetadata { silo_id: 945a1a16-215d-4d44-93d6-8182ecf02bfd, project_id: e600c0bb-c184-4415-a0e5-03fbd8225e9c } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5 vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-12-19T06:04:45.411799216Z }
28372024-12-19T06:04:45.415ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:588 instance_id = f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1 migration_id = None propolis_id = b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5
28382024-12-19T06:04:45.415ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1281 instance_id = f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1 migration_id = None propolis_id = b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5 state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 54239c6d-f28a-47c8-8412-3581a2d9b5f4, kind: Instance { id: f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(4164950), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 54239c6d-f28a-47c8-8412-3581a2d9b5f4, kind: Instance { id: f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(4164950), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 54239c6d-f28a-47c8-8412-3581a2d9b5f4, kind: Instance { id: f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(4164950), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(4164950))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 54239c6d-f28a-47c8-8412-3581a2d9b5f4, kind: Instance { id: f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(4164950), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-eb82ef6fee3", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: ff616f83-1476-4fd8-bdb4-9da1f54423cc, read_only_parent: Some(Volume { block_size: 512, id: 50595d16-bd30-42ce-a81c-81401c71b96e, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 22dad3eb-d63f-4900-b305-6d9de7b17973, key: Some("mj5K8w7dZSF2audro+SkCYtvR54K4tjQtdAlRfSTfds="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::19]:19001", "[fd00:1122:3344:101::1a]:19002", "[fd00:1122:3344:101::12]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: ff616f83-1476-4fd8-bdb4-9da1f54423cc, key: Some("B/92KcmWuHbP8pTMtPK2G1Trn4zng9ONS1HgZvfSw1s="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::19]:19002", "[fd00:1122:3344:101::1a]:19003", "[fd00:1122:3344:101::18]:19000"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-eb82ef6fee3" }] }), cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-12-19T06:04:45.411799216Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
28392024-12-19T06:04:45.415ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3751 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56035 req_id = 21a5b8f9-bd7d-4579-a95f-be879918fcce response_code = 200 uri = /vmms/b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5
28402024-12-19T06:04:45.509ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33469
28412024-12-19T06:04:45.509ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 220 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33469 req_id = d6054a9e-d74a-4b19-ae97-bbfc33a50d13 response_code = 200 uri = /vmms/b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5/state
28422024-12-19T06:04:45.512ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 4164950 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
28432024-12-19T06:04:45.513ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
28442024-12-19T06:04:45.556ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5 file = illumos-utils/src/zone.rs:325 instance_id = f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1 propolis_id = b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5
28452024-12-19T06:04:45.583ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5 file = illumos-utils/src/zone.rs:363 instance_id = f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1 propolis_id = b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5
28462024-12-19T06:04:45.592ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52088
28472024-12-19T06:04:45.593ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52088 req_id = bb6e834c-17da-44e9-893e-146b5ea18d92 response_code = 200 uri = /vpc-routes
28482024-12-19T06:04:45.614ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = a9851483-adb5-4271-9f27-41db71133b55 values = ExternalIpGatewayMap { mappings: {54239c6d-f28a-47c8-8412-3581a2d9b5f4: {10.151.1.175: {5bc270ca-97f0-4743-b809-4882e6b3423a}, 10.151.1.176: {5bc270ca-97f0-4743-b809-4882e6b3423a}}} }
28492024-12-19T06:04:47.046ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1 propolis_id = b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5
28502024-12-19T06:04:47.047ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5 zone file = illumos-utils/src/running_zone.rs:488 instance_id = f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1 propolis_id = b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5 zone = oxz_propolis-server_b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5
28512024-12-19T06:04:47.254ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5") failed: Property not found. retry in 65.470173ms file = illumos-utils/src/svc.rs:36 instance_id = f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1 propolis_id = b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5 zone = oxz_propolis-server_b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5
28522024-12-19T06:04:47.349ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5") failed: Property not found. retry in 104.27645ms file = illumos-utils/src/svc.rs:36 instance_id = f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1 propolis_id = b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5 zone = oxz_propolis-server_b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5
28532024-12-19T06:04:47.468ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5") failed: Property not found. retry in 150.266594ms file = illumos-utils/src/svc.rs:36 instance_id = f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1 propolis_id = b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5 zone = oxz_propolis-server_b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5
28542024-12-19T06:04:47.638ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5") failed: Property not found. retry in 550.385628ms file = illumos-utils/src/svc.rs:36 instance_id = f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1 propolis_id = b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5 zone = oxz_propolis-server_b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5
28552024-12-19T06:04:48.205ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5") failed: Property not found. retry in 819.539143ms file = illumos-utils/src/svc.rs:36 instance_id = f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1 propolis_id = b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5 zone = oxz_propolis-server_b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5
28562024-12-19T06:04:49.036ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5") failed: Property not found. retry in 750.366815ms file = illumos-utils/src/svc.rs:36 instance_id = f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1 propolis_id = b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5 zone = oxz_propolis-server_b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5
28572024-12-19T06:04:49.797ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5") failed: Property not found. retry in 611.502766ms file = illumos-utils/src/svc.rs:36 instance_id = f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1 propolis_id = b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5 zone = oxz_propolis-server_b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5
28582024-12-19T06:04:50.421ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5") failed: Property not found. retry in 1.402666143s file = illumos-utils/src/svc.rs:36 instance_id = f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1 propolis_id = b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5 zone = oxz_propolis-server_b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5
28592024-12-19T06:04:51.836ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5") failed: Property not found. retry in 584.583091ms file = illumos-utils/src/svc.rs:36 instance_id = f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1 propolis_id = b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5 zone = oxz_propolis-server_b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5
28602024-12-19T06:04:52.452ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5 file = sled-agent/src/instance.rs:1786 instance_id = f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1 propolis_id = b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5
28612024-12-19T06:04:52.462ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5") failed: Property not found. retry in 25.150882ms file = illumos-utils/src/svc.rs:36 instance_id = f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1 propolis_id = b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5
28622024-12-19T06:04:52.497ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5") failed: Property not found. retry in 120.124847ms file = illumos-utils/src/svc.rs:36 instance_id = f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1 propolis_id = b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5
28632024-12-19T06:04:52.627ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5") failed: Property not found. retry in 214.378125ms file = illumos-utils/src/svc.rs:36 instance_id = f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1 propolis_id = b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5
28642024-12-19T06:04:52.855ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:1795 instance_id = f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1 propolis_id = b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5
28652024-12-19T06:04:52.894ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:1819 instance_id = f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1 propolis_id = b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5
28662024-12-19T06:04:53.033ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:932 instance_id = f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1 propolis_id = b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5
28672024-12-19T06:04:53.035ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1243 sled_id = a9851483-adb5-4271-9f27-41db71133b55
28682024-12-19T06:04:53.035ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7421131 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52088 req_id = 6e222e66-07b2-45cc-b9de-70bec04a71ad response_code = 204 uri = /eip-gateways
28692024-12-19T06:04:53.035ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2024-12-19T06:04:53.035454601Z } file = sled-agent/src/instance.rs:780 instance_id = f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1 propolis_id = b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5
28702024-12-19T06:04:53.035ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1 new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-12-19T06:04:53.035454601Z } propolis_id = b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5
28712024-12-19T06:04:53.035ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1 propolis_id = b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5 state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-12-19T06:04:53.035454601Z }, migration_in: None, migration_out: None }
28722024-12-19T06:04:53.081ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2024-12-19T06:04:53.081894187Z } file = sled-agent/src/instance.rs:780 instance_id = f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1 propolis_id = b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5
28732024-12-19T06:04:53.081ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1 new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-12-19T06:04:53.081894187Z } propolis_id = b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5
28742024-12-19T06:04:53.081ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1 propolis_id = b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5 state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-12-19T06:04:53.081894187Z }, migration_in: None, migration_out: None }
28752024-12-19T06:04:53.120ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 289 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52088 req_id = c6c6475e-dd67-496a-bd9e-68b90ccd2d03 response_code = 204 uri = /vpc-routes
28762024-12-19T06:04:54.984ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:51929
28772024-12-19T06:04:54.985ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:51929 req_id = d9bcef21-b2f3-4718-ac2e-94c35538e6f4 response_code = 200 uri = /baseboard
28782024-12-19T06:05:00.004ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7156 local_addr = [fd00:1122:3344:101::1]:34192 method = GET remote_addr = [fd00:1122:3344:101::d]:58608 req_id = bb690212-3d00-43cf-92e7-d5bca284caef response_code = 200 sled_id = a9851483-adb5-4271-9f27-41db71133b55 uri = /a9851483-adb5-4271-9f27-41db71133b55
28792024-12-19T06:05:01.130ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49860
28802024-12-19T06:05:01.130ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49860 req_id = 299601e7-50c9-47ce-9291-4940a4f3281d response_code = 200 uri = /vmms/b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5/state
28812024-12-19T06:05:01.186ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37706
28822024-12-19T06:05:01.186ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37706 req_id = b1911b63-5763-4c5c-9be4-d43a398754ae response_code = 200 uri = /vpc-routes
28832024-12-19T06:05:01.237ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = a9851483-adb5-4271-9f27-41db71133b55 values = ExternalIpGatewayMap { mappings: {54239c6d-f28a-47c8-8412-3581a2d9b5f4: {10.151.1.175: {5bc270ca-97f0-4743-b809-4882e6b3423a}, 10.151.1.176: {5bc270ca-97f0-4743-b809-4882e6b3423a}}} }
28842024-12-19T06:05:01.239ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1456 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37706 req_id = b672530b-14fb-473e-861e-92a27991ecb4 response_code = 204 uri = /eip-gateways
28852024-12-19T06:05:01.255ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 222 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37706 req_id = 3b422f19-bcc7-4c02-b836-c559a1c27d18 response_code = 204 uri = /vpc-routes
28862024-12-19T06:05:01.340ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45847
28872024-12-19T06:05:01.340ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
28882024-12-19T06:05:01.384ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
28892024-12-19T06:05:01.442ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102374 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:45847 req_id = 1e6d9370-e689-47b2-9d50-dc13b4c4d456 response_code = 204 uri = /switch-ports
28902024-12-19T06:05:01.443ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34712
28912024-12-19T06:05:01.443ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 270 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45847 req_id = 91250f65-2210-43d9-8165-e3f2e23db374 response_code = 200 uri = /network-bootstore-config
28922024-12-19T06:05:01.443ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 242 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34712 req_id = 9b0b8d5f-e3a8-428c-a0ba-57df8a2d15a2 response_code = 200 uri = /v2p
28932024-12-19T06:05:02.156ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48434
28942024-12-19T06:05:02.156ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48434 req_id = 8d743480-e94f-4163-adde-67dd8e758b59 response_code = 200 uri = /vmms/b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5/state
28952024-12-19T06:05:02.270ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55957
28962024-12-19T06:05:02.270ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55957 req_id = be7d1830-5e9e-4e34-8a7e-dee720444611 response_code = 200 uri = /vpc-routes
28972024-12-19T06:05:02.285ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = a9851483-adb5-4271-9f27-41db71133b55 values = ExternalIpGatewayMap { mappings: {54239c6d-f28a-47c8-8412-3581a2d9b5f4: {10.151.1.175: {5bc270ca-97f0-4743-b809-4882e6b3423a}, 10.151.1.176: {5bc270ca-97f0-4743-b809-4882e6b3423a}}} }
28982024-12-19T06:05:02.285ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55957 req_id = 5de6707a-b675-41e0-a0db-c8a315ca23a8 response_code = 204 uri = /eip-gateways
28992024-12-19T06:05:02.307ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46622
29002024-12-19T06:05:02.307ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46622 req_id = 74c94bf8-19ad-4dd6-8a05-552fde6b3515 response_code = 200 uri = /v2p
29012024-12-19T06:05:02.309ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45442
29022024-12-19T06:05:02.309ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
29032024-12-19T06:05:02.353ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
29042024-12-19T06:05:02.416ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106722 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:45442 req_id = 8332d6e1-eb4b-4404-8848-c2e35989b0a7 response_code = 204 uri = /switch-ports
29052024-12-19T06:05:02.416ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 238 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45442 req_id = 2db02830-be0b-41c9-aaf5-e348253e1035 response_code = 200 uri = /network-bootstore-config
29062024-12-19T06:05:02.416ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 331 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55957 req_id = a48ff982-f567-483f-9a82-eaf6234683be response_code = 204 uri = /vpc-routes
29072024-12-19T06:05:03.039ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46336
29082024-12-19T06:05:03.039ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 581 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46336 req_id = b9a40701-ec84-44e7-ab4d-a1bebd252ea3 response_code = 200 uri = /vmms/b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5/state
29092024-12-19T06:05:03.040ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2024-12-19T06:05:03.040014869Z } file = sled-agent/src/instance.rs:780 instance_id = f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1 propolis_id = b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5
29102024-12-19T06:05:03.040ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1 new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-12-19T06:05:03.040014869Z } propolis_id = b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5
29112024-12-19T06:05:03.040ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1 propolis_id = b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5 state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-12-19T06:05:03.040014869Z }, migration_in: None, migration_out: None }
29122024-12-19T06:05:03.051ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2024-12-19T06:05:03.051687225Z } file = sled-agent/src/instance.rs:780 instance_id = f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1 propolis_id = b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5
29132024-12-19T06:05:03.051ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1 new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-12-19T06:05:03.051687225Z } propolis_id = b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5
29142024-12-19T06:05:03.051ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:816 instance_id = f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1 propolis_id = b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5
29152024-12-19T06:05:03.051ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
29162024-12-19T06:05:03.051ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 12956162184549014910 n_samples = 6 sled_id = a9851483-adb5-4271-9f27-41db71133b55
29172024-12-19T06:05:03.051ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 2777645104945663988 n_samples = 6 sled_id = a9851483-adb5-4271-9f27-41db71133b55
29182024-12-19T06:05:03.052ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
29192024-12-19T06:05:03.052ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/d2802dae-55e1-4039-8308-ca231b2dc40c/debug/bundle/zone", "/pool/int/e0de026f-6896-43b8-9686-b840d0967c1e/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/f1c83160-c846-4e0a-a537-6a326722ac5a/crypt/debug", "/pool/ext/436ef9e1-c612-46c3-866b-9e48c044fdf2/crypt/debug", "/pool/ext/defcb6a1-2bbe-47a6-a426-436ed60fd6fc/crypt/debug", "/pool/ext/a0552d97-e3e6-4586-a789-e6bcdec66672/crypt/debug", "/pool/ext/0cdd8476-a0d8-44ca-a74b-0704c56ede98/crypt/debug", "/pool/ext/0686bda3-5eb8-4859-ac7b-e5a6ceb8616d/crypt/debug", "/pool/ext/1fd2ac0f-93a9-44e1-a6b3-7ccfcdc6b252/crypt/debug", "/pool/ext/b5578c06-5ed8-4225-9470-d661174b141e/crypt/debug", "/pool/ext/c12c68d5-6ddb-4829-80b0-49f80baef150/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5
29202024-12-19T06:05:03.692ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1142 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5", bundle_id: ecf0e142-1fa0-4d3b-9a41-2047882e412d }, time_created: 2024-12-19T06:05:03.052499262Z, version: 0, cause: TerminatedInstance }
29212024-12-19T06:05:03.692ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5 file = sled-agent/src/instance.rs:1032 instance_id = f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1 propolis_id = b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5
29222024-12-19T06:05:05.464ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:279 instance_id = f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1 propolis_id = b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5
29232024-12-19T06:05:05.482ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(4164950), kind: System }
29242024-12-19T06:05:05.482ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(4164950), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
29252024-12-19T06:05:05.482ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1 propolis_id = b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-19T06:05:05.482666602Z }, migration_in: None, migration_out: None }
29262024-12-19T06:05:05.526ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1 propolis_id = b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-19T06:05:05.482666602Z }, migration_in: None, migration_out: None }
29272024-12-19T06:05:05.531ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:969 instance_id = f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1 propolis_id = b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5
29282024-12-19T06:05:06.075ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57814
29292024-12-19T06:05:06.075ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57814 req_id = 9e86124a-1b04-426c-9fc8-3b6c317374c0 response_code = 200 uri = /v2p
29302024-12-19T06:05:06.081ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42238
29312024-12-19T06:05:06.081ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42238 req_id = ddfdba10-0f34-4629-abe3-a1417485b65d response_code = 200 uri = /vpc-routes
29322024-12-19T06:05:06.096ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = a9851483-adb5-4271-9f27-41db71133b55 values = ExternalIpGatewayMap { mappings: {} }
29332024-12-19T06:05:06.096ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1243 sled_id = a9851483-adb5-4271-9f27-41db71133b55
29342024-12-19T06:05:06.096ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42238 req_id = cbe57f63-0e81-4267-a645-a7f760f4d9db response_code = 204 uri = /eip-gateways
29352024-12-19T06:05:06.105ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 279 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42238 req_id = 290dbe14-ef32-42b6-9b7a-f5c1bbcff860 response_code = 204 uri = /vpc-routes
29362024-12-19T06:05:06.212ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59232
29372024-12-19T06:05:06.212ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59232 req_id = 122e39f3-58ac-47aa-bdd4-d256ef7bd687 response_code = 200 uri = /v2p
29382024-12-19T06:05:06.381ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38537
29392024-12-19T06:05:06.381ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38537 req_id = ae236f32-a01c-4d7e-a45b-8e6e5f8b4b32 response_code = 200 uri = /vpc-routes
29402024-12-19T06:05:06.397ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = a9851483-adb5-4271-9f27-41db71133b55 values = ExternalIpGatewayMap { mappings: {} }
29412024-12-19T06:05:06.397ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38537 req_id = 674d74dc-505a-4a60-b7a9-9896b4f80a27 response_code = 204 uri = /eip-gateways
29422024-12-19T06:05:06.405ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38537 req_id = 4d9793c3-e22b-433f-b3a6-ddfb8e6f0288 response_code = 204 uri = /vpc-routes
29432024-12-19T06:05:07.079ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52031
29442024-12-19T06:05:07.079ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52031 req_id = 7e96baa3-4387-4b89-af6b-b4e9f8ec2a8a response_code = 200 uri = /vpc-routes
29452024-12-19T06:05:07.119ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = a9851483-adb5-4271-9f27-41db71133b55 values = ExternalIpGatewayMap { mappings: {} }
29462024-12-19T06:05:07.119ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52031 req_id = 292b7595-6061-4ae4-b3af-4d1990a65bc1 response_code = 204 uri = /eip-gateways
29472024-12-19T06:05:07.126ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 186 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52031 req_id = ac4aacea-5eb2-4be1-bb0e-afd6dab83501 response_code = 204 uri = /vpc-routes
29482024-12-19T06:05:08.972ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54832
29492024-12-19T06:05:08.972ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54832 req_id = e36e1e69-d784-4e15-9ea0-90c74087789a response_code = 200 uri = /vpc-routes
29502024-12-19T06:05:08.978ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48279
29512024-12-19T06:05:08.978ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48279 req_id = 872ff5e7-951e-4203-9d8e-653880c665e1 response_code = 200 uri = /v2p
29522024-12-19T06:05:09.014ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = a9851483-adb5-4271-9f27-41db71133b55 values = ExternalIpGatewayMap { mappings: {} }
29532024-12-19T06:05:09.014ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54832 req_id = 807f0f06-ae98-4393-9a5a-bf63a0617e8a response_code = 204 uri = /eip-gateways
29542024-12-19T06:05:09.023ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54832 req_id = 4d604513-7498-463c-831b-a66632ade86d response_code = 204 uri = /vpc-routes
29552024-12-19T06:05:09.053ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36945
29562024-12-19T06:05:09.053ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
29572024-12-19T06:05:09.096ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
29582024-12-19T06:05:09.159ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105489 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:36945 req_id = 4ab845a9-0d65-4802-a524-f1f20fb838a0 response_code = 204 uri = /switch-ports
29592024-12-19T06:05:09.159ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36945 req_id = 91935fc9-7254-41ae-a107-0782e5385c98 response_code = 200 uri = /network-bootstore-config