Max level shown:
1 [ Nov 25 19:27:40 Enabled. ]
2 [ Nov 25 19:27:40 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Nov 25 19:27:40 Method "start" exited with status 0. ]
4 [ Nov 25 19:27:40 Rereading configuration. ]
5 [ Nov 25 19:27:40 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72024-11-25T19:27:40.266ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:113
82024-11-25T19:27:40.267ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92024-11-25T19:27:40.320ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102024-11-25T19:27:40.320ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112024-11-25T19:27:40.435ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122024-11-25T19:27:40.444ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132024-11-25T19:27:40.452ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142024-11-25T19:27:41.056ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:9fb2::, width: 64 }
152024-11-25T19:27:41.198ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
162024-11-25T19:27:41.198ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
172024-11-25T19:27:41.198ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
182024-11-25T19:27:41.198ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192024-11-25T19:27:41.198ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:520
202024-11-25T19:27:41.198ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:717
212024-11-25T19:27:41.201ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "buskin", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:624
222024-11-25T19:27:41.201ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:766
232024-11-25T19:27:41.201ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
242024-11-25T19:27:41.201ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:825
252024-11-25T19:27:41.201ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
262024-11-25T19:27:41.201ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272024-11-25T19:27:41.201ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
282024-11-25T19:27:41.201ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292024-11-25T19:27:41.201ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302024-11-25T19:27:41.213ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:367
312024-11-25T19:27:41.213ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = dd272387-9bb6-475e-8ebb-47dcac6d1d2a (zpool)
322024-11-25T19:27:41.314ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: dd272387-9bb6-475e-8ebb-47dcac6d1d2a (zpool), kind: Internal }
332024-11-25T19:27:41.788ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:603
342024-11-25T19:27:41.788ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
352024-11-25T19:27:41.788ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362024-11-25T19:27:41.788ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372024-11-25T19:27:41.788ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
382024-11-25T19:27:41.788ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392024-11-25T19:27:41.788ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402024-11-25T19:27:41.797ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:367
412024-11-25T19:27:41.797ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = a4bf8354-b44e-436c-b4f2-9bd494b77342 (zpool)
422024-11-25T19:27:42.555ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: a4bf8354-b44e-436c-b4f2-9bd494b77342 (zpool), kind: Internal }
432024-11-25T19:27:44.694ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
442024-11-25T19:27:44.694ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: dd272387-9bb6-475e-8ebb-47dcac6d1d2a (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a4bf8354-b44e-436c-b4f2-9bd494b77342 (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
452024-11-25T19:27:44.694ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
462024-11-25T19:27:44.694ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
472024-11-25T19:27:44.694ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
482024-11-25T19:27:44.694ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
492024-11-25T19:27:44.694ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
502024-11-25T19:27:44.694ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: dd272387-9bb6-475e-8ebb-47dcac6d1d2a (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a4bf8354-b44e-436c-b4f2-9bd494b77342 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
512024-11-25T19:27:44.694ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
522024-11-25T19:27:44.694ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
532024-11-25T19:27:44.694ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
542024-11-25T19:27:44.694ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
552024-11-25T19:27:44.694ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
562024-11-25T19:27:44.694ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: dd272387-9bb6-475e-8ebb-47dcac6d1d2a (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a4bf8354-b44e-436c-b4f2-9bd494b77342 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
572024-11-25T19:27:44.694ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
582024-11-25T19:27:44.694ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
592024-11-25T19:27:44.694ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
602024-11-25T19:27:44.694ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
612024-11-25T19:27:44.694ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
622024-11-25T19:27:44.694ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: dd272387-9bb6-475e-8ebb-47dcac6d1d2a (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a4bf8354-b44e-436c-b4f2-9bd494b77342 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
632024-11-25T19:27:44.694ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
642024-11-25T19:27:44.694ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
652024-11-25T19:27:44.694ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
662024-11-25T19:27:44.694ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
672024-11-25T19:27:44.694ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
682024-11-25T19:27:44.694ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: dd272387-9bb6-475e-8ebb-47dcac6d1d2a (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a4bf8354-b44e-436c-b4f2-9bd494b77342 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
692024-11-25T19:27:44.694ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
702024-11-25T19:27:44.694ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
712024-11-25T19:27:44.694ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
722024-11-25T19:27:44.694ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
732024-11-25T19:27:44.694ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
742024-11-25T19:27:44.694ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: dd272387-9bb6-475e-8ebb-47dcac6d1d2a (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a4bf8354-b44e-436c-b4f2-9bd494b77342 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
752024-11-25T19:27:44.694ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
762024-11-25T19:27:44.694ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
772024-11-25T19:27:44.694ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
782024-11-25T19:27:44.694ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
792024-11-25T19:27:44.694ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
802024-11-25T19:27:44.694ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: dd272387-9bb6-475e-8ebb-47dcac6d1d2a (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a4bf8354-b44e-436c-b4f2-9bd494b77342 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
812024-11-25T19:27:44.694ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
822024-11-25T19:27:44.694ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
832024-11-25T19:27:44.694ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
842024-11-25T19:27:44.694ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
852024-11-25T19:27:44.694ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
862024-11-25T19:27:44.694ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: dd272387-9bb6-475e-8ebb-47dcac6d1d2a (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a4bf8354-b44e-436c-b4f2-9bd494b77342 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
872024-11-25T19:27:44.694ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
882024-11-25T19:27:44.694ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
892024-11-25T19:27:44.694ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
902024-11-25T19:27:44.694ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
912024-11-25T19:27:44.694ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
922024-11-25T19:27:44.694ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: dd272387-9bb6-475e-8ebb-47dcac6d1d2a (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a4bf8354-b44e-436c-b4f2-9bd494b77342 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
932024-11-25T19:27:44.694ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
942024-11-25T19:27:44.694ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
952024-11-25T19:27:44.694ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
962024-11-25T19:27:44.694ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
972024-11-25T19:27:44.694ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
982024-11-25T19:27:44.694ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
992024-11-25T19:27:44.694ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: dd272387-9bb6-475e-8ebb-47dcac6d1d2a (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a4bf8354-b44e-436c-b4f2-9bd494b77342 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
1002024-11-25T19:27:44.694ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1012024-11-25T19:27:44.694ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
1022024-11-25T19:27:44.694ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1032024-11-25T19:27:44.695ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1042024-11-25T19:27:44.695ZINFOSledAgent (bootstore): No ledger in /pool/int/dd272387-9bb6-475e-8ebb-47dcac6d1d2a/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:189 peer_id = pc-buskin-i86pc
1052024-11-25T19:27:44.695ZINFOSledAgent (bootstore): No ledger in /pool/int/a4bf8354-b44e-436c-b4f2-9bd494b77342/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:189 peer_id = pc-buskin-i86pc
1062024-11-25T19:27:44.695ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-buskin-i86pc
1072024-11-25T19:27:44.695ZINFOSledAgent (bootstore): No ledger in /pool/int/dd272387-9bb6-475e-8ebb-47dcac6d1d2a/cluster/bootstore-network-config.json file = common/src/ledger.rs:189 peer_id = pc-buskin-i86pc
1082024-11-25T19:27:44.695ZINFOSledAgent (bootstore): No ledger in /pool/int/a4bf8354-b44e-436c-b4f2-9bd494b77342/cluster/bootstore-network-config.json file = common/src/ledger.rs:189 peer_id = pc-buskin-i86pc
1092024-11-25T19:27:44.695ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-buskin-i86pc
1102024-11-25T19:27:44.695ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1112024-11-25T19:27:44.695ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1122024-11-25T19:27:44.706ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:743
1132024-11-25T19:27:44.706ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1491, tv_nsec: 224305057 } time_to_next_cleanup = 599.999945449s
1142024-11-25T19:27:44.706ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:4001
1152024-11-25T19:27:44.706ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1162024-11-25T19:27:44.706ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/dd272387-9bb6-475e-8ebb-47dcac6d1d2a/config/sled-agent-request.json file = common/src/ledger.rs:189
1172024-11-25T19:27:44.709ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/a4bf8354-b44e-436c-b4f2-9bd494b77342/config/sled-agent-request.json file = common/src/ledger.rs:189
1182024-11-25T19:27:44.709ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80
1192024-11-25T19:27:44.711ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:9fb2::1]:12346
1202024-11-25T19:27:44.711ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.1.164, last: 10.151.1.173, }, ), ], external_dns_ips: [ 10.151.1.164, 10.151.1.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1200
1212024-11-25T19:27:44.711ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1222024-11-25T19:27:44.711ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1232024-11-25T19:27:44.711ZINFOSledAgent (RSS): No ledger in /pool/int/dd272387-9bb6-475e-8ebb-47dcac6d1d2a/config/rss-plan-completed.marker file = common/src/ledger.rs:189
1242024-11-25T19:27:44.711ZINFOSledAgent (RSS): No ledger in /pool/int/a4bf8354-b44e-436c-b4f2-9bd494b77342/config/rss-plan-completed.marker file = common/src/ledger.rs:189
1252024-11-25T19:27:44.711ZINFOSledAgent (RSS): RSS configuration has not been fully applied yet file = sled-agent/src/rack_setup/service.rs:1263
1262024-11-25T19:27:44.711ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1272024-11-25T19:27:44.711ZINFOSledAgent (RSS): No ledger in /pool/int/dd272387-9bb6-475e-8ebb-47dcac6d1d2a/config/rss-sled-plan.json file = common/src/ledger.rs:189
1282024-11-25T19:27:44.711ZINFOSledAgent (RSS): No ledger in /pool/int/a4bf8354-b44e-436c-b4f2-9bd494b77342/config/rss-sled-plan.json file = common/src/ledger.rs:189
1292024-11-25T19:27:44.711ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1305
1302024-11-25T19:27:44.711ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:156
1312024-11-25T19:27:44.711ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:9fb2::1 file = sled-agent/src/rack_setup/plan/sled.rs:129
1322024-11-25T19:27:44.711ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1332024-11-25T19:27:44.711ZINFOSledAgent (RSS): Writing ledger to /pool/int/dd272387-9bb6-475e-8ebb-47dcac6d1d2a/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:200
1342024-11-25T19:27:44.712ZINFOSledAgent (RSS): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/dd272387-9bb6-475e-8ebb-47dcac6d1d2a/config/rss-sled-plan.json"
1352024-11-25T19:27:44.712ZINFOSledAgent (RSS): Writing ledger to /pool/int/a4bf8354-b44e-436c-b4f2-9bd494b77342/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:200
1362024-11-25T19:27:44.712ZINFOSledAgent (RSS): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/a4bf8354-b44e-436c-b4f2-9bd494b77342/config/rss-sled-plan.json"
1372024-11-25T19:27:44.712ZINFOSledAgent (RSS): Sled plan written to storage: Plan { rack_id: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, sleds: { [fdb0:18c0:4d0d:9fb2::1]:12346: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 38711855-ef69-4d79-bb75-aebd85b1280b (sled), rack_id: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64, }, }, }, }, }, config: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.1.164, last: 10.151.1.173, }, ), ], external_dns_ips: [ 10.151.1.164, 10.151.1.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, }, } file = sled-agent/src/rack_setup/plan/sled.rs:176
1382024-11-25T19:27:44.712ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1339
1392024-11-25T19:27:44.712ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
1402024-11-25T19:27:44.712ZINFOSledAgent (bootstore): Writing ledger to /pool/int/dd272387-9bb6-475e-8ebb-47dcac6d1d2a/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:200 peer_id = pc-buskin-i86pc
1412024-11-25T19:27:44.712ZINFOSledAgent (bootstore): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/dd272387-9bb6-475e-8ebb-47dcac6d1d2a/cluster/bootstore-network-config.json" peer_id = pc-buskin-i86pc
1422024-11-25T19:27:44.712ZINFOSledAgent (bootstore): Writing ledger to /pool/int/a4bf8354-b44e-436c-b4f2-9bd494b77342/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:200 peer_id = pc-buskin-i86pc
1432024-11-25T19:27:44.712ZINFOSledAgent (bootstore): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/a4bf8354-b44e-436c-b4f2-9bd494b77342/cluster/bootstore-network-config.json" peer_id = pc-buskin-i86pc
1442024-11-25T19:27:44.712ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
1452024-11-25T19:27:44.713ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 38711855-ef69-4d79-bb75-aebd85b1280b (sled), rack_id: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
1462024-11-25T19:27:44.713ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4298
1472024-11-25T19:27:44.713ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4698
1482024-11-25T19:27:44.718ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/client.rs:50
1492024-11-25T19:27:44.724ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1502024-11-25T19:27:44.724ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1512024-11-25T19:27:44.728ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1522024-11-25T19:27:44.728ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1532024-11-25T19:27:44.728ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:51201
1542024-11-25T19:27:44.728ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 38711855-ef69-4d79-bb75-aebd85b1280b (sled), rack_id: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:362
1552024-11-25T19:27:44.728ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:377
1562024-11-25T19:27:44.728ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1572024-11-25T19:27:44.728ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1582024-11-25T19:27:44.728ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:603
1592024-11-25T19:27:44.728ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1602024-11-25T19:27:44.728ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:809
1612024-11-25T19:27:44.728ZINFOSledAgent (StorageManager): No ledger in /pool/int/dd272387-9bb6-475e-8ebb-47dcac6d1d2a/config/omicron-physical-disks.json file = common/src/ledger.rs:189 request = load_disks_ledger
1622024-11-25T19:27:44.728ZINFOSledAgent (StorageManager): No ledger in /pool/int/a4bf8354-b44e-436c-b4f2-9bd494b77342/config/omicron-physical-disks.json file = common/src/ledger.rs:189 request = load_disks_ledger
1632024-11-25T19:27:44.729ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:798
1642024-11-25T19:27:44.729ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:826
1652024-11-25T19:27:44.729ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:592
1662024-11-25T19:27:44.729ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1672024-11-25T19:27:44.729ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:697 result = DisksManagementResult { status: [] }
1682024-11-25T19:27:44.745ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1692024-11-25T19:27:44.765ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:325
1702024-11-25T19:27:44.783ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:363
1712024-11-25T19:27:44.789ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:407 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
1722024-11-25T19:27:44.789ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1732024-11-25T19:27:44.789ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:419 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
1742024-11-25T19:27:44.789ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1752024-11-25T19:27:44.792ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 93.243935ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "47bae99b-02fc-4300-a45f-5f71e0e7019f", "content-length": "124", "date": "Mon, 25 Nov 2024 19:27:44 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "47bae99b-02fc-4300-a45f-5f71e0e7019f" } file = clients/ddm-admin-client/src/lib.rs:177
1762024-11-25T19:27:44.802ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_dd272387-9bb6-475e-8ebb-47dcac6d1d2a/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1772024-11-25T19:27:44.886ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1782024-11-25T19:27:44.887ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 121.531083ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "4b2f5ab6-1046-4c17-afe9-ae4f05d1e7e1", "content-length": "124", "date": "Mon, 25 Nov 2024 19:27:44 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "4b2f5ab6-1046-4c17-afe9-ae4f05d1e7e1" } file = clients/ddm-admin-client/src/lib.rs:177
1792024-11-25T19:27:44.912ZINFOSledAgent: successfully created encrypted zvol: name="oxi_dd272387-9bb6-475e-8ebb-47dcac6d1d2a/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1802024-11-25T19:27:44.912ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_dd272387-9bb6-475e-8ebb-47dcac6d1d2a/swap" file = sled-agent/src/swap_device.rs:96
1812024-11-25T19:27:44.918ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:434 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
1822024-11-25T19:27:44.918ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:128
1832024-11-25T19:27:44.918ZINFOSledAgent (BackingFs): Ensuring dataset oxi_dd272387-9bb6-475e-8ebb-47dcac6d1d2a/backing/fmd file = sled-agent/src/backing_fs.rs:138
1842024-11-25T19:27:45.009ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1852024-11-25T19:27:45.010ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 180.569197ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "0eaa72ad-1534-4f7c-b85c-b57e49a89c5f", "content-length": "124", "date": "Mon, 25 Nov 2024 19:27:44 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "0eaa72ad-1534-4f7c-b85c-b57e49a89c5f" } file = clients/ddm-admin-client/src/lib.rs:177
1862024-11-25T19:27:45.191ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1872024-11-25T19:27:45.192ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 125.201059ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "972822b3-d1d9-45ae-bcb7-2ff42bbe83c4", "content-length": "124", "date": "Mon, 25 Nov 2024 19:27:44 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "972822b3-d1d9-45ae-bcb7-2ff42bbe83c4" } file = clients/ddm-admin-client/src/lib.rs:177
1882024-11-25T19:27:45.318ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1892024-11-25T19:27:45.319ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 138.530751ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "c8f87826-69e5-444d-bac2-b3f075526dd4", "content-length": "124", "date": "Mon, 25 Nov 2024 19:27:44 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "c8f87826-69e5-444d-bac2-b3f075526dd4" } file = clients/ddm-admin-client/src/lib.rs:177
1902024-11-25T19:27:45.343ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:173
1912024-11-25T19:27:45.458ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1922024-11-25T19:27:45.459ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 281.07653ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "0a8b5fcb-7bc7-4b7e-b82f-4cde7ef99da4", "content-length": "124", "date": "Mon, 25 Nov 2024 19:27:44 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "0a8b5fcb-7bc7-4b7e-b82f-4cde7ef99da4" } file = clients/ddm-admin-client/src/lib.rs:177
1932024-11-25T19:27:45.461ZINFOSledAgent (BackingFs): Mounting oxi_dd272387-9bb6-475e-8ebb-47dcac6d1d2a/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:181
1942024-11-25T19:27:45.477ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:189
1952024-11-25T19:27:45.477ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:189
1962024-11-25T19:27:45.477ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:189
1972024-11-25T19:27:45.477ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:195
1982024-11-25T19:27:45.742ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1992024-11-25T19:27:45.743ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 297.259501ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "cf8b97be-a292-45a0-838a-527f4b011dcf", "content-length": "124", "date": "Mon, 25 Nov 2024 19:27:45 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "cf8b97be-a292-45a0-838a-527f4b011dcf" } file = clients/ddm-admin-client/src/lib.rs:177
2002024-11-25T19:27:46.041ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
2012024-11-25T19:27:46.042ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 241.722856ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "819db178-ea27-4a4c-aeca-3ec02ef93258", "content-length": "124", "date": "Mon, 25 Nov 2024 19:27:45 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "819db178-ea27-4a4c-aeca-3ec02ef93258" } file = clients/ddm-admin-client/src/lib.rs:177
2022024-11-25T19:27:46.286ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
2032024-11-25T19:27:46.286ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 439.043316ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "a60769f1-c222-4d55-9759-1cf43f34f855", "content-length": "124", "date": "Mon, 25 Nov 2024 19:27:45 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "a60769f1-c222-4d55-9759-1cf43f34f855" } file = clients/ddm-admin-client/src/lib.rs:177
2042024-11-25T19:27:46.344ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:93 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
2052024-11-25T19:27:46.350ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:49777 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
2062024-11-25T19:27:46.350ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
2072024-11-25T19:27:46.350ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:49777 file = oximeter/producer/src/lib.rs:279 interval = 30s producer_id = 38711855-ef69-4d79-bb75-aebd85b1280b sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
2082024-11-25T19:27:46.351ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 252.062106ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
2092024-11-25T19:27:46.352ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
2102024-11-25T19:27:46.352ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
2112024-11-25T19:27:46.352ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:927 underlay_address = fd00:1122:3344:101::1
2122024-11-25T19:27:46.352ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
2132024-11-25T19:27:46.605ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 289.378022ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
2142024-11-25T19:27:46.727ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
2152024-11-25T19:27:46.896ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 613.463971ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
2162024-11-25T19:27:47.510ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 2.290656562s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
2172024-11-25T19:27:48.574ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2676
2182024-11-25T19:27:48.574ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2921
2192024-11-25T19:27:48.574ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2546
2202024-11-25T19:27:48.574ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2593
2212024-11-25T19:27:48.574ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:3002
2222024-11-25T19:27:48.574ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3047
2232024-11-25T19:27:48.576ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2846
2242024-11-25T19:27:48.578ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2587
2252024-11-25T19:27:48.578ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='b2b2b805-c910-42f7-8bd4-d5f05a06bed3'/> <propval type="astring" name="rack_id" value='bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:9fb2::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:fefd:37b0'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:9fb2::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"buskin","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="rack_id" value='bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c'/> <propval type="astring" name="sled_id" value='38711855-ef69-4d79-bb75-aebd85b1280b'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='buskin'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="host" value='[::1]'/> <propval type="astring" name="port" value='12224'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='buskin'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='38711855-ef69-4d79-bb75-aebd85b1280b'/> <propval type="astring" name="rack_uuid" value='bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='38711855-ef69-4d79-bb75-aebd85b1280b'/> <propval type="astring" name="rack_uuid" value='bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2262024-11-25T19:27:48.578ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_switch
2272024-11-25T19:27:48.903ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 40.107278ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2282024-11-25T19:27:49.113ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 76.030302ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2292024-11-25T19:27:49.286ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 142.345089ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2302024-11-25T19:27:49.457ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 513.89622ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2312024-11-25T19:27:49.802ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 2.957394275s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
2322024-11-25T19:27:50.049ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.183752307s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2332024-11-25T19:27:51.272ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 659.631679ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2342024-11-25T19:27:51.958ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.195774356s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2352024-11-25T19:27:52.762ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 9.44214216s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
2362024-11-25T19:27:53.324ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.378147812s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2372024-11-25T19:27:55.086ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/38711855-ef69-4d79-bb75-aebd85b1280b) file = sled-agent/src/nexus.rs:527 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
2382024-11-25T19:27:55.116ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2392024-11-25T19:27:55.117ZINFOSledAgent (dropshot (Repo Depot)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12348 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
2402024-11-25T19:27:55.117ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12345
2412024-11-25T19:27:55.117ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:432
2422024-11-25T19:27:55.117ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2432024-11-25T19:27:55.117ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/dd272387-9bb6-475e-8ebb-47dcac6d1d2a/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:200
2442024-11-25T19:27:55.118ZINFOSledAgent (SledAgentMain): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/dd272387-9bb6-475e-8ebb-47dcac6d1d2a/config/sled-agent-request.json"
2452024-11-25T19:27:55.118ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/a4bf8354-b44e-436c-b4f2-9bd494b77342/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:200
2462024-11-25T19:27:55.118ZINFOSledAgent (SledAgentMain): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/a4bf8354-b44e-436c-b4f2-9bd494b77342/config/sled-agent-request.json"
2472024-11-25T19:27:55.118ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2482024-11-25T19:27:55.118ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some(None), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None }], bgp: [], bfd: [] })))
2492024-11-25T19:27:55.118ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:4001
2502024-11-25T19:27:55.118ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:51201
2512024-11-25T19:27:55.327ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:9fb2::1]:12346
2522024-11-25T19:27:55.327ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
2532024-11-25T19:27:55.327ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2542024-11-25T19:27:55.327ZINFOSledAgent (RSS): No ledger in /pool/int/dd272387-9bb6-475e-8ebb-47dcac6d1d2a/config/rss-service-plan-v5.json file = common/src/ledger.rs:189
2552024-11-25T19:27:55.327ZINFOSledAgent (RSS): No ledger in /pool/int/a4bf8354-b44e-436c-b4f2-9bd494b77342/config/rss-service-plan-v5.json file = common/src/ledger.rs:189
2562024-11-25T19:27:55.327ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2572024-11-25T19:27:55.327ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2582024-11-25T19:27:55.327ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2592024-11-25T19:27:55.327ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2602024-11-25T19:27:55.332ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4322 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2612024-11-25T19:27:55.332ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:4338
2622024-11-25T19:27:55.332ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:534 zone = oxz_switch
2632024-11-25T19:27:55.599ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47989
2642024-11-25T19:27:55.599ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2652024-11-25T19:27:55.599ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2662024-11-25T19:27:55.599ZINFOSledAgent (ServiceManager): No ledger in /pool/int/dd272387-9bb6-475e-8ebb-47dcac6d1d2a/config/omicron-zones.json file = common/src/ledger.rs:189
2672024-11-25T19:27:55.599ZINFOSledAgent (ServiceManager): No ledger in /pool/int/a4bf8354-b44e-436c-b4f2-9bd494b77342/config/omicron-zones.json file = common/src/ledger.rs:189
2682024-11-25T19:27:55.599ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 366 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:47989 req_id = 36a6efec-51ce-424c-993e-5dcf3be77b49 response_code = 200 uri = /inventory
2692024-11-25T19:27:55.631ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41955
2702024-11-25T19:27:55.631ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 29 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:41955 req_id = 0f096e28-0000-43af-993e-a9c3be0fae5a response_code = 200 uri = /sled-role
2712024-11-25T19:27:55.633ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2722024-11-25T19:27:55.633ZINFOSledAgent (RSS): Writing ledger to /pool/int/dd272387-9bb6-475e-8ebb-47dcac6d1d2a/config/.rss-service-plan-v5.json.tmp file = common/src/ledger.rs:200
2732024-11-25T19:27:55.633ZINFOSledAgent (RSS): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/dd272387-9bb6-475e-8ebb-47dcac6d1d2a/config/rss-service-plan-v5.json"
2742024-11-25T19:27:55.633ZINFOSledAgent (RSS): Writing ledger to /pool/int/a4bf8354-b44e-436c-b4f2-9bd494b77342/config/.rss-service-plan-v5.json.tmp file = common/src/ledger.rs:200
2752024-11-25T19:27:55.633ZINFOSledAgent (RSS): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/a4bf8354-b44e-436c-b4f2-9bd494b77342/config/rss-service-plan-v5.json"
2762024-11-25T19:27:55.633ZINFOSledAgent (RSS): Service plan written to storage file = sled-agent/src/rack_setup/plan/service.rs:980
2772024-11-25T19:27:55.663ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(1), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: b048b34a-75aa-4bad-b776-d3f8f218c18c, pool_id: 71fa9360-75cf-491a-b7ef-fd270ae2f32c (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 0a9b02ad-f3c2-4ceb-8b34-b3ac669cdd52, pool_id: cc26c009-a951-4771-a26a-f2513b9e63e2 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: ca291b27-d496-4732-9f3e-f8baceb32d76, pool_id: 56aea45f-c451-4174-9b8f-66145c2696e8 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 861dcc11-e75f-4cc1-8062-54d454843acc, pool_id: d7af1128-7206-4198-91cb-ef632ea8556e (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: d6301858-b1fb-4502-9b27-568c6acf5c62, pool_id: fe712103-328f-4ff5-a621-99ae42de7f00 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 789102d9-c835-48c4-9911-5ca432cdc4ab, pool_id: ca727341-d003-494b-b98d-9fa5b5aeeec8 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 2dee4fa6-735b-45e2-9555-b16c367d283b, pool_id: 1b4c5120-bb11-444d-9c86-edb04be1264c (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: f70fc958-8475-41a9-ad11-f0e856a00356, pool_id: df57d550-ef00-4438-9a9e-b1b08bdaa525 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 473ba020-9209-4a1b-8931-1b190b0a7a71, pool_id: 2517e8b2-3022-4575-a6ad-4786cce7adb4 (zpool) }] } file = sled-agent/src/rack_setup/service.rs:382 sled_address = [fd00:1122:3344:101::1]:12345
2782024-11-25T19:27:55.663ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33710
2792024-11-25T19:27:55.663ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:883 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
2802024-11-25T19:27:55.663ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(1), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: b048b34a-75aa-4bad-b776-d3f8f218c18c, pool_id: 71fa9360-75cf-491a-b7ef-fd270ae2f32c (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 0a9b02ad-f3c2-4ceb-8b34-b3ac669cdd52, pool_id: cc26c009-a951-4771-a26a-f2513b9e63e2 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: ca291b27-d496-4732-9f3e-f8baceb32d76, pool_id: 56aea45f-c451-4174-9b8f-66145c2696e8 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 861dcc11-e75f-4cc1-8062-54d454843acc, pool_id: d7af1128-7206-4198-91cb-ef632ea8556e (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: d6301858-b1fb-4502-9b27-568c6acf5c62, pool_id: fe712103-328f-4ff5-a621-99ae42de7f00 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 789102d9-c835-48c4-9911-5ca432cdc4ab, pool_id: ca727341-d003-494b-b98d-9fa5b5aeeec8 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 2dee4fa6-735b-45e2-9555-b16c367d283b, pool_id: 1b4c5120-bb11-444d-9c86-edb04be1264c (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: f70fc958-8475-41a9-ad11-f0e856a00356, pool_id: df57d550-ef00-4438-9a9e-b1b08bdaa525 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 473ba020-9209-4a1b-8931-1b190b0a7a71, pool_id: 2517e8b2-3022-4575-a6ad-4786cce7adb4 (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:603
2812024-11-25T19:27:55.664ZINFOSledAgent (StorageManager): No ledger in /pool/int/dd272387-9bb6-475e-8ebb-47dcac6d1d2a/config/omicron-physical-disks.json file = common/src/ledger.rs:189 request = omicron_physical_disks_ensure
2822024-11-25T19:27:55.664ZINFOSledAgent (StorageManager): No ledger in /pool/int/a4bf8354-b44e-436c-b4f2-9bd494b77342/config/omicron-physical-disks.json file = common/src/ledger.rs:189 request = omicron_physical_disks_ensure
2832024-11-25T19:27:55.664ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:1175 request = omicron_physical_disks_ensure
2842024-11-25T19:27:55.664ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2852024-11-25T19:27:55.664ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2862024-11-25T19:27:55.664ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2872024-11-25T19:27:55.664ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2882024-11-25T19:27:55.827ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:367
2892024-11-25T19:27:55.827ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 71fa9360-75cf-491a-b7ef-fd270ae2f32c (zpool)
2902024-11-25T19:27:56.285ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/38711855-ef69-4d79-bb75-aebd85b1280b) file = sled-agent/src/probe_manager.rs:231 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
2912024-11-25T19:27:56.745ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
2922024-11-25T19:27:56.746ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14677523493110185006 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
2932024-11-25T19:27:56.746ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4713903543762200350 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
2942024-11-25T19:27:56.779ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 71fa9360-75cf-491a-b7ef-fd270ae2f32c (zpool), kind: External }
2952024-11-25T19:27:56.787ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:240
2962024-11-25T19:27:56.787ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:242
2972024-11-25T19:27:56.787ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:246
2982024-11-25T19:27:56.787ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:248
2992024-11-25T19:27:56.787ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
3002024-11-25T19:27:56.787ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
3012024-11-25T19:27:56.787ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3022024-11-25T19:27:56.822ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3032024-11-25T19:27:56.829ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_71fa9360-75cf-491a-b7ef-fd270ae2f32c/crypt/zone file = sled-storage/src/dataset.rs:303
3042024-11-25T19:27:56.998ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_71fa9360-75cf-491a-b7ef-fd270ae2f32c file = sled-storage/src/dataset.rs:389
3052024-11-25T19:27:57.006ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
3062024-11-25T19:27:57.006ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
3072024-11-25T19:27:57.006ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
3082024-11-25T19:27:57.006ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3092024-11-25T19:27:57.006ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
3102024-11-25T19:27:57.017ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:367
3112024-11-25T19:27:57.017ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = cc26c009-a951-4771-a26a-f2513b9e63e2 (zpool)
3122024-11-25T19:27:57.108ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: cc26c009-a951-4771-a26a-f2513b9e63e2 (zpool), kind: External }
3132024-11-25T19:27:57.116ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:240
3142024-11-25T19:27:57.116ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:242
3152024-11-25T19:27:57.116ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:246
3162024-11-25T19:27:57.116ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:248
3172024-11-25T19:27:57.116ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
3182024-11-25T19:27:57.116ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
3192024-11-25T19:27:57.116ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3202024-11-25T19:27:57.148ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3212024-11-25T19:27:57.155ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_cc26c009-a951-4771-a26a-f2513b9e63e2/crypt/zone file = sled-storage/src/dataset.rs:303
3222024-11-25T19:27:57.288ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/38711855-ef69-4d79-bb75-aebd85b1280b) file = sled-agent/src/probe_manager.rs:231 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
3232024-11-25T19:27:57.316ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_cc26c009-a951-4771-a26a-f2513b9e63e2 file = sled-storage/src/dataset.rs:389
3242024-11-25T19:27:57.323ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
3252024-11-25T19:27:57.323ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
3262024-11-25T19:27:57.323ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
3272024-11-25T19:27:57.323ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3282024-11-25T19:27:57.323ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3292024-11-25T19:27:57.331ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:367
3302024-11-25T19:27:57.331ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 56aea45f-c451-4174-9b8f-66145c2696e8 (zpool)
3312024-11-25T19:27:57.417ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 56aea45f-c451-4174-9b8f-66145c2696e8 (zpool), kind: External }
3322024-11-25T19:27:57.424ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:240
3332024-11-25T19:27:57.424ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:242
3342024-11-25T19:27:57.424ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:246
3352024-11-25T19:27:57.424ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:248
3362024-11-25T19:27:57.424ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3372024-11-25T19:27:57.424ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3382024-11-25T19:27:57.424ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3392024-11-25T19:27:57.455ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3402024-11-25T19:27:57.462ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_56aea45f-c451-4174-9b8f-66145c2696e8/crypt/zone file = sled-storage/src/dataset.rs:303
3412024-11-25T19:27:57.636ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_56aea45f-c451-4174-9b8f-66145c2696e8 file = sled-storage/src/dataset.rs:389
3422024-11-25T19:27:57.643ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3432024-11-25T19:27:57.643ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3442024-11-25T19:27:57.643ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3452024-11-25T19:27:57.643ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3462024-11-25T19:27:57.643ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3472024-11-25T19:27:57.654ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:367
3482024-11-25T19:27:57.654ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = d7af1128-7206-4198-91cb-ef632ea8556e (zpool)
3492024-11-25T19:27:57.750ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: d7af1128-7206-4198-91cb-ef632ea8556e (zpool), kind: External }
3502024-11-25T19:27:57.757ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:240
3512024-11-25T19:27:57.758ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:242
3522024-11-25T19:27:57.758ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:246
3532024-11-25T19:27:57.758ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:248
3542024-11-25T19:27:57.758ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3552024-11-25T19:27:57.758ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3562024-11-25T19:27:57.758ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3572024-11-25T19:27:57.793ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3582024-11-25T19:27:57.801ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_d7af1128-7206-4198-91cb-ef632ea8556e/crypt/zone file = sled-storage/src/dataset.rs:303
3592024-11-25T19:27:57.974ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_d7af1128-7206-4198-91cb-ef632ea8556e file = sled-storage/src/dataset.rs:389
3602024-11-25T19:27:57.982ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3612024-11-25T19:27:57.982ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3622024-11-25T19:27:57.982ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3632024-11-25T19:27:57.982ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3642024-11-25T19:27:57.982ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3652024-11-25T19:27:57.992ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:367
3662024-11-25T19:27:57.992ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = fe712103-328f-4ff5-a621-99ae42de7f00 (zpool)
3672024-11-25T19:27:58.085ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: fe712103-328f-4ff5-a621-99ae42de7f00 (zpool), kind: External }
3682024-11-25T19:27:58.092ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:240
3692024-11-25T19:27:58.092ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:242
3702024-11-25T19:27:58.092ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:246
3712024-11-25T19:27:58.092ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:248
3722024-11-25T19:27:58.092ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3732024-11-25T19:27:58.092ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3742024-11-25T19:27:58.092ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3752024-11-25T19:27:58.124ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3762024-11-25T19:27:58.132ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_fe712103-328f-4ff5-a621-99ae42de7f00/crypt/zone file = sled-storage/src/dataset.rs:303
3772024-11-25T19:27:58.290ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/38711855-ef69-4d79-bb75-aebd85b1280b) file = sled-agent/src/probe_manager.rs:231 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
3782024-11-25T19:27:58.306ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_fe712103-328f-4ff5-a621-99ae42de7f00 file = sled-storage/src/dataset.rs:389
3792024-11-25T19:27:58.314ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3802024-11-25T19:27:58.314ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3812024-11-25T19:27:58.314ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3822024-11-25T19:27:58.314ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3832024-11-25T19:27:58.314ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3842024-11-25T19:27:58.324ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:367
3852024-11-25T19:27:58.324ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = ca727341-d003-494b-b98d-9fa5b5aeeec8 (zpool)
3862024-11-25T19:27:58.434ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: ca727341-d003-494b-b98d-9fa5b5aeeec8 (zpool), kind: External }
3872024-11-25T19:27:58.441ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:240
3882024-11-25T19:27:58.441ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:242
3892024-11-25T19:27:58.441ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:246
3902024-11-25T19:27:58.441ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:248
3912024-11-25T19:27:58.441ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3922024-11-25T19:27:58.442ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3932024-11-25T19:27:58.442ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3942024-11-25T19:27:58.478ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3952024-11-25T19:27:58.485ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_ca727341-d003-494b-b98d-9fa5b5aeeec8/crypt/zone file = sled-storage/src/dataset.rs:303
3962024-11-25T19:27:58.664ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_ca727341-d003-494b-b98d-9fa5b5aeeec8 file = sled-storage/src/dataset.rs:389
3972024-11-25T19:27:58.672ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3982024-11-25T19:27:58.672ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3992024-11-25T19:27:58.672ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
4002024-11-25T19:27:58.672ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4012024-11-25T19:27:58.672ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
4022024-11-25T19:27:58.682ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:367
4032024-11-25T19:27:58.682ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 1b4c5120-bb11-444d-9c86-edb04be1264c (zpool)
4042024-11-25T19:27:58.779ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 1b4c5120-bb11-444d-9c86-edb04be1264c (zpool), kind: External }
4052024-11-25T19:27:58.787ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:240
4062024-11-25T19:27:58.787ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:242
4072024-11-25T19:27:58.787ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:246
4082024-11-25T19:27:58.787ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:248
4092024-11-25T19:27:58.787ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
4102024-11-25T19:27:58.787ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
4112024-11-25T19:27:58.787ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
4122024-11-25T19:27:58.824ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4132024-11-25T19:27:58.832ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_1b4c5120-bb11-444d-9c86-edb04be1264c/crypt/zone file = sled-storage/src/dataset.rs:303
4142024-11-25T19:27:59.010ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_1b4c5120-bb11-444d-9c86-edb04be1264c file = sled-storage/src/dataset.rs:389
4152024-11-25T19:27:59.019ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
4162024-11-25T19:27:59.019ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
4172024-11-25T19:27:59.019ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
4182024-11-25T19:27:59.019ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4192024-11-25T19:27:59.019ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
4202024-11-25T19:27:59.029ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:367
4212024-11-25T19:27:59.029ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = df57d550-ef00-4438-9a9e-b1b08bdaa525 (zpool)
4222024-11-25T19:27:59.125ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: df57d550-ef00-4438-9a9e-b1b08bdaa525 (zpool), kind: External }
4232024-11-25T19:27:59.132ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:240
4242024-11-25T19:27:59.132ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:242
4252024-11-25T19:27:59.132ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:246
4262024-11-25T19:27:59.132ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:248
4272024-11-25T19:27:59.132ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4282024-11-25T19:27:59.132ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4292024-11-25T19:27:59.132ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
4302024-11-25T19:27:59.168ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4312024-11-25T19:27:59.176ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_df57d550-ef00-4438-9a9e-b1b08bdaa525/crypt/zone file = sled-storage/src/dataset.rs:303
4322024-11-25T19:27:59.291ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/38711855-ef69-4d79-bb75-aebd85b1280b) file = sled-agent/src/probe_manager.rs:231 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
4332024-11-25T19:27:59.348ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_df57d550-ef00-4438-9a9e-b1b08bdaa525 file = sled-storage/src/dataset.rs:389
4342024-11-25T19:27:59.356ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
4352024-11-25T19:27:59.356ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4362024-11-25T19:27:59.356ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4372024-11-25T19:27:59.356ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4382024-11-25T19:27:59.356ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4392024-11-25T19:27:59.366ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:367
4402024-11-25T19:27:59.366ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 2517e8b2-3022-4575-a6ad-4786cce7adb4 (zpool)
4412024-11-25T19:27:59.463ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 2517e8b2-3022-4575-a6ad-4786cce7adb4 (zpool), kind: External }
4422024-11-25T19:27:59.471ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:240
4432024-11-25T19:27:59.471ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:242
4442024-11-25T19:27:59.471ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:246
4452024-11-25T19:27:59.471ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:248
4462024-11-25T19:27:59.471ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4472024-11-25T19:27:59.471ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4482024-11-25T19:27:59.471ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
4492024-11-25T19:27:59.507ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4502024-11-25T19:27:59.515ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_2517e8b2-3022-4575-a6ad-4786cce7adb4/crypt/zone file = sled-storage/src/dataset.rs:303
4512024-11-25T19:27:59.690ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_2517e8b2-3022-4575-a6ad-4786cce7adb4 file = sled-storage/src/dataset.rs:389
4522024-11-25T19:27:59.698ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4532024-11-25T19:27:59.698ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4542024-11-25T19:27:59.698ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/dd272387-9bb6-475e-8ebb-47dcac6d1d2a/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:200 request = omicron_physical_disks_ensure
4552024-11-25T19:27:59.698ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: dd272387-9bb6-475e-8ebb-47dcac6d1d2a (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a4bf8354-b44e-436c-b4f2-9bd494b77342 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 71fa9360-75cf-491a-b7ef-fd270ae2f32c (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: cc26c009-a951-4771-a26a-f2513b9e63e2 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 56aea45f-c451-4174-9b8f-66145c2696e8 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d7af1128-7206-4198-91cb-ef632ea8556e (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: fe712103-328f-4ff5-a621-99ae42de7f00 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: ca727341-d003-494b-b98d-9fa5b5aeeec8 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 1b4c5120-bb11-444d-9c86-edb04be1264c (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: df57d550-ef00-4438-9a9e-b1b08bdaa525 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 2517e8b2-3022-4575-a6ad-4786cce7adb4 (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4562024-11-25T19:27:59.698ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
4572024-11-25T19:27:59.698ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
4582024-11-25T19:27:59.698ZINFOSledAgent (StorageManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/dd272387-9bb6-475e-8ebb-47dcac6d1d2a/config/omicron-physical-disks.json" request = omicron_physical_disks_ensure
4592024-11-25T19:27:59.698ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/a4bf8354-b44e-436c-b4f2-9bd494b77342/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:200 request = omicron_physical_disks_ensure
4602024-11-25T19:27:59.698ZINFOSledAgent (StorageManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/a4bf8354-b44e-436c-b4f2-9bd494b77342/config/omicron-physical-disks.json" request = omicron_physical_disks_ensure
4612024-11-25T19:27:59.698ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:887 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
4622024-11-25T19:27:59.698ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
4632024-11-25T19:27:59.698ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:913 generation = Generation(1) sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
4642024-11-25T19:27:59.698ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:918 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
4652024-11-25T19:27:59.698ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:923 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
4662024-11-25T19:27:59.699ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:122 gen = Generation(1) sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
4672024-11-25T19:27:59.699ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:929 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
4682024-11-25T19:27:59.699ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(1)
4692024-11-25T19:27:59.699ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:934 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
4702024-11-25T19:27:59.699ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4035395 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:33710 req_id = 03ad7591-ef3e-42ee-9414-5953d855c4a2 response_code = 200 uri = /omicron-physical-disks
4712024-11-25T19:27:59.730ZINFOSledAgent (RSS): attempting to set up sled's datasets: DatasetsConfig { generation: Generation(1), datasets: {0b69577c-adb9-487f-a8cc-438528a04fba (dataset): DatasetConfig { id: 0b69577c-adb9-487f-a8cc-438528a04fba (dataset), name: DatasetName { pool_name: ZpoolName { id: 71fa9360-75cf-491a-b7ef-fd270ae2f32c (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0e4ced73-4ce4-459e-b5e5-946b7307bd09 (dataset): DatasetConfig { id: 0e4ced73-4ce4-459e-b5e5-946b7307bd09 (dataset), name: DatasetName { pool_name: ZpoolName { id: fe712103-328f-4ff5-a621-99ae42de7f00 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1454dc3e-2755-41e3-b840-5eced5f9e50a (dataset): DatasetConfig { id: 1454dc3e-2755-41e3-b840-5eced5f9e50a (dataset), name: DatasetName { pool_name: ZpoolName { id: 71fa9360-75cf-491a-b7ef-fd270ae2f32c (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 175d78dc-3afe-4c9b-82f1-327723c9f690 (dataset): DatasetConfig { id: 175d78dc-3afe-4c9b-82f1-327723c9f690 (dataset), name: DatasetName { pool_name: ZpoolName { id: 71fa9360-75cf-491a-b7ef-fd270ae2f32c (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_6b3cbeea-c72e-481d-a7a1-e27c601ccb03" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2086c6ba-d732-41e0-968b-6cd565ca02b3 (dataset): DatasetConfig { id: 2086c6ba-d732-41e0-968b-6cd565ca02b3 (dataset), name: DatasetName { pool_name: ZpoolName { id: ca727341-d003-494b-b98d-9fa5b5aeeec8 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 24fa5470-281b-494f-a155-a9fcea472ef6 (dataset): DatasetConfig { id: 24fa5470-281b-494f-a155-a9fcea472ef6 (dataset), name: DatasetName { pool_name: ZpoolName { id: cc26c009-a951-4771-a26a-f2513b9e63e2 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 2d7b4ec3-65fd-4c8a-8597-2b953021ccc4 (dataset): DatasetConfig { id: 2d7b4ec3-65fd-4c8a-8597-2b953021ccc4 (dataset), name: DatasetName { pool_name: ZpoolName { id: d7af1128-7206-4198-91cb-ef632ea8556e (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_863e78e3-a753-4fb2-97de-c46023f03292" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 36381191-53e4-46e7-b178-e35db4e65b83 (dataset): DatasetConfig { id: 36381191-53e4-46e7-b178-e35db4e65b83 (dataset), name: DatasetName { pool_name: ZpoolName { id: ca727341-d003-494b-b98d-9fa5b5aeeec8 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_50534bbc-e79b-4382-9f0d-65daaa00ec78" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3adbd8c1-9e77-4bbb-af72-4caf06f3e837 (dataset): DatasetConfig { id: 3adbd8c1-9e77-4bbb-af72-4caf06f3e837 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2517e8b2-3022-4575-a6ad-4786cce7adb4 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3cef1573-f1da-4214-bf2c-8c2b68e8b4b4 (dataset): DatasetConfig { id: 3cef1573-f1da-4214-bf2c-8c2b68e8b4b4 (dataset), name: DatasetName { pool_name: ZpoolName { id: ca727341-d003-494b-b98d-9fa5b5aeeec8 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_42cf72f4-fa5d-45b0-b91f-af1c2e33690d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 48809926-1a77-44dc-a1b2-2a83069a6a77 (dataset): DatasetConfig { id: 48809926-1a77-44dc-a1b2-2a83069a6a77 (dataset), name: DatasetName { pool_name: ZpoolName { id: 56aea45f-c451-4174-9b8f-66145c2696e8 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_7e8f0bb3-d78c-423c-95e4-008fd1e3aabc" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4e51eec3-2acf-4d73-b16e-134b04a33177 (dataset): DatasetConfig { id: 4e51eec3-2acf-4d73-b16e-134b04a33177 (dataset), name: DatasetName { pool_name: ZpoolName { id: cc26c009-a951-4771-a26a-f2513b9e63e2 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_5e357e48-2959-4886-8b9d-557b95c45fb7" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 50a26fb5-288a-48f1-b82b-229ba808f542 (dataset): DatasetConfig { id: 50a26fb5-288a-48f1-b82b-229ba808f542 (dataset), name: DatasetName { pool_name: ZpoolName { id: df57d550-ef00-4438-9a9e-b1b08bdaa525 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5134215a-7bea-42ff-9558-6b38f624ede3 (dataset): DatasetConfig { id: 5134215a-7bea-42ff-9558-6b38f624ede3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 56aea45f-c451-4174-9b8f-66145c2696e8 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 52d2ee87-5d4a-4712-a4ec-54af35b1be7e (dataset): DatasetConfig { id: 52d2ee87-5d4a-4712-a4ec-54af35b1be7e (dataset), name: DatasetName { pool_name: ZpoolName { id: cc26c009-a951-4771-a26a-f2513b9e63e2 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5f41f7e4-da6c-47ea-ac63-ab821f262efc (dataset): DatasetConfig { id: 5f41f7e4-da6c-47ea-ac63-ab821f262efc (dataset), name: DatasetName { pool_name: ZpoolName { id: d7af1128-7206-4198-91cb-ef632ea8556e (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 63835b79-d599-4ebd-a7fb-d4acedb097bf (dataset): DatasetConfig { id: 63835b79-d599-4ebd-a7fb-d4acedb097bf (dataset), name: DatasetName { pool_name: ZpoolName { id: ca727341-d003-494b-b98d-9fa5b5aeeec8 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 660a8ee5-1f2d-42c0-982a-9a5dfa28d548 (dataset): DatasetConfig { id: 660a8ee5-1f2d-42c0-982a-9a5dfa28d548 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2517e8b2-3022-4575-a6ad-4786cce7adb4 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 66a1449c-d4fb-4bfd-bb74-41175a2a6ba6 (dataset): DatasetConfig { id: 66a1449c-d4fb-4bfd-bb74-41175a2a6ba6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1b4c5120-bb11-444d-9c86-edb04be1264c (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6acc4e48-445e-4974-ac7b-c0c8a6894452 (dataset): DatasetConfig { id: 6acc4e48-445e-4974-ac7b-c0c8a6894452 (dataset), name: DatasetName { pool_name: ZpoolName { id: 71fa9360-75cf-491a-b7ef-fd270ae2f32c (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 6b8550b8-a7a5-436a-ba11-496e71537cf4 (dataset): DatasetConfig { id: 6b8550b8-a7a5-436a-ba11-496e71537cf4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2517e8b2-3022-4575-a6ad-4786cce7adb4 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 6ebc657d-199a-481f-84d4-48fda8fdc020 (dataset): DatasetConfig { id: 6ebc657d-199a-481f-84d4-48fda8fdc020 (dataset), name: DatasetName { pool_name: ZpoolName { id: 71fa9360-75cf-491a-b7ef-fd270ae2f32c (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7717bbcf-0fa8-4a65-b5ed-f10fb32341dd (dataset): DatasetConfig { id: 7717bbcf-0fa8-4a65-b5ed-f10fb32341dd (dataset), name: DatasetName { pool_name: ZpoolName { id: df57d550-ef00-4438-9a9e-b1b08bdaa525 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7b068585-d876-4d51-993f-1f4b22c2b9bc (dataset): DatasetConfig { id: 7b068585-d876-4d51-993f-1f4b22c2b9bc (dataset), name: DatasetName { pool_name: ZpoolName { id: fe712103-328f-4ff5-a621-99ae42de7f00 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 8010c051-3325-4a7f-97f8-b99191255893 (dataset): DatasetConfig { id: 8010c051-3325-4a7f-97f8-b99191255893 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2517e8b2-3022-4575-a6ad-4786cce7adb4 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 86b44f44-f1a1-489f-bcf2-1562b16a1ee2 (dataset): DatasetConfig { id: 86b44f44-f1a1-489f-bcf2-1562b16a1ee2 (dataset), name: DatasetName { pool_name: ZpoolName { id: ca727341-d003-494b-b98d-9fa5b5aeeec8 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 8a579497-b6b4-4c09-8023-af5fa41319ef (dataset): DatasetConfig { id: 8a579497-b6b4-4c09-8023-af5fa41319ef (dataset), name: DatasetName { pool_name: ZpoolName { id: fe712103-328f-4ff5-a621-99ae42de7f00 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8fd6510c-1bc0-4b60-8b38-9a1c81a492cf (dataset): DatasetConfig { id: 8fd6510c-1bc0-4b60-8b38-9a1c81a492cf (dataset), name: DatasetName { pool_name: ZpoolName { id: 1b4c5120-bb11-444d-9c86-edb04be1264c (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 95c5888c-8d4a-4a6b-ad13-d8d0dc1172f2 (dataset): DatasetConfig { id: 95c5888c-8d4a-4a6b-ad13-d8d0dc1172f2 (dataset), name: DatasetName { pool_name: ZpoolName { id: df57d550-ef00-4438-9a9e-b1b08bdaa525 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_fa3bd66a-1a51-4937-9188-36e5fc334f7c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9dfc6b99-aadc-4edf-be7b-382bc3477c84 (dataset): DatasetConfig { id: 9dfc6b99-aadc-4edf-be7b-382bc3477c84 (dataset), name: DatasetName { pool_name: ZpoolName { id: fe712103-328f-4ff5-a621-99ae42de7f00 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a12d9318-8dbd-4415-85cf-25229d5a6043 (dataset): DatasetConfig { id: a12d9318-8dbd-4415-85cf-25229d5a6043 (dataset), name: DatasetName { pool_name: ZpoolName { id: 56aea45f-c451-4174-9b8f-66145c2696e8 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a51b5e97-3f56-4c3e-852a-eeaa1213fcb2 (dataset): DatasetConfig { id: a51b5e97-3f56-4c3e-852a-eeaa1213fcb2 (dataset), name: DatasetName { pool_name: ZpoolName { id: d7af1128-7206-4198-91cb-ef632ea8556e (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_9bea4b41-0e61-416b-9a60-0c3dff58b905" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a76e1c2b-609c-4637-aa07-e478781d578c (dataset): DatasetConfig { id: a76e1c2b-609c-4637-aa07-e478781d578c (dataset), name: DatasetName { pool_name: ZpoolName { id: 1b4c5120-bb11-444d-9c86-edb04be1264c (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_3a33ba47-8706-4469-959c-acd4a6a8404e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a87af2c1-1011-4896-96e9-761d557a697b (dataset): DatasetConfig { id: a87af2c1-1011-4896-96e9-761d557a697b (dataset), name: DatasetName { pool_name: ZpoolName { id: 56aea45f-c451-4174-9b8f-66145c2696e8 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_d6f634f5-3528-4e41-966f-f47648523f6a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, aec66277-5149-4d9c-85df-d6a30f6761a8 (dataset): DatasetConfig { id: aec66277-5149-4d9c-85df-d6a30f6761a8 (dataset), name: DatasetName { pool_name: ZpoolName { id: d7af1128-7206-4198-91cb-ef632ea8556e (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b05ba1ea-7af0-4f4f-935c-1f81fc8e3781 (dataset): DatasetConfig { id: b05ba1ea-7af0-4f4f-935c-1f81fc8e3781 (dataset), name: DatasetName { pool_name: ZpoolName { id: 71fa9360-75cf-491a-b7ef-fd270ae2f32c (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_64a08338-1eb5-49da-827e-ddea69a7943c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b175288d-1041-4b3b-b1d4-f97b4453fc91 (dataset): DatasetConfig { id: b175288d-1041-4b3b-b1d4-f97b4453fc91 (dataset), name: DatasetName { pool_name: ZpoolName { id: 71fa9360-75cf-491a-b7ef-fd270ae2f32c (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b1782d53-f1c0-4be3-b2d8-9f22501d4ea0 (dataset): DatasetConfig { id: b1782d53-f1c0-4be3-b2d8-9f22501d4ea0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1b4c5120-bb11-444d-9c86-edb04be1264c (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bb910381-afff-41b0-8882-6f42759779d3 (dataset): DatasetConfig { id: bb910381-afff-41b0-8882-6f42759779d3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 71fa9360-75cf-491a-b7ef-fd270ae2f32c (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_4f833d1f-8a98-4545-91ff-69d713fdd1f0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bf207099-92f0-40ac-9f00-a6771d3699a5 (dataset): DatasetConfig { id: bf207099-92f0-40ac-9f00-a6771d3699a5 (dataset), name: DatasetName { pool_name: ZpoolName { id: cc26c009-a951-4771-a26a-f2513b9e63e2 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_7db61d8a-2b76-4a38-9be0-42b379308323" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c01f002e-cf56-40a8-856e-717717a9d209 (dataset): DatasetConfig { id: c01f002e-cf56-40a8-856e-717717a9d209 (dataset), name: DatasetName { pool_name: ZpoolName { id: d7af1128-7206-4198-91cb-ef632ea8556e (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c053334f-bbf4-4fee-9888-b056a9cc51db (dataset): DatasetConfig { id: c053334f-bbf4-4fee-9888-b056a9cc51db (dataset), name: DatasetName { pool_name: ZpoolName { id: ca727341-d003-494b-b98d-9fa5b5aeeec8 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_1d808376-6b5a-46f0-b373-d7ba578556eb" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c4e421b8-1195-43e3-b9ac-bfc9ad77e7e7 (dataset): DatasetConfig { id: c4e421b8-1195-43e3-b9ac-bfc9ad77e7e7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 56aea45f-c451-4174-9b8f-66145c2696e8 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cb50db26-684b-438a-8c48-94aaff4042b9 (dataset): DatasetConfig { id: cb50db26-684b-438a-8c48-94aaff4042b9 (dataset), name: DatasetName { pool_name: ZpoolName { id: d7af1128-7206-4198-91cb-ef632ea8556e (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_0b6bc18d-d78b-4cf7-a684-c6255a25f2ed" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cbedc4cc-97ac-4e36-8a65-377112c625cf (dataset): DatasetConfig { id: cbedc4cc-97ac-4e36-8a65-377112c625cf (dataset), name: DatasetName { pool_name: ZpoolName { id: d7af1128-7206-4198-91cb-ef632ea8556e (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ce3ee622-fe93-452c-99db-39dcaf440329 (dataset): DatasetConfig { id: ce3ee622-fe93-452c-99db-39dcaf440329 (dataset), name: DatasetName { pool_name: ZpoolName { id: cc26c009-a951-4771-a26a-f2513b9e63e2 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_234660ab-07d6-46bf-8748-19a6e4eb0d61" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d0452f08-9fee-4410-9972-0c1a7ded5e09 (dataset): DatasetConfig { id: d0452f08-9fee-4410-9972-0c1a7ded5e09 (dataset), name: DatasetName { pool_name: ZpoolName { id: df57d550-ef00-4438-9a9e-b1b08bdaa525 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, d06a9a59-e653-48fa-8dcc-7cc0acef6ddc (dataset): DatasetConfig { id: d06a9a59-e653-48fa-8dcc-7cc0acef6ddc (dataset), name: DatasetName { pool_name: ZpoolName { id: fe712103-328f-4ff5-a621-99ae42de7f00 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_5ead9ee2-e8b0-4593-9027-48635affc5e2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d1103926-c3ce-497b-b7c7-67e9b91eb37c (dataset): DatasetConfig { id: d1103926-c3ce-497b-b7c7-67e9b91eb37c (dataset), name: DatasetName { pool_name: ZpoolName { id: 71fa9360-75cf-491a-b7ef-fd270ae2f32c (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_e75f2650-a245-42d3-9d24-2a4c8145f522" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d3e64b53-1d52-4e43-a327-aa25216b28de (dataset): DatasetConfig { id: d3e64b53-1d52-4e43-a327-aa25216b28de (dataset), name: DatasetName { pool_name: ZpoolName { id: 2517e8b2-3022-4575-a6ad-4786cce7adb4 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_0a80d709-bf2b-457a-9df6-b7c61cf35e54" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d4e26abc-aaaa-4c27-adf7-4d37b7ef906b (dataset): DatasetConfig { id: d4e26abc-aaaa-4c27-adf7-4d37b7ef906b (dataset), name: DatasetName { pool_name: ZpoolName { id: 71fa9360-75cf-491a-b7ef-fd270ae2f32c (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d7cdf6b3-3468-47c9-b703-0ff4bc28dac3 (dataset): DatasetConfig { id: d7cdf6b3-3468-47c9-b703-0ff4bc28dac3 (dataset), name: DatasetName { pool_name: ZpoolName { id: cc26c009-a951-4771-a26a-f2513b9e63e2 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, da842f30-e5ea-4a7c-b8fa-3d06f4a46ff3 (dataset): DatasetConfig { id: da842f30-e5ea-4a7c-b8fa-3d06f4a46ff3 (dataset), name: DatasetName { pool_name: ZpoolName { id: cc26c009-a951-4771-a26a-f2513b9e63e2 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_2f59c006-0a7d-42ea-a0d5-5b48cf7cd990" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, db6bbfb9-4289-4ad6-89ac-64034a50a0d4 (dataset): DatasetConfig { id: db6bbfb9-4289-4ad6-89ac-64034a50a0d4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 71fa9360-75cf-491a-b7ef-fd270ae2f32c (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e23716cc-1bb2-47d5-831a-401babcb900e (dataset): DatasetConfig { id: e23716cc-1bb2-47d5-831a-401babcb900e (dataset), name: DatasetName { pool_name: ZpoolName { id: 71fa9360-75cf-491a-b7ef-fd270ae2f32c (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_21786b6f-d071-4762-9de6-138ef833b3de" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e501ce1f-8495-44d6-9d50-8ffee6113168 (dataset): DatasetConfig { id: e501ce1f-8495-44d6-9d50-8ffee6113168 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1b4c5120-bb11-444d-9c86-edb04be1264c (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e6a84613-486b-440f-b73e-1efb98b8d0ef (dataset): DatasetConfig { id: e6a84613-486b-440f-b73e-1efb98b8d0ef (dataset), name: DatasetName { pool_name: ZpoolName { id: 56aea45f-c451-4174-9b8f-66145c2696e8 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_dd4b9bd7-7dc8-4c50-b7a6-ad30d3af9195" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e845c8a8-042c-4c36-b96a-86f6e68004ba (dataset): DatasetConfig { id: e845c8a8-042c-4c36-b96a-86f6e68004ba (dataset), name: DatasetName { pool_name: ZpoolName { id: cc26c009-a951-4771-a26a-f2513b9e63e2 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ef770427-0a5f-40b3-a157-2160a7628b15 (dataset): DatasetConfig { id: ef770427-0a5f-40b3-a157-2160a7628b15 (dataset), name: DatasetName { pool_name: ZpoolName { id: cc26c009-a951-4771-a26a-f2513b9e63e2 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_c588016e-a348-47f5-b498-43234ef44320" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f100cf37-ff11-499c-9032-ebaff0b595ca (dataset): DatasetConfig { id: f100cf37-ff11-499c-9032-ebaff0b595ca (dataset), name: DatasetName { pool_name: ZpoolName { id: 71fa9360-75cf-491a-b7ef-fd270ae2f32c (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_7c96e2c2-1643-4666-b1e3-92a7f608b3f8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f4a584df-900f-4dd9-b647-27dc36a44775 (dataset): DatasetConfig { id: f4a584df-900f-4dd9-b647-27dc36a44775 (dataset), name: DatasetName { pool_name: ZpoolName { id: 56aea45f-c451-4174-9b8f-66145c2696e8 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f569b3ad-5ca5-44f8-b297-c510d6f2270c (dataset): DatasetConfig { id: f569b3ad-5ca5-44f8-b297-c510d6f2270c (dataset), name: DatasetName { pool_name: ZpoolName { id: cc26c009-a951-4771-a26a-f2513b9e63e2 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f87725cb-a018-4c62-83d5-a022aac44dac (dataset): DatasetConfig { id: f87725cb-a018-4c62-83d5-a022aac44dac (dataset), name: DatasetName { pool_name: ZpoolName { id: cc26c009-a951-4771-a26a-f2513b9e63e2 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, faba2fb9-5b70-402c-a83d-13b625337d7d (dataset): DatasetConfig { id: faba2fb9-5b70-402c-a83d-13b625337d7d (dataset), name: DatasetName { pool_name: ZpoolName { id: fe712103-328f-4ff5-a621-99ae42de7f00 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_1287099d-2056-4e10-99e5-632481da2c2b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fe8ed89a-0644-451c-ab45-f80df0ebac21 (dataset): DatasetConfig { id: fe8ed89a-0644-451c-ab45-f80df0ebac21 (dataset), name: DatasetName { pool_name: ZpoolName { id: 56aea45f-c451-4174-9b8f-66145c2696e8 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fe927566-0c31-44e2-b69d-a0eee3ee5635 (dataset): DatasetConfig { id: fe927566-0c31-44e2-b69d-a0eee3ee5635 (dataset), name: DatasetName { pool_name: ZpoolName { id: 71fa9360-75cf-491a-b7ef-fd270ae2f32c (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} } file = sled-agent/src/rack_setup/service.rs:457 sled_address = [fd00:1122:3344:101::1]:12345
4722024-11-25T19:27:59.730ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37409
4732024-11-25T19:27:59.731ZINFOSledAgent: datasets ensure file = sled-agent/src/sled_agent.rs:849 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
4742024-11-25T19:27:59.733ZINFOSledAgent (StorageManager): Received DatasetsEnsure { config: DatasetsConfig { generation: Generation(1), datasets: {0b69577c-adb9-487f-a8cc-438528a04fba (dataset): DatasetConfig { id: 0b69577c-adb9-487f-a8cc-438528a04fba (dataset), name: DatasetName { pool_name: ZpoolName { id: 71fa9360-75cf-491a-b7ef-fd270ae2f32c (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0e4ced73-4ce4-459e-b5e5-946b7307bd09 (dataset): DatasetConfig { id: 0e4ced73-4ce4-459e-b5e5-946b7307bd09 (dataset), name: DatasetName { pool_name: ZpoolName { id: fe712103-328f-4ff5-a621-99ae42de7f00 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1454dc3e-2755-41e3-b840-5eced5f9e50a (dataset): DatasetConfig { id: 1454dc3e-2755-41e3-b840-5eced5f9e50a (dataset), name: DatasetName { pool_name: ZpoolName { id: 71fa9360-75cf-491a-b7ef-fd270ae2f32c (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 175d78dc-3afe-4c9b-82f1-327723c9f690 (dataset): DatasetConfig { id: 175d78dc-3afe-4c9b-82f1-327723c9f690 (dataset), name: DatasetName { pool_name: ZpoolName { id: 71fa9360-75cf-491a-b7ef-fd270ae2f32c (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_6b3cbeea-c72e-481d-a7a1-e27c601ccb03" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2086c6ba-d732-41e0-968b-6cd565ca02b3 (dataset): DatasetConfig { id: 2086c6ba-d732-41e0-968b-6cd565ca02b3 (dataset), name: DatasetName { pool_name: ZpoolName { id: ca727341-d003-494b-b98d-9fa5b5aeeec8 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 24fa5470-281b-494f-a155-a9fcea472ef6 (dataset): DatasetConfig { id: 24fa5470-281b-494f-a155-a9fcea472ef6 (dataset), name: DatasetName { pool_name: ZpoolName { id: cc26c009-a951-4771-a26a-f2513b9e63e2 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 2d7b4ec3-65fd-4c8a-8597-2b953021ccc4 (dataset): DatasetConfig { id: 2d7b4ec3-65fd-4c8a-8597-2b953021ccc4 (dataset), name: DatasetName { pool_name: ZpoolName { id: d7af1128-7206-4198-91cb-ef632ea8556e (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_863e78e3-a753-4fb2-97de-c46023f03292" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 36381191-53e4-46e7-b178-e35db4e65b83 (dataset): DatasetConfig { id: 36381191-53e4-46e7-b178-e35db4e65b83 (dataset), name: DatasetName { pool_name: ZpoolName { id: ca727341-d003-494b-b98d-9fa5b5aeeec8 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_50534bbc-e79b-4382-9f0d-65daaa00ec78" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3adbd8c1-9e77-4bbb-af72-4caf06f3e837 (dataset): DatasetConfig { id: 3adbd8c1-9e77-4bbb-af72-4caf06f3e837 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2517e8b2-3022-4575-a6ad-4786cce7adb4 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3cef1573-f1da-4214-bf2c-8c2b68e8b4b4 (dataset): DatasetConfig { id: 3cef1573-f1da-4214-bf2c-8c2b68e8b4b4 (dataset), name: DatasetName { pool_name: ZpoolName { id: ca727341-d003-494b-b98d-9fa5b5aeeec8 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_42cf72f4-fa5d-45b0-b91f-af1c2e33690d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 48809926-1a77-44dc-a1b2-2a83069a6a77 (dataset): DatasetConfig { id: 48809926-1a77-44dc-a1b2-2a83069a6a77 (dataset), name: DatasetName { pool_name: ZpoolName { id: 56aea45f-c451-4174-9b8f-66145c2696e8 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_7e8f0bb3-d78c-423c-95e4-008fd1e3aabc" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4e51eec3-2acf-4d73-b16e-134b04a33177 (dataset): DatasetConfig { id: 4e51eec3-2acf-4d73-b16e-134b04a33177 (dataset), name: DatasetName { pool_name: ZpoolName { id: cc26c009-a951-4771-a26a-f2513b9e63e2 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_5e357e48-2959-4886-8b9d-557b95c45fb7" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 50a26fb5-288a-48f1-b82b-229ba808f542 (dataset): DatasetConfig { id: 50a26fb5-288a-48f1-b82b-229ba808f542 (dataset), name: DatasetName { pool_name: ZpoolName { id: df57d550-ef00-4438-9a9e-b1b08bdaa525 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5134215a-7bea-42ff-9558-6b38f624ede3 (dataset): DatasetConfig { id: 5134215a-7bea-42ff-9558-6b38f624ede3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 56aea45f-c451-4174-9b8f-66145c2696e8 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 52d2ee87-5d4a-4712-a4ec-54af35b1be7e (dataset): DatasetConfig { id: 52d2ee87-5d4a-4712-a4ec-54af35b1be7e (dataset), name: DatasetName { pool_name: ZpoolName { id: cc26c009-a951-4771-a26a-f2513b9e63e2 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5f41f7e4-da6c-47ea-ac63-ab821f262efc (dataset): DatasetConfig { id: 5f41f7e4-da6c-47ea-ac63-ab821f262efc (dataset), name: DatasetName { pool_name: ZpoolName { id: d7af1128-7206-4198-91cb-ef632ea8556e (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 63835b79-d599-4ebd-a7fb-d4acedb097bf (dataset): DatasetConfig { id: 63835b79-d599-4ebd-a7fb-d4acedb097bf (dataset), name: DatasetName { pool_name: ZpoolName { id: ca727341-d003-494b-b98d-9fa5b5aeeec8 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 660a8ee5-1f2d-42c0-982a-9a5dfa28d548 (dataset): DatasetConfig { id: 660a8ee5-1f2d-42c0-982a-9a5dfa28d548 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2517e8b2-3022-4575-a6ad-4786cce7adb4 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 66a1449c-d4fb-4bfd-bb74-41175a2a6ba6 (dataset): DatasetConfig { id: 66a1449c-d4fb-4bfd-bb74-41175a2a6ba6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1b4c5120-bb11-444d-9c86-edb04be1264c (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6acc4e48-445e-4974-ac7b-c0c8a6894452 (dataset): DatasetConfig { id: 6acc4e48-445e-4974-ac7b-c0c8a6894452 (dataset), name: DatasetName { pool_name: ZpoolName { id: 71fa9360-75cf-491a-b7ef-fd270ae2f32c (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 6b8550b8-a7a5-436a-ba11-496e71537cf4 (dataset): DatasetConfig { id: 6b8550b8-a7a5-436a-ba11-496e71537cf4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2517e8b2-3022-4575-a6ad-4786cce7adb4 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 6ebc657d-199a-481f-84d4-48fda8fdc020 (dataset): DatasetConfig { id: 6ebc657d-199a-481f-84d4-48fda8fdc020 (dataset), name: DatasetName { pool_name: ZpoolName { id: 71fa9360-75cf-491a-b7ef-fd270ae2f32c (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7717bbcf-0fa8-4a65-b5ed-f10fb32341dd (dataset): DatasetConfig { id: 7717bbcf-0fa8-4a65-b5ed-f10fb32341dd (dataset), name: DatasetName { pool_name: ZpoolName { id: df57d550-ef00-4438-9a9e-b1b08bdaa525 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7b068585-d876-4d51-993f-1f4b22c2b9bc (dataset): DatasetConfig { id: 7b068585-d876-4d51-993f-1f4b22c2b9bc (dataset), name: DatasetName { pool_name: ZpoolName { id: fe712103-328f-4ff5-a621-99ae42de7f00 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 8010c051-3325-4a7f-97f8-b99191255893 (dataset): DatasetConfig { id: 8010c051-3325-4a7f-97f8-b99191255893 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2517e8b2-3022-4575-a6ad-4786cce7adb4 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 86b44f44-f1a1-489f-bcf2-1562b16a1ee2 (dataset): DatasetConfig { id: 86b44f44-f1a1-489f-bcf2-1562b16a1ee2 (dataset), name: DatasetName { pool_name: ZpoolName { id: ca727341-d003-494b-b98d-9fa5b5aeeec8 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 8a579497-b6b4-4c09-8023-af5fa41319ef (dataset): DatasetConfig { id: 8a579497-b6b4-4c09-8023-af5fa41319ef (dataset), name: DatasetName { pool_name: ZpoolName { id: fe712103-328f-4ff5-a621-99ae42de7f00 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8fd6510c-1bc0-4b60-8b38-9a1c81a492cf (dataset): DatasetConfig { id: 8fd6510c-1bc0-4b60-8b38-9a1c81a492cf (dataset), name: DatasetName { pool_name: ZpoolName { id: 1b4c5120-bb11-444d-9c86-edb04be1264c (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 95c5888c-8d4a-4a6b-ad13-d8d0dc1172f2 (dataset): DatasetConfig { id: 95c5888c-8d4a-4a6b-ad13-d8d0dc1172f2 (dataset), name: DatasetName { pool_name: ZpoolName { id: df57d550-ef00-4438-9a9e-b1b08bdaa525 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_fa3bd66a-1a51-4937-9188-36e5fc334f7c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9dfc6b99-aadc-4edf-be7b-382bc3477c84 (dataset): DatasetConfig { id: 9dfc6b99-aadc-4edf-be7b-382bc3477c84 (dataset), name: DatasetName { pool_name: ZpoolName { id: fe712103-328f-4ff5-a621-99ae42de7f00 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a12d9318-8dbd-4415-85cf-25229d5a6043 (dataset): DatasetConfig { id: a12d9318-8dbd-4415-85cf-25229d5a6043 (dataset), name: DatasetName { pool_name: ZpoolName { id: 56aea45f-c451-4174-9b8f-66145c2696e8 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a51b5e97-3f56-4c3e-852a-eeaa1213fcb2 (dataset): DatasetConfig { id: a51b5e97-3f56-4c3e-852a-eeaa1213fcb2 (dataset), name: DatasetName { pool_name: ZpoolName { id: d7af1128-7206-4198-91cb-ef632ea8556e (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_9bea4b41-0e61-416b-9a60-0c3dff58b905" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a76e1c2b-609c-4637-aa07-e478781d578c (dataset): DatasetConfig { id: a76e1c2b-609c-4637-aa07-e478781d578c (dataset), name: DatasetName { pool_name: ZpoolName { id: 1b4c5120-bb11-444d-9c86-edb04be1264c (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_3a33ba47-8706-4469-959c-acd4a6a8404e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a87af2c1-1011-4896-96e9-761d557a697b (dataset): DatasetConfig { id: a87af2c1-1011-4896-96e9-761d557a697b (dataset), name: DatasetName { pool_name: ZpoolName { id: 56aea45f-c451-4174-9b8f-66145c2696e8 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_d6f634f5-3528-4e41-966f-f47648523f6a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, aec66277-5149-4d9c-85df-d6a30f6761a8 (dataset): DatasetConfig { id: aec66277-5149-4d9c-85df-d6a30f6761a8 (dataset), name: DatasetName { pool_name: ZpoolName { id: d7af1128-7206-4198-91cb-ef632ea8556e (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b05ba1ea-7af0-4f4f-935c-1f81fc8e3781 (dataset): DatasetConfig { id: b05ba1ea-7af0-4f4f-935c-1f81fc8e3781 (dataset), name: DatasetName { pool_name: ZpoolName { id: 71fa9360-75cf-491a-b7ef-fd270ae2f32c (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_64a08338-1eb5-49da-827e-ddea69a7943c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b175288d-1041-4b3b-b1d4-f97b4453fc91 (dataset): DatasetConfig { id: b175288d-1041-4b3b-b1d4-f97b4453fc91 (dataset), name: DatasetName { pool_name: ZpoolName { id: 71fa9360-75cf-491a-b7ef-fd270ae2f32c (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b1782d53-f1c0-4be3-b2d8-9f22501d4ea0 (dataset): DatasetConfig { id: b1782d53-f1c0-4be3-b2d8-9f22501d4ea0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1b4c5120-bb11-444d-9c86-edb04be1264c (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bb910381-afff-41b0-8882-6f42759779d3 (dataset): DatasetConfig { id: bb910381-afff-41b0-8882-6f42759779d3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 71fa9360-75cf-491a-b7ef-fd270ae2f32c (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_4f833d1f-8a98-4545-91ff-69d713fdd1f0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bf207099-92f0-40ac-9f00-a6771d3699a5 (dataset): DatasetConfig { id: bf207099-92f0-40ac-9f00-a6771d3699a5 (dataset), name: DatasetName { pool_name: ZpoolName { id: cc26c009-a951-4771-a26a-f2513b9e63e2 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_7db61d8a-2b76-4a38-9be0-42b379308323" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c01f002e-cf56-40a8-856e-717717a9d209 (dataset): DatasetConfig { id: c01f002e-cf56-40a8-856e-717717a9d209 (dataset), name: DatasetName { pool_name: ZpoolName { id: d7af1128-7206-4198-91cb-ef632ea8556e (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c053334f-bbf4-4fee-9888-b056a9cc51db (dataset): DatasetConfig { id: c053334f-bbf4-4fee-9888-b056a9cc51db (dataset), name: DatasetName { pool_name: ZpoolName { id: ca727341-d003-494b-b98d-9fa5b5aeeec8 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_1d808376-6b5a-46f0-b373-d7ba578556eb" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c4e421b8-1195-43e3-b9ac-bfc9ad77e7e7 (dataset): DatasetConfig { id: c4e421b8-1195-43e3-b9ac-bfc9ad77e7e7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 56aea45f-c451-4174-9b8f-66145c2696e8 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cb50db26-684b-438a-8c48-94aaff4042b9 (dataset): DatasetConfig { id: cb50db26-684b-438a-8c48-94aaff4042b9 (dataset), name: DatasetName { pool_name: ZpoolName { id: d7af1128-7206-4198-91cb-ef632ea8556e (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_0b6bc18d-d78b-4cf7-a684-c6255a25f2ed" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cbedc4cc-97ac-4e36-8a65-377112c625cf (dataset): DatasetConfig { id: cbedc4cc-97ac-4e36-8a65-377112c625cf (dataset), name: DatasetName { pool_name: ZpoolName { id: d7af1128-7206-4198-91cb-ef632ea8556e (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ce3ee622-fe93-452c-99db-39dcaf440329 (dataset): DatasetConfig { id: ce3ee622-fe93-452c-99db-39dcaf440329 (dataset), name: DatasetName { pool_name: ZpoolName { id: cc26c009-a951-4771-a26a-f2513b9e63e2 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_234660ab-07d6-46bf-8748-19a6e4eb0d61" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d0452f08-9fee-4410-9972-0c1a7ded5e09 (dataset): DatasetConfig { id: d0452f08-9fee-4410-9972-0c1a7ded5e09 (dataset), name: DatasetName { pool_name: ZpoolName { id: df57d550-ef00-4438-9a9e-b1b08bdaa525 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, d06a9a59-e653-48fa-8dcc-7cc0acef6ddc (dataset): DatasetConfig { id: d06a9a59-e653-48fa-8dcc-7cc0acef6ddc (dataset), name: DatasetName { pool_name: ZpoolName { id: fe712103-328f-4ff5-a621-99ae42de7f00 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_5ead9ee2-e8b0-4593-9027-48635affc5e2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d1103926-c3ce-497b-b7c7-67e9b91eb37c (dataset): DatasetConfig { id: d1103926-c3ce-497b-b7c7-67e9b91eb37c (dataset), name: DatasetName { pool_name: ZpoolName { id: 71fa9360-75cf-491a-b7ef-fd270ae2f32c (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_e75f2650-a245-42d3-9d24-2a4c8145f522" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d3e64b53-1d52-4e43-a327-aa25216b28de (dataset): DatasetConfig { id: d3e64b53-1d52-4e43-a327-aa25216b28de (dataset), name: DatasetName { pool_name: ZpoolName { id: 2517e8b2-3022-4575-a6ad-4786cce7adb4 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_0a80d709-bf2b-457a-9df6-b7c61cf35e54" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d4e26abc-aaaa-4c27-adf7-4d37b7ef906b (dataset): DatasetConfig { id: d4e26abc-aaaa-4c27-adf7-4d37b7ef906b (dataset), name: DatasetName { pool_name: ZpoolName { id: 71fa9360-75cf-491a-b7ef-fd270ae2f32c (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d7cdf6b3-3468-47c9-b703-0ff4bc28dac3 (dataset): DatasetConfig { id: d7cdf6b3-3468-47c9-b703-0ff4bc28dac3 (dataset), name: DatasetName { pool_name: ZpoolName { id: cc26c009-a951-4771-a26a-f2513b9e63e2 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, da842f30-e5ea-4a7c-b8fa-3d06f4a46ff3 (dataset): DatasetConfig { id: da842f30-e5ea-4a7c-b8fa-3d06f4a46ff3 (dataset), name: DatasetName { pool_name: ZpoolName { id: cc26c009-a951-4771-a26a-f2513b9e63e2 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_2f59c006-0a7d-42ea-a0d5-5b48cf7cd990" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, db6bbfb9-4289-4ad6-89ac-64034a50a0d4 (dataset): DatasetConfig { id: db6bbfb9-4289-4ad6-89ac-64034a50a0d4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 71fa9360-75cf-491a-b7ef-fd270ae2f32c (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e23716cc-1bb2-47d5-831a-401babcb900e (dataset): DatasetConfig { id: e23716cc-1bb2-47d5-831a-401babcb900e (dataset), name: DatasetName { pool_name: ZpoolName { id: 71fa9360-75cf-491a-b7ef-fd270ae2f32c (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_21786b6f-d071-4762-9de6-138ef833b3de" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e501ce1f-8495-44d6-9d50-8ffee6113168 (dataset): DatasetConfig { id: e501ce1f-8495-44d6-9d50-8ffee6113168 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1b4c5120-bb11-444d-9c86-edb04be1264c (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e6a84613-486b-440f-b73e-1efb98b8d0ef (dataset): DatasetConfig { id: e6a84613-486b-440f-b73e-1efb98b8d0ef (dataset), name: DatasetName { pool_name: ZpoolName { id: 56aea45f-c451-4174-9b8f-66145c2696e8 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_dd4b9bd7-7dc8-4c50-b7a6-ad30d3af9195" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e845c8a8-042c-4c36-b96a-86f6e68004ba (dataset): DatasetConfig { id: e845c8a8-042c-4c36-b96a-86f6e68004ba (dataset), name: DatasetName { pool_name: ZpoolName { id: cc26c009-a951-4771-a26a-f2513b9e63e2 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ef770427-0a5f-40b3-a157-2160a7628b15 (dataset): DatasetConfig { id: ef770427-0a5f-40b3-a157-2160a7628b15 (dataset), name: DatasetName { pool_name: ZpoolName { id: cc26c009-a951-4771-a26a-f2513b9e63e2 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_c588016e-a348-47f5-b498-43234ef44320" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f100cf37-ff11-499c-9032-ebaff0b595ca (dataset): DatasetConfig { id: f100cf37-ff11-499c-9032-ebaff0b595ca (dataset), name: DatasetName { pool_name: ZpoolName { id: 71fa9360-75cf-491a-b7ef-fd270ae2f32c (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_7c96e2c2-1643-4666-b1e3-92a7f608b3f8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f4a584df-900f-4dd9-b647-27dc36a44775 (dataset): DatasetConfig { id: f4a584df-900f-4dd9-b647-27dc36a44775 (dataset), name: DatasetName { pool_name: ZpoolName { id: 56aea45f-c451-4174-9b8f-66145c2696e8 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f569b3ad-5ca5-44f8-b297-c510d6f2270c (dataset): DatasetConfig { id: f569b3ad-5ca5-44f8-b297-c510d6f2270c (dataset), name: DatasetName { pool_name: ZpoolName { id: cc26c009-a951-4771-a26a-f2513b9e63e2 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f87725cb-a018-4c62-83d5-a022aac44dac (dataset): DatasetConfig { id: f87725cb-a018-4c62-83d5-a022aac44dac (dataset), name: DatasetName { pool_name: ZpoolName { id: cc26c009-a951-4771-a26a-f2513b9e63e2 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, faba2fb9-5b70-402c-a83d-13b625337d7d (dataset): DatasetConfig { id: faba2fb9-5b70-402c-a83d-13b625337d7d (dataset), name: DatasetName { pool_name: ZpoolName { id: fe712103-328f-4ff5-a621-99ae42de7f00 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_1287099d-2056-4e10-99e5-632481da2c2b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fe8ed89a-0644-451c-ab45-f80df0ebac21 (dataset): DatasetConfig { id: fe8ed89a-0644-451c-ab45-f80df0ebac21 (dataset), name: DatasetName { pool_name: ZpoolName { id: 56aea45f-c451-4174-9b8f-66145c2696e8 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fe927566-0c31-44e2-b69d-a0eee3ee5635 (dataset): DatasetConfig { id: fe927566-0c31-44e2-b69d-a0eee3ee5635 (dataset), name: DatasetName { pool_name: ZpoolName { id: 71fa9360-75cf-491a-b7ef-fd270ae2f32c (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} }, tx: ... } file = sled-storage/src/manager.rs:603
4752024-11-25T19:27:59.734ZINFOSledAgent (StorageManager): No ledger in /pool/int/dd272387-9bb6-475e-8ebb-47dcac6d1d2a/config/omicron-datasets.json file = common/src/ledger.rs:189 request = datasets_ensure
4762024-11-25T19:27:59.734ZINFOSledAgent (StorageManager): No ledger in /pool/int/a4bf8354-b44e-436c-b4f2-9bd494b77342/config/omicron-datasets.json file = common/src/ledger.rs:189 request = datasets_ensure
4772024-11-25T19:27:59.734ZINFOSledAgent (StorageManager): No previously-stored 'requested datasets', creating new ledger file = sled-storage/src/manager.rs:906 request = datasets_ensure
4782024-11-25T19:27:59.734ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4792024-11-25T19:27:59.734ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/71fa9360-75cf-491a-b7ef-fd270ae2f32c/crypt/zone/oxz_nexus_a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67"), full_name: "oxp_71fa9360-75cf-491a-b7ef-fd270ae2f32c/crypt/zone/oxz_nexus_a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67" } file = sled-storage/src/manager.rs:1338
4802024-11-25T19:27:59.829ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4812024-11-25T19:27:59.829ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_fe712103-328f-4ff5-a621-99ae42de7f00/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1338
4822024-11-25T19:27:59.918ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4832024-11-25T19:27:59.918ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_71fa9360-75cf-491a-b7ef-fd270ae2f32c/crypt/external_dns" } file = sled-storage/src/manager.rs:1338
4842024-11-25T19:28:00.008ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4852024-11-25T19:28:00.008ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/71fa9360-75cf-491a-b7ef-fd270ae2f32c/crypt/zone/oxz_external_dns_6b3cbeea-c72e-481d-a7a1-e27c601ccb03"), full_name: "oxp_71fa9360-75cf-491a-b7ef-fd270ae2f32c/crypt/zone/oxz_external_dns_6b3cbeea-c72e-481d-a7a1-e27c601ccb03" } file = sled-storage/src/manager.rs:1338
4862024-11-25T19:28:00.108ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4872024-11-25T19:28:00.108ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ca727341-d003-494b-b98d-9fa5b5aeeec8/crypt/zone"), full_name: "oxp_ca727341-d003-494b-b98d-9fa5b5aeeec8/crypt/zone" } file = sled-storage/src/manager.rs:1338
4882024-11-25T19:28:00.177ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4892024-11-25T19:28:00.177ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/cc26c009-a951-4771-a26a-f2513b9e63e2/crypt/debug"), full_name: "oxp_cc26c009-a951-4771-a26a-f2513b9e63e2/crypt/debug" } file = sled-storage/src/manager.rs:1338
4902024-11-25T19:28:00.244ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4912024-11-25T19:28:00.244ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d7af1128-7206-4198-91cb-ef632ea8556e/crypt/zone/oxz_crucible_863e78e3-a753-4fb2-97de-c46023f03292"), full_name: "oxp_d7af1128-7206-4198-91cb-ef632ea8556e/crypt/zone/oxz_crucible_863e78e3-a753-4fb2-97de-c46023f03292" } file = sled-storage/src/manager.rs:1338
4922024-11-25T19:28:00.294ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/38711855-ef69-4d79-bb75-aebd85b1280b) file = sled-agent/src/probe_manager.rs:231 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
4932024-11-25T19:28:00.342ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4942024-11-25T19:28:00.342ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ca727341-d003-494b-b98d-9fa5b5aeeec8/crypt/zone/oxz_ntp_50534bbc-e79b-4382-9f0d-65daaa00ec78"), full_name: "oxp_ca727341-d003-494b-b98d-9fa5b5aeeec8/crypt/zone/oxz_ntp_50534bbc-e79b-4382-9f0d-65daaa00ec78" } file = sled-storage/src/manager.rs:1338
4952024-11-25T19:28:00.441ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4962024-11-25T19:28:00.441ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_2517e8b2-3022-4575-a6ad-4786cce7adb4/crucible" } file = sled-storage/src/manager.rs:1338
4972024-11-25T19:28:00.526ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4982024-11-25T19:28:00.526ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ca727341-d003-494b-b98d-9fa5b5aeeec8/crypt/zone/oxz_crucible_42cf72f4-fa5d-45b0-b91f-af1c2e33690d"), full_name: "oxp_ca727341-d003-494b-b98d-9fa5b5aeeec8/crypt/zone/oxz_crucible_42cf72f4-fa5d-45b0-b91f-af1c2e33690d" } file = sled-storage/src/manager.rs:1338
4992024-11-25T19:28:00.623ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5002024-11-25T19:28:00.623ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/56aea45f-c451-4174-9b8f-66145c2696e8/crypt/zone/oxz_cockroachdb_7e8f0bb3-d78c-423c-95e4-008fd1e3aabc"), full_name: "oxp_56aea45f-c451-4174-9b8f-66145c2696e8/crypt/zone/oxz_cockroachdb_7e8f0bb3-d78c-423c-95e4-008fd1e3aabc" } file = sled-storage/src/manager.rs:1338
5012024-11-25T19:28:00.720ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5022024-11-25T19:28:00.720ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/cc26c009-a951-4771-a26a-f2513b9e63e2/crypt/zone/oxz_external_dns_5e357e48-2959-4886-8b9d-557b95c45fb7"), full_name: "oxp_cc26c009-a951-4771-a26a-f2513b9e63e2/crypt/zone/oxz_external_dns_5e357e48-2959-4886-8b9d-557b95c45fb7" } file = sled-storage/src/manager.rs:1338
5032024-11-25T19:28:00.821ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5042024-11-25T19:28:00.821ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_df57d550-ef00-4438-9a9e-b1b08bdaa525/crucible" } file = sled-storage/src/manager.rs:1338
5052024-11-25T19:28:00.910ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5062024-11-25T19:28:00.910ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/56aea45f-c451-4174-9b8f-66145c2696e8/crypt/debug"), full_name: "oxp_56aea45f-c451-4174-9b8f-66145c2696e8/crypt/debug" } file = sled-storage/src/manager.rs:1338
5072024-11-25T19:28:00.978ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5082024-11-25T19:28:00.978ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/cc26c009-a951-4771-a26a-f2513b9e63e2/crypt/zone"), full_name: "oxp_cc26c009-a951-4771-a26a-f2513b9e63e2/crypt/zone" } file = sled-storage/src/manager.rs:1338
5092024-11-25T19:28:01.047ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5102024-11-25T19:28:01.047ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d7af1128-7206-4198-91cb-ef632ea8556e/crypt/debug"), full_name: "oxp_d7af1128-7206-4198-91cb-ef632ea8556e/crypt/debug" } file = sled-storage/src/manager.rs:1338
5112024-11-25T19:28:01.115ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5122024-11-25T19:28:01.115ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_ca727341-d003-494b-b98d-9fa5b5aeeec8/crucible" } file = sled-storage/src/manager.rs:1338
5132024-11-25T19:28:01.203ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5142024-11-25T19:28:01.203ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2517e8b2-3022-4575-a6ad-4786cce7adb4/crypt/zone/oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3"), full_name: "oxp_2517e8b2-3022-4575-a6ad-4786cce7adb4/crypt/zone/oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3" } file = sled-storage/src/manager.rs:1338
5152024-11-25T19:28:01.299ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/38711855-ef69-4d79-bb75-aebd85b1280b) file = sled-agent/src/probe_manager.rs:231 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
5162024-11-25T19:28:01.318ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5172024-11-25T19:28:01.318ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1b4c5120-bb11-444d-9c86-edb04be1264c/crypt/zone/oxz_nexus_29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037"), full_name: "oxp_1b4c5120-bb11-444d-9c86-edb04be1264c/crypt/zone/oxz_nexus_29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037" } file = sled-storage/src/manager.rs:1338
5182024-11-25T19:28:01.417ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5192024-11-25T19:28:01.417ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/71fa9360-75cf-491a-b7ef-fd270ae2f32c/crypt/debug"), full_name: "oxp_71fa9360-75cf-491a-b7ef-fd270ae2f32c/crypt/debug" } file = sled-storage/src/manager.rs:1338
5202024-11-25T19:28:01.487ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5212024-11-25T19:28:01.487ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2517e8b2-3022-4575-a6ad-4786cce7adb4/crypt/debug"), full_name: "oxp_2517e8b2-3022-4575-a6ad-4786cce7adb4/crypt/debug" } file = sled-storage/src/manager.rs:1338
5222024-11-25T19:28:01.556ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5232024-11-25T19:28:01.556ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_71fa9360-75cf-491a-b7ef-fd270ae2f32c/crypt/clickhouse" } file = sled-storage/src/manager.rs:1338
5242024-11-25T19:28:01.645ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5252024-11-25T19:28:01.645ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/df57d550-ef00-4438-9a9e-b1b08bdaa525/crypt/zone"), full_name: "oxp_df57d550-ef00-4438-9a9e-b1b08bdaa525/crypt/zone" } file = sled-storage/src/manager.rs:1338
5262024-11-25T19:28:01.714ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5272024-11-25T19:28:01.714ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/fe712103-328f-4ff5-a621-99ae42de7f00/crypt/debug"), full_name: "oxp_fe712103-328f-4ff5-a621-99ae42de7f00/crypt/debug" } file = sled-storage/src/manager.rs:1338
5282024-11-25T19:28:01.782ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5292024-11-25T19:28:01.782ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2517e8b2-3022-4575-a6ad-4786cce7adb4/crypt/zone"), full_name: "oxp_2517e8b2-3022-4575-a6ad-4786cce7adb4/crypt/zone" } file = sled-storage/src/manager.rs:1338
5302024-11-25T19:28:01.851ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5312024-11-25T19:28:01.851ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ca727341-d003-494b-b98d-9fa5b5aeeec8/crypt/debug"), full_name: "oxp_ca727341-d003-494b-b98d-9fa5b5aeeec8/crypt/debug" } file = sled-storage/src/manager.rs:1338
5322024-11-25T19:28:01.919ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5332024-11-25T19:28:01.920ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/fe712103-328f-4ff5-a621-99ae42de7f00/crypt/zone"), full_name: "oxp_fe712103-328f-4ff5-a621-99ae42de7f00/crypt/zone" } file = sled-storage/src/manager.rs:1338
5342024-11-25T19:28:01.988ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5352024-11-25T19:28:01.988ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1b4c5120-bb11-444d-9c86-edb04be1264c/crypt/debug"), full_name: "oxp_1b4c5120-bb11-444d-9c86-edb04be1264c/crypt/debug" } file = sled-storage/src/manager.rs:1338
5362024-11-25T19:28:02.058ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5372024-11-25T19:28:02.058ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/df57d550-ef00-4438-9a9e-b1b08bdaa525/crypt/zone/oxz_crucible_fa3bd66a-1a51-4937-9188-36e5fc334f7c"), full_name: "oxp_df57d550-ef00-4438-9a9e-b1b08bdaa525/crypt/zone/oxz_crucible_fa3bd66a-1a51-4937-9188-36e5fc334f7c" } file = sled-storage/src/manager.rs:1338
5382024-11-25T19:28:02.156ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5392024-11-25T19:28:02.156ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_fe712103-328f-4ff5-a621-99ae42de7f00/crucible" } file = sled-storage/src/manager.rs:1338
5402024-11-25T19:28:02.207ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 8.500038563s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
5412024-11-25T19:28:02.244ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5422024-11-25T19:28:02.244ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/56aea45f-c451-4174-9b8f-66145c2696e8/crypt/zone"), full_name: "oxp_56aea45f-c451-4174-9b8f-66145c2696e8/crypt/zone" } file = sled-storage/src/manager.rs:1338
5432024-11-25T19:28:02.303ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/38711855-ef69-4d79-bb75-aebd85b1280b) file = sled-agent/src/probe_manager.rs:231 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
5442024-11-25T19:28:02.313ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5452024-11-25T19:28:02.313ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d7af1128-7206-4198-91cb-ef632ea8556e/crypt/zone/oxz_crucible_pantry_9bea4b41-0e61-416b-9a60-0c3dff58b905"), full_name: "oxp_d7af1128-7206-4198-91cb-ef632ea8556e/crypt/zone/oxz_crucible_pantry_9bea4b41-0e61-416b-9a60-0c3dff58b905" } file = sled-storage/src/manager.rs:1338
5462024-11-25T19:28:02.417ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5472024-11-25T19:28:02.417ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1b4c5120-bb11-444d-9c86-edb04be1264c/crypt/zone/oxz_crucible_3a33ba47-8706-4469-959c-acd4a6a8404e"), full_name: "oxp_1b4c5120-bb11-444d-9c86-edb04be1264c/crypt/zone/oxz_crucible_3a33ba47-8706-4469-959c-acd4a6a8404e" } file = sled-storage/src/manager.rs:1338
5482024-11-25T19:28:02.519ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5492024-11-25T19:28:02.519ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/56aea45f-c451-4174-9b8f-66145c2696e8/crypt/zone/oxz_crucible_d6f634f5-3528-4e41-966f-f47648523f6a"), full_name: "oxp_56aea45f-c451-4174-9b8f-66145c2696e8/crypt/zone/oxz_crucible_d6f634f5-3528-4e41-966f-f47648523f6a" } file = sled-storage/src/manager.rs:1338
5502024-11-25T19:28:02.619ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5512024-11-25T19:28:02.619ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_d7af1128-7206-4198-91cb-ef632ea8556e/crucible" } file = sled-storage/src/manager.rs:1338
5522024-11-25T19:28:02.708ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5532024-11-25T19:28:02.708ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/71fa9360-75cf-491a-b7ef-fd270ae2f32c/crypt/zone/oxz_internal_dns_64a08338-1eb5-49da-827e-ddea69a7943c"), full_name: "oxp_71fa9360-75cf-491a-b7ef-fd270ae2f32c/crypt/zone/oxz_internal_dns_64a08338-1eb5-49da-827e-ddea69a7943c" } file = sled-storage/src/manager.rs:1338
5542024-11-25T19:28:02.807ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5552024-11-25T19:28:02.807ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_71fa9360-75cf-491a-b7ef-fd270ae2f32c/crypt/internal_dns" } file = sled-storage/src/manager.rs:1338
5562024-11-25T19:28:02.898ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5572024-11-25T19:28:02.898ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_1b4c5120-bb11-444d-9c86-edb04be1264c/crucible" } file = sled-storage/src/manager.rs:1338
5582024-11-25T19:28:02.986ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5592024-11-25T19:28:02.986ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/71fa9360-75cf-491a-b7ef-fd270ae2f32c/crypt/zone/oxz_oximeter_4f833d1f-8a98-4545-91ff-69d713fdd1f0"), full_name: "oxp_71fa9360-75cf-491a-b7ef-fd270ae2f32c/crypt/zone/oxz_oximeter_4f833d1f-8a98-4545-91ff-69d713fdd1f0" } file = sled-storage/src/manager.rs:1338
5602024-11-25T19:28:03.087ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5612024-11-25T19:28:03.087ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/cc26c009-a951-4771-a26a-f2513b9e63e2/crypt/zone/oxz_crucible_7db61d8a-2b76-4a38-9be0-42b379308323"), full_name: "oxp_cc26c009-a951-4771-a26a-f2513b9e63e2/crypt/zone/oxz_crucible_7db61d8a-2b76-4a38-9be0-42b379308323" } file = sled-storage/src/manager.rs:1338
5622024-11-25T19:28:03.186ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5632024-11-25T19:28:03.186ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d7af1128-7206-4198-91cb-ef632ea8556e/crypt/zone"), full_name: "oxp_d7af1128-7206-4198-91cb-ef632ea8556e/crypt/zone" } file = sled-storage/src/manager.rs:1338
5642024-11-25T19:28:03.254ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5652024-11-25T19:28:03.254ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ca727341-d003-494b-b98d-9fa5b5aeeec8/crypt/zone/oxz_nexus_1d808376-6b5a-46f0-b373-d7ba578556eb"), full_name: "oxp_ca727341-d003-494b-b98d-9fa5b5aeeec8/crypt/zone/oxz_nexus_1d808376-6b5a-46f0-b373-d7ba578556eb" } file = sled-storage/src/manager.rs:1338
5662024-11-25T19:28:03.304ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/38711855-ef69-4d79-bb75-aebd85b1280b) file = sled-agent/src/probe_manager.rs:231 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
5672024-11-25T19:28:03.356ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5682024-11-25T19:28:03.356ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_56aea45f-c451-4174-9b8f-66145c2696e8/crypt/internal_dns" } file = sled-storage/src/manager.rs:1338
5692024-11-25T19:28:03.447ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5702024-11-25T19:28:03.447ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d7af1128-7206-4198-91cb-ef632ea8556e/crypt/zone/oxz_cockroachdb_0b6bc18d-d78b-4cf7-a684-c6255a25f2ed"), full_name: "oxp_d7af1128-7206-4198-91cb-ef632ea8556e/crypt/zone/oxz_cockroachdb_0b6bc18d-d78b-4cf7-a684-c6255a25f2ed" } file = sled-storage/src/manager.rs:1338
5712024-11-25T19:28:03.548ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5722024-11-25T19:28:03.548ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_d7af1128-7206-4198-91cb-ef632ea8556e/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1338
5732024-11-25T19:28:03.639ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5742024-11-25T19:28:03.639ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/cc26c009-a951-4771-a26a-f2513b9e63e2/crypt/zone/oxz_crucible_pantry_234660ab-07d6-46bf-8748-19a6e4eb0d61"), full_name: "oxp_cc26c009-a951-4771-a26a-f2513b9e63e2/crypt/zone/oxz_crucible_pantry_234660ab-07d6-46bf-8748-19a6e4eb0d61" } file = sled-storage/src/manager.rs:1338
5752024-11-25T19:28:03.740ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5762024-11-25T19:28:03.740ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/df57d550-ef00-4438-9a9e-b1b08bdaa525/crypt/debug"), full_name: "oxp_df57d550-ef00-4438-9a9e-b1b08bdaa525/crypt/debug" } file = sled-storage/src/manager.rs:1338
5772024-11-25T19:28:03.808ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5782024-11-25T19:28:03.808ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/fe712103-328f-4ff5-a621-99ae42de7f00/crypt/zone/oxz_cockroachdb_5ead9ee2-e8b0-4593-9027-48635affc5e2"), full_name: "oxp_fe712103-328f-4ff5-a621-99ae42de7f00/crypt/zone/oxz_cockroachdb_5ead9ee2-e8b0-4593-9027-48635affc5e2" } file = sled-storage/src/manager.rs:1338
5792024-11-25T19:28:03.907ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5802024-11-25T19:28:03.907ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/71fa9360-75cf-491a-b7ef-fd270ae2f32c/crypt/zone/oxz_cockroachdb_e75f2650-a245-42d3-9d24-2a4c8145f522"), full_name: "oxp_71fa9360-75cf-491a-b7ef-fd270ae2f32c/crypt/zone/oxz_cockroachdb_e75f2650-a245-42d3-9d24-2a4c8145f522" } file = sled-storage/src/manager.rs:1338
5812024-11-25T19:28:04.008ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5822024-11-25T19:28:04.008ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2517e8b2-3022-4575-a6ad-4786cce7adb4/crypt/zone/oxz_crucible_pantry_0a80d709-bf2b-457a-9df6-b7c61cf35e54"), full_name: "oxp_2517e8b2-3022-4575-a6ad-4786cce7adb4/crypt/zone/oxz_crucible_pantry_0a80d709-bf2b-457a-9df6-b7c61cf35e54" } file = sled-storage/src/manager.rs:1338
5832024-11-25T19:28:04.109ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5842024-11-25T19:28:04.109ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_71fa9360-75cf-491a-b7ef-fd270ae2f32c/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1338
5852024-11-25T19:28:04.199ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5862024-11-25T19:28:04.199ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_cc26c009-a951-4771-a26a-f2513b9e63e2/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1338
5872024-11-25T19:28:04.290ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5882024-11-25T19:28:04.290ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/cc26c009-a951-4771-a26a-f2513b9e63e2/crypt/zone/oxz_cockroachdb_2f59c006-0a7d-42ea-a0d5-5b48cf7cd990"), full_name: "oxp_cc26c009-a951-4771-a26a-f2513b9e63e2/crypt/zone/oxz_cockroachdb_2f59c006-0a7d-42ea-a0d5-5b48cf7cd990" } file = sled-storage/src/manager.rs:1338
5892024-11-25T19:28:04.306ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/38711855-ef69-4d79-bb75-aebd85b1280b) file = sled-agent/src/probe_manager.rs:231 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
5902024-11-25T19:28:04.388ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5912024-11-25T19:28:04.388ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_71fa9360-75cf-491a-b7ef-fd270ae2f32c/crucible" } file = sled-storage/src/manager.rs:1338
5922024-11-25T19:28:04.484ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5932024-11-25T19:28:04.484ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/71fa9360-75cf-491a-b7ef-fd270ae2f32c/crypt/zone/oxz_clickhouse_21786b6f-d071-4762-9de6-138ef833b3de"), full_name: "oxp_71fa9360-75cf-491a-b7ef-fd270ae2f32c/crypt/zone/oxz_clickhouse_21786b6f-d071-4762-9de6-138ef833b3de" } file = sled-storage/src/manager.rs:1338
5942024-11-25T19:28:04.586ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5952024-11-25T19:28:04.586ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1b4c5120-bb11-444d-9c86-edb04be1264c/crypt/zone"), full_name: "oxp_1b4c5120-bb11-444d-9c86-edb04be1264c/crypt/zone" } file = sled-storage/src/manager.rs:1338
5962024-11-25T19:28:04.654ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5972024-11-25T19:28:04.654ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/56aea45f-c451-4174-9b8f-66145c2696e8/crypt/zone/oxz_internal_dns_dd4b9bd7-7dc8-4c50-b7a6-ad30d3af9195"), full_name: "oxp_56aea45f-c451-4174-9b8f-66145c2696e8/crypt/zone/oxz_internal_dns_dd4b9bd7-7dc8-4c50-b7a6-ad30d3af9195" } file = sled-storage/src/manager.rs:1338
5982024-11-25T19:28:04.754ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5992024-11-25T19:28:04.754ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_cc26c009-a951-4771-a26a-f2513b9e63e2/crucible" } file = sled-storage/src/manager.rs:1338
6002024-11-25T19:28:04.841ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
6012024-11-25T19:28:04.841ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/cc26c009-a951-4771-a26a-f2513b9e63e2/crypt/zone/oxz_internal_dns_c588016e-a348-47f5-b498-43234ef44320"), full_name: "oxp_cc26c009-a951-4771-a26a-f2513b9e63e2/crypt/zone/oxz_internal_dns_c588016e-a348-47f5-b498-43234ef44320" } file = sled-storage/src/manager.rs:1338
6022024-11-25T19:28:04.902ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:4346
6032024-11-25T19:28:04.902ZINFOSledAgent (ServiceManager): Ensuring there is a default route file = sled-agent/src/services.rs:4356 gateway = fd00:1122:3344:101::1
6042024-11-25T19:28:04.908ZINFOSledAgent (ServiceManager): Default route already exists file = sled-agent/src/services.rs:4370 gateway = fd00:1122:3344:101::1
6052024-11-25T19:28:04.908ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4435
6062024-11-25T19:28:04.954ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
6072024-11-25T19:28:04.954ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/71fa9360-75cf-491a-b7ef-fd270ae2f32c/crypt/zone/oxz_crucible_7c96e2c2-1643-4666-b1e3-92a7f608b3f8"), full_name: "oxp_71fa9360-75cf-491a-b7ef-fd270ae2f32c/crypt/zone/oxz_crucible_7c96e2c2-1643-4666-b1e3-92a7f608b3f8" } file = sled-storage/src/manager.rs:1338
6082024-11-25T19:28:05.070ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
6092024-11-25T19:28:05.070ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_56aea45f-c451-4174-9b8f-66145c2696e8/crucible" } file = sled-storage/src/manager.rs:1338
6102024-11-25T19:28:05.070ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4501
6112024-11-25T19:28:05.070ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4528
6122024-11-25T19:28:05.088ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14429237625139708775 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
6132024-11-25T19:28:05.089ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3794891261527998048 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
6142024-11-25T19:28:05.116ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4541
6152024-11-25T19:28:05.116ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4387
6162024-11-25T19:28:05.166ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
6172024-11-25T19:28:05.166ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_cc26c009-a951-4771-a26a-f2513b9e63e2/crypt/internal_dns" } file = sled-storage/src/manager.rs:1338
6182024-11-25T19:28:05.170ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4429
6192024-11-25T19:28:05.170ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4508 rack_subnet = fd00:1122:3344::
6202024-11-25T19:28:05.192ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4519
6212024-11-25T19:28:05.192ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4561
6222024-11-25T19:28:05.267ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4593
6232024-11-25T19:28:05.267ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4599
6242024-11-25T19:28:05.269ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
6252024-11-25T19:28:05.269ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_cc26c009-a951-4771-a26a-f2513b9e63e2/crypt/external_dns" } file = sled-storage/src/manager.rs:1338
6262024-11-25T19:28:05.309ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/38711855-ef69-4d79-bb75-aebd85b1280b) file = sled-agent/src/probe_manager.rs:231 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
6272024-11-25T19:28:05.366ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4640
6282024-11-25T19:28:05.366ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:370
6292024-11-25T19:28:05.372ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
6302024-11-25T19:28:05.372ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/fe712103-328f-4ff5-a621-99ae42de7f00/crypt/zone/oxz_crucible_1287099d-2056-4e10-99e5-632481da2c2b"), full_name: "oxp_fe712103-328f-4ff5-a621-99ae42de7f00/crypt/zone/oxz_crucible_1287099d-2056-4e10-99e5-632481da2c2b" } file = sled-storage/src/manager.rs:1338
6312024-11-25T19:28:05.408ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:420
6322024-11-25T19:28:05.409ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/38711855-ef69-4d79-bb75-aebd85b1280b) file = sled-agent/src/nexus.rs:527 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
6332024-11-25T19:28:05.450ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:717
6342024-11-25T19:28:05.450ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:762
6352024-11-25T19:28:05.451ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:765 uptime = 1
6362024-11-25T19:28:05.451ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.1.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: Some(\n None,\n ),\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n tx_eq: None,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:444
6372024-11-25T19:28:05.474ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
6382024-11-25T19:28:05.474ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_56aea45f-c451-4174-9b8f-66145c2696e8/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1338
6392024-11-25T19:28:05.506ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4173
6402024-11-25T19:28:05.571ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
6412024-11-25T19:28:05.571ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/71fa9360-75cf-491a-b7ef-fd270ae2f32c/crypt/zone"), full_name: "oxp_71fa9360-75cf-491a-b7ef-fd270ae2f32c/crypt/zone" } file = sled-storage/src/manager.rs:1338
6422024-11-25T19:28:05.640ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/dd272387-9bb6-475e-8ebb-47dcac6d1d2a/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:200 request = datasets_ensure
6432024-11-25T19:28:05.641ZINFOSledAgent (StorageManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/dd272387-9bb6-475e-8ebb-47dcac6d1d2a/config/omicron-datasets.json" request = datasets_ensure
6442024-11-25T19:28:05.641ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/a4bf8354-b44e-436c-b4f2-9bd494b77342/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:200 request = datasets_ensure
6452024-11-25T19:28:05.641ZINFOSledAgent (StorageManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/a4bf8354-b44e-436c-b4f2-9bd494b77342/config/omicron-datasets.json" request = datasets_ensure
6462024-11-25T19:28:05.641ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:603
6472024-11-25T19:28:05.641ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
6482024-11-25T19:28:05.641ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
6492024-11-25T19:28:05.641ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
6502024-11-25T19:28:05.641ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
6512024-11-25T19:28:05.641ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
6522024-11-25T19:28:05.641ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
6532024-11-25T19:28:05.641ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
6542024-11-25T19:28:05.641ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
6552024-11-25T19:28:05.641ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
6562024-11-25T19:28:05.641ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
6572024-11-25T19:28:05.641ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
6582024-11-25T19:28:05.641ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
6592024-11-25T19:28:05.641ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
6602024-11-25T19:28:05.641ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
6612024-11-25T19:28:05.641ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
6622024-11-25T19:28:05.641ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
6632024-11-25T19:28:05.641ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
6642024-11-25T19:28:05.641ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
6652024-11-25T19:28:05.641ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
6662024-11-25T19:28:05.641ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
6672024-11-25T19:28:05.641ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
6682024-11-25T19:28:05.641ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
6692024-11-25T19:28:05.641ZINFOSledAgent: datasets ensure: Updated storage file = sled-agent/src/sled_agent.rs:851 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
6702024-11-25T19:28:05.641ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5910858 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:37409 req_id = dc2cc081-4ce1-4b75-b881-c24d758f5854 response_code = 200 uri = /datasets
6712024-11-25T19:28:05.673ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: 64a08338-1eb5-49da-827e-ddea69a7943c (service), filesystem_pool: Some(ZpoolName { id: 71fa9360-75cf-491a-b7ef-fd270ae2f32c (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 71fa9360-75cf-491a-b7ef-fd270ae2f32c (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: c588016e-a348-47f5-b498-43234ef44320 (service), filesystem_pool: Some(ZpoolName { id: cc26c009-a951-4771-a26a-f2513b9e63e2 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: cc26c009-a951-4771-a26a-f2513b9e63e2 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: dd4b9bd7-7dc8-4c50-b7a6-ad30d3af9195 (service), filesystem_pool: Some(ZpoolName { id: 56aea45f-c451-4174-9b8f-66145c2696e8 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 56aea45f-c451-4174-9b8f-66145c2696e8 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:538 sled_address = [fd00:1122:3344:101::1]:12345
6722024-11-25T19:28:05.673ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56622
6732024-11-25T19:28:05.674ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6742024-11-25T19:28:05.674ZINFOSledAgent (ServiceManager): No ledger in /pool/int/dd272387-9bb6-475e-8ebb-47dcac6d1d2a/config/omicron-zones.json file = common/src/ledger.rs:189
6752024-11-25T19:28:05.674ZINFOSledAgent (ServiceManager): No ledger in /pool/int/a4bf8354-b44e-436c-b4f2-9bd494b77342/config/omicron-zones.json file = common/src/ledger.rs:189
6762024-11-25T19:28:05.674ZINFOSledAgent (StorageManager): Received DatasetsConfigList { tx: ... } file = sled-storage/src/manager.rs:603
6772024-11-25T19:28:05.674ZINFOSledAgent (StorageManager): Reading ledger from /pool/int/dd272387-9bb6-475e-8ebb-47dcac6d1d2a/config/omicron-datasets.json file = common/src/ledger.rs:178 request = datasets_config_list
6782024-11-25T19:28:05.674ZINFOSledAgent (StorageManager): Reading ledger from /pool/int/a4bf8354-b44e-436c-b4f2-9bd494b77342/config/omicron-datasets.json file = common/src/ledger.rs:178 request = datasets_config_list
6792024-11-25T19:28:05.674ZINFOSledAgent (StorageManager): Found ledger on internal storage file = sled-storage/src/manager.rs:992 request = datasets_config_list
6802024-11-25T19:28:05.674ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6812024-11-25T19:28:05.720ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6822024-11-25T19:28:05.720ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6832024-11-25T19:28:05.720ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6842024-11-25T19:28:05.773ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_c588016e-a348-47f5-b498-43234ef44320 file = illumos-utils/src/zone.rs:325
6852024-11-25T19:28:05.776ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_dd4b9bd7-7dc8-4c50-b7a6-ad30d3af9195 file = illumos-utils/src/zone.rs:325
6862024-11-25T19:28:05.780ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_64a08338-1eb5-49da-827e-ddea69a7943c file = illumos-utils/src/zone.rs:325
6872024-11-25T19:28:05.792ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_c588016e-a348-47f5-b498-43234ef44320 file = illumos-utils/src/zone.rs:363
6882024-11-25T19:28:05.796ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_dd4b9bd7-7dc8-4c50-b7a6-ad30d3af9195 file = illumos-utils/src/zone.rs:363
6892024-11-25T19:28:05.800ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_64a08338-1eb5-49da-827e-ddea69a7943c file = illumos-utils/src/zone.rs:363
6902024-11-25T19:28:06.311ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/38711855-ef69-4d79-bb75-aebd85b1280b) file = sled-agent/src/probe_manager.rs:231 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
6912024-11-25T19:28:06.747ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14677523493110185006 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
6922024-11-25T19:28:06.747ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4713903543762200350 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
6932024-11-25T19:28:07.418ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_64a08338-1eb5-49da-827e-ddea69a7943c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6942024-11-25T19:28:07.418ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
6952024-11-25T19:28:07.897ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_c588016e-a348-47f5-b498-43234ef44320: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6962024-11-25T19:28:08.374ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_dd4b9bd7-7dc8-4c50-b7a6-ad30d3af9195: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6972024-11-25T19:28:08.374ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
6982024-11-25T19:28:08.374ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_64a08338-1eb5-49da-827e-ddea69a7943c zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_64a08338-1eb5-49da-827e-ddea69a7943c
6992024-11-25T19:28:08.378ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
7002024-11-25T19:28:08.378ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_c588016e-a348-47f5-b498-43234ef44320 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_c588016e-a348-47f5-b498-43234ef44320
7012024-11-25T19:28:08.382ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_dd4b9bd7-7dc8-4c50-b7a6-ad30d3af9195 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_dd4b9bd7-7dc8-4c50-b7a6-ad30d3af9195
7022024-11-25T19:28:08.508ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_64a08338-1eb5-49da-827e-ddea69a7943c") failed: Property not found. retry in 35.978872ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_64a08338-1eb5-49da-827e-ddea69a7943c
7032024-11-25T19:28:08.514ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c588016e-a348-47f5-b498-43234ef44320") failed: Property not found. retry in 58.510229ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c588016e-a348-47f5-b498-43234ef44320
7042024-11-25T19:28:08.520ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_dd4b9bd7-7dc8-4c50-b7a6-ad30d3af9195") failed: Property not found. retry in 71.881029ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_dd4b9bd7-7dc8-4c50-b7a6-ad30d3af9195
7052024-11-25T19:28:08.551ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_64a08338-1eb5-49da-827e-ddea69a7943c") failed: Property not found. retry in 82.781349ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_64a08338-1eb5-49da-827e-ddea69a7943c
7062024-11-25T19:28:08.608ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c588016e-a348-47f5-b498-43234ef44320") failed: Property not found. retry in 131.107287ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c588016e-a348-47f5-b498-43234ef44320
7072024-11-25T19:28:08.625ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_dd4b9bd7-7dc8-4c50-b7a6-ad30d3af9195") failed: Property not found. retry in 138.689079ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_dd4b9bd7-7dc8-4c50-b7a6-ad30d3af9195
7082024-11-25T19:28:08.750ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_64a08338-1eb5-49da-827e-ddea69a7943c") failed: Property not found. retry in 293.350079ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_64a08338-1eb5-49da-827e-ddea69a7943c
7092024-11-25T19:28:08.938ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c588016e-a348-47f5-b498-43234ef44320") failed: Property not found. retry in 142.201603ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c588016e-a348-47f5-b498-43234ef44320
7102024-11-25T19:28:09.001ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_dd4b9bd7-7dc8-4c50-b7a6-ad30d3af9195") failed: Property not found. retry in 103.979754ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_dd4b9bd7-7dc8-4c50-b7a6-ad30d3af9195
7112024-11-25T19:28:09.121ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_64a08338-1eb5-49da-827e-ddea69a7943c") failed: Property not found. retry in 440.322971ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_64a08338-1eb5-49da-827e-ddea69a7943c
7122024-11-25T19:28:09.143ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c588016e-a348-47f5-b498-43234ef44320") failed: Property not found. retry in 348.848351ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c588016e-a348-47f5-b498-43234ef44320
7132024-11-25T19:28:09.162ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_dd4b9bd7-7dc8-4c50-b7a6-ad30d3af9195") failed: Property not found. retry in 219.075647ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_dd4b9bd7-7dc8-4c50-b7a6-ad30d3af9195
7142024-11-25T19:28:09.394ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_dd4b9bd7-7dc8-4c50-b7a6-ad30d3af9195") failed: Property not found. retry in 1.185077704s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_dd4b9bd7-7dc8-4c50-b7a6-ad30d3af9195
7152024-11-25T19:28:09.503ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c588016e-a348-47f5-b498-43234ef44320") failed: Property not found. retry in 804.735558ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c588016e-a348-47f5-b498-43234ef44320
7162024-11-25T19:28:09.570ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_64a08338-1eb5-49da-827e-ddea69a7943c") failed: Property not found. retry in 722.408632ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_64a08338-1eb5-49da-827e-ddea69a7943c
7172024-11-25T19:28:10.304ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_64a08338-1eb5-49da-827e-ddea69a7943c") failed: Property not found. retry in 1.320638829s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_64a08338-1eb5-49da-827e-ddea69a7943c
7182024-11-25T19:28:10.317ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c588016e-a348-47f5-b498-43234ef44320") failed: Property not found. retry in 1.287752597s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c588016e-a348-47f5-b498-43234ef44320
7192024-11-25T19:28:10.588ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_dd4b9bd7-7dc8-4c50-b7a6-ad30d3af9195") failed: Property not found. retry in 962.160314ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_dd4b9bd7-7dc8-4c50-b7a6-ad30d3af9195
7202024-11-25T19:28:11.560ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_dd4b9bd7-7dc8-4c50-b7a6-ad30d3af9195") failed: Property not found. retry in 1.218494867s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_dd4b9bd7-7dc8-4c50-b7a6-ad30d3af9195
7212024-11-25T19:28:11.613ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c588016e-a348-47f5-b498-43234ef44320") failed: Property not found. retry in 562.108968ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c588016e-a348-47f5-b498-43234ef44320
7222024-11-25T19:28:11.632ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_64a08338-1eb5-49da-827e-ddea69a7943c") failed: Property not found. retry in 1.432580545s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_64a08338-1eb5-49da-827e-ddea69a7943c
7232024-11-25T19:28:12.183ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c588016e-a348-47f5-b498-43234ef44320") failed: Property not found. retry in 1.060949751s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c588016e-a348-47f5-b498-43234ef44320
7242024-11-25T19:28:12.786ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_dd4b9bd7-7dc8-4c50-b7a6-ad30d3af9195") failed: Property not found. retry in 950.833236ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_dd4b9bd7-7dc8-4c50-b7a6-ad30d3af9195
7252024-11-25T19:28:13.076ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_64a08338-1eb5-49da-827e-ddea69a7943c") failed: Property not found. retry in 1.009548861s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_64a08338-1eb5-49da-827e-ddea69a7943c
7262024-11-25T19:28:13.254ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c588016e-a348-47f5-b498-43234ef44320") failed: Property not found. retry in 1.039128259s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c588016e-a348-47f5-b498-43234ef44320
7272024-11-25T19:28:13.747ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_dd4b9bd7-7dc8-4c50-b7a6-ad30d3af9195") failed: Property not found. retry in 1.395423259s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_dd4b9bd7-7dc8-4c50-b7a6-ad30d3af9195
7282024-11-25T19:28:15.090ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14429237625139708775 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
7292024-11-25T19:28:15.090ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3794891261527998048 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
7302024-11-25T19:28:15.162ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_internal_dns_c588016e-a348-47f5-b498-43234ef44320
7312024-11-25T19:28:15.162ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_internal_dns_dd4b9bd7-7dc8-4c50-b7a6-ad30d3af9195
7322024-11-25T19:28:15.162ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_internal_dns_64a08338-1eb5-49da-827e-ddea69a7943c
7332024-11-25T19:28:15.163ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/dd272387-9bb6-475e-8ebb-47dcac6d1d2a/config/.omicron-zones.json.tmp file = common/src/ledger.rs:200
7342024-11-25T19:28:15.163ZINFOSledAgent (ServiceManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/dd272387-9bb6-475e-8ebb-47dcac6d1d2a/config/omicron-zones.json"
7352024-11-25T19:28:15.163ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/a4bf8354-b44e-436c-b4f2-9bd494b77342/config/.omicron-zones.json.tmp file = common/src/ledger.rs:200
7362024-11-25T19:28:15.163ZINFOSledAgent (ServiceManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/a4bf8354-b44e-436c-b4f2-9bd494b77342/config/omicron-zones.json"
7372024-11-25T19:28:15.163ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9489730 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:56622 req_id = 6469cdb1-5263-4f80-9c48-df193872f9e3 response_code = 204 uri = /omicron-zones
7382024-11-25T19:28:15.165ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:655
7392024-11-25T19:28:15.213ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:655
7402024-11-25T19:28:15.260ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:655
7412024-11-25T19:28:15.308ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:691
7422024-11-25T19:28:15.308ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7432024-11-25T19:28:15.340ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7442024-11-25T19:28:15.340ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7452024-11-25T19:28:15.340ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7462024-11-25T19:28:15.370ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: 64a08338-1eb5-49da-827e-ddea69a7943c (service), filesystem_pool: Some(ZpoolName { id: 71fa9360-75cf-491a-b7ef-fd270ae2f32c (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 71fa9360-75cf-491a-b7ef-fd270ae2f32c (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: c588016e-a348-47f5-b498-43234ef44320 (service), filesystem_pool: Some(ZpoolName { id: cc26c009-a951-4771-a26a-f2513b9e63e2 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: cc26c009-a951-4771-a26a-f2513b9e63e2 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: dd4b9bd7-7dc8-4c50-b7a6-ad30d3af9195 (service), filesystem_pool: Some(ZpoolName { id: 56aea45f-c451-4174-9b8f-66145c2696e8 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 56aea45f-c451-4174-9b8f-66145c2696e8 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 50534bbc-e79b-4382-9f0d-65daaa00ec78 (service), filesystem_pool: Some(ZpoolName { id: ca727341-d003-494b-b98d-9fa5b5aeeec8 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 9187eec3-ac34-4efc-9cac-ca1119452c7e, kind: Service { id: 50534bbc-e79b-4382-9f0d-65daaa00ec78 }, name: Name("ntp-50534bbc-e79b-4382-9f0d-65daaa00ec78"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 136, 178])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:538 sled_address = [fd00:1122:3344:101::1]:12345
7472024-11-25T19:28:15.370ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37594
7482024-11-25T19:28:15.370ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7492024-11-25T19:28:15.370ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/dd272387-9bb6-475e-8ebb-47dcac6d1d2a/config/omicron-zones.json file = common/src/ledger.rs:178
7502024-11-25T19:28:15.370ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/a4bf8354-b44e-436c-b4f2-9bd494b77342/config/omicron-zones.json file = common/src/ledger.rs:178
7512024-11-25T19:28:15.370ZINFOSledAgent (StorageManager): Received DatasetsConfigList { tx: ... } file = sled-storage/src/manager.rs:603
7522024-11-25T19:28:15.370ZINFOSledAgent (StorageManager): Reading ledger from /pool/int/dd272387-9bb6-475e-8ebb-47dcac6d1d2a/config/omicron-datasets.json file = common/src/ledger.rs:178 request = datasets_config_list
7532024-11-25T19:28:15.370ZINFOSledAgent (StorageManager): Reading ledger from /pool/int/a4bf8354-b44e-436c-b4f2-9bd494b77342/config/omicron-datasets.json file = common/src/ledger.rs:178 request = datasets_config_list
7542024-11-25T19:28:15.371ZINFOSledAgent (StorageManager): Found ledger on internal storage file = sled-storage/src/manager.rs:992 request = datasets_config_list
7552024-11-25T19:28:15.371ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7562024-11-25T19:28:15.383ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7572024-11-25T19:28:15.416ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7582024-11-25T19:28:15.417ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7592024-11-25T19:28:15.417ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7602024-11-25T19:28:15.446ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 136, 178]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
7612024-11-25T19:28:15.446ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1271 zone_type = boundary_ntp
7622024-11-25T19:28:15.473ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:83
7632024-11-25T19:28:15.473ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:90
7642024-11-25T19:28:15.473ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:118
7652024-11-25T19:28:15.474ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7662024-11-25T19:28:15.499ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_50534bbc-e79b-4382-9f0d-65daaa00ec78 file = illumos-utils/src/zone.rs:325
7672024-11-25T19:28:15.517ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_50534bbc-e79b-4382-9f0d-65daaa00ec78 file = illumos-utils/src/zone.rs:363
7682024-11-25T19:28:16.138ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_50534bbc-e79b-4382-9f0d-65daaa00ec78: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7692024-11-25T19:28:16.138ZINFOSledAgent (ServiceManager): Booting oxz_ntp_50534bbc-e79b-4382-9f0d-65daaa00ec78 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_ntp_50534bbc-e79b-4382-9f0d-65daaa00ec78
7702024-11-25T19:28:16.279ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_50534bbc-e79b-4382-9f0d-65daaa00ec78") failed: Property not found. retry in 72.058505ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_50534bbc-e79b-4382-9f0d-65daaa00ec78
7712024-11-25T19:28:16.363ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_50534bbc-e79b-4382-9f0d-65daaa00ec78") failed: Property not found. retry in 141.848815ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_50534bbc-e79b-4382-9f0d-65daaa00ec78
7722024-11-25T19:28:16.517ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_50534bbc-e79b-4382-9f0d-65daaa00ec78") failed: Property not found. retry in 243.025092ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_50534bbc-e79b-4382-9f0d-65daaa00ec78
7732024-11-25T19:28:16.749ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14677523493110185006 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
7742024-11-25T19:28:16.749ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4713903543762200350 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
7752024-11-25T19:28:16.769ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_50534bbc-e79b-4382-9f0d-65daaa00ec78") failed: Property not found. retry in 363.401087ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_50534bbc-e79b-4382-9f0d-65daaa00ec78
7762024-11-25T19:28:17.142ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_50534bbc-e79b-4382-9f0d-65daaa00ec78") failed: Property not found. retry in 521.114784ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_50534bbc-e79b-4382-9f0d-65daaa00ec78
7772024-11-25T19:28:17.674ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_50534bbc-e79b-4382-9f0d-65daaa00ec78") failed: Property not found. retry in 539.345367ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_50534bbc-e79b-4382-9f0d-65daaa00ec78
7782024-11-25T19:28:18.222ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_50534bbc-e79b-4382-9f0d-65daaa00ec78") failed: Property not found. retry in 1.219650482s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_50534bbc-e79b-4382-9f0d-65daaa00ec78
7792024-11-25T19:28:19.450ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_50534bbc-e79b-4382-9f0d-65daaa00ec78") failed: Property not found. retry in 1.315195582s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_50534bbc-e79b-4382-9f0d-65daaa00ec78
7802024-11-25T19:28:20.774ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_50534bbc-e79b-4382-9f0d-65daaa00ec78") failed: Property not found. retry in 616.595898ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_50534bbc-e79b-4382-9f0d-65daaa00ec78
7812024-11-25T19:28:21.411ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_ntp_50534bbc-e79b-4382-9f0d-65daaa00ec78
7822024-11-25T19:28:21.411ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/dd272387-9bb6-475e-8ebb-47dcac6d1d2a/config/.omicron-zones.json.tmp file = common/src/ledger.rs:200
7832024-11-25T19:28:21.411ZINFOSledAgent (ServiceManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/dd272387-9bb6-475e-8ebb-47dcac6d1d2a/config/omicron-zones.json"
7842024-11-25T19:28:21.411ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/a4bf8354-b44e-436c-b4f2-9bd494b77342/config/.omicron-zones.json.tmp file = common/src/ledger.rs:200
7852024-11-25T19:28:21.412ZINFOSledAgent (ServiceManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/a4bf8354-b44e-436c-b4f2-9bd494b77342/config/omicron-zones.json"
7862024-11-25T19:28:21.412ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6041865 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:37594 req_id = 2c40ba51-a5fb-496a-9590-707752bc718a response_code = 204 uri = /omicron-zones
7872024-11-25T19:28:21.414ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:732
7882024-11-25T19:28:21.445ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
7892024-11-25T19:28:21.445ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64154
7902024-11-25T19:28:21.454ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_50534bbc-e79b-4382-9f0d-65daaa00ec78': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3954
7912024-11-25T19:28:21.454ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 9034 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:64154 req_id = 2013be7c-463e-4822-b860-2277d5ea7b00 response_code = 500 uri = /timesync
7922024-11-25T19:28:21.457ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
7932024-11-25T19:28:21.626ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
7942024-11-25T19:28:21.626ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44264
7952024-11-25T19:28:24.117ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6548380365538563005 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
7962024-11-25T19:28:24.316ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3191602134441840933 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
7972024-11-25T19:28:25.092ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14429237625139708775 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
7982024-11-25T19:28:25.092ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3794891261527998048 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
7992024-11-25T19:28:25.163ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9051884434243860396 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
8002024-11-25T19:28:25.635ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_50534bbc-e79b-4382-9f0d-65daaa00ec78': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3954
8012024-11-25T19:28:25.635ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 4008817 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:44264 req_id = bc0b3886-b9c6-479f-8cc1-14c3c47a3701 response_code = 500 uri = /timesync
8022024-11-25T19:28:25.638ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8032024-11-25T19:28:25.835ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8042024-11-25T19:28:25.835ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35528
8052024-11-25T19:28:25.844ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_50534bbc-e79b-4382-9f0d-65daaa00ec78': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3954
8062024-11-25T19:28:25.844ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 8551 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:35528 req_id = ea35e22b-4119-4b3a-bcdf-ea2488ec1262 response_code = 500 uri = /timesync
8072024-11-25T19:28:25.847ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8082024-11-25T19:28:25.956ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8092024-11-25T19:28:25.956ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35160
8102024-11-25T19:28:26.751ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14677523493110185006 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
8112024-11-25T19:28:26.751ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4713903543762200350 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
8122024-11-25T19:28:31.142ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_50534bbc-e79b-4382-9f0d-65daaa00ec78': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3954
8132024-11-25T19:28:31.142ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 4008711 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:35160 req_id = 9fc4da86-45dd-45e9-9ea5-925c64efc26f response_code = 500 uri = /timesync
8142024-11-25T19:28:31.146ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8152024-11-25T19:28:31.378ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8162024-11-25T19:28:31.378ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61607
8172024-11-25T19:28:31.387ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9254 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:61607 req_id = 7f9fcf9a-025d-403a-8bb9-3cdcebf03e42 response_code = 200 uri = /timesync
8182024-11-25T19:28:31.390ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:740
8192024-11-25T19:28:31.390ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8202024-11-25T19:28:31.537ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8212024-11-25T19:28:31.538ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44033
8222024-11-25T19:28:31.546ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:44033 req_id = 59619069-91b3-479e-8889-bf9ba3fb1691 response_code = 200 uri = /timesync
8232024-11-25T19:28:31.549ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:740
8242024-11-25T19:28:31.549ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8252024-11-25T19:28:31.708ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8262024-11-25T19:28:31.708ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39197
8272024-11-25T19:28:31.716ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8600 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39197 req_id = 9a8eb1ea-eb4a-4b27-8cb3-1afc6818f9b1 response_code = 200 uri = /timesync
8282024-11-25T19:28:31.720ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:740
8292024-11-25T19:28:31.720ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8302024-11-25T19:28:31.921ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 201.10962ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
8312024-11-25T19:28:32.143ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8322024-11-25T19:28:32.143ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51049
8332024-11-25T19:28:32.151ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7940 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:51049 req_id = 20b5b0a9-2ca1-40fa-a52d-4770040ef289 response_code = 200 uri = /timesync
8342024-11-25T19:28:32.152ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.209177569 } file = sled-agent/src/rack_setup/service.rs:740
8352024-11-25T19:28:32.152ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8362024-11-25T19:28:32.606ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8372024-11-25T19:28:32.606ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:38637
8382024-11-25T19:28:32.610ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1246036174995345413 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
8392024-11-25T19:28:32.611ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4554135899350342217 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
8402024-11-25T19:28:32.615ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:38637 req_id = 9e2b79a0-81a3-452f-b5ce-57fce4a4b10a response_code = 200 uri = /timesync
8412024-11-25T19:28:32.617ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.207917765 } file = sled-agent/src/rack_setup/service.rs:740
8422024-11-25T19:28:32.617ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8432024-11-25T19:28:33.234ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8442024-11-25T19:28:33.234ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39939
8452024-11-25T19:28:33.242ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8441 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39939 req_id = 362246ec-e57a-4603-a425-140fd9eb27b8 response_code = 200 uri = /timesync
8462024-11-25T19:28:33.244ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.210137963 } file = sled-agent/src/rack_setup/service.rs:740
8472024-11-25T19:28:33.244ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8482024-11-25T19:28:33.850ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8492024-11-25T19:28:33.850ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:36159
8502024-11-25T19:28:33.859ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8732 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:36159 req_id = 24c2a04c-28a8-43c5-be5a-6ae3c67f61b1 response_code = 200 uri = /timesync
8512024-11-25T19:28:33.860ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.207762644 } file = sled-agent/src/rack_setup/service.rs:740
8522024-11-25T19:28:33.860ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8532024-11-25T19:28:34.293ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8542024-11-25T19:28:34.294ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:32933
8552024-11-25T19:28:34.301ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7653 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:32933 req_id = d8b457d8-d574-425a-b87e-c0fd66bba2ef response_code = 200 uri = /timesync
8562024-11-25T19:28:34.304ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.203712136 } file = sled-agent/src/rack_setup/service.rs:740
8572024-11-25T19:28:34.304ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8582024-11-25T19:28:35.287ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6548380365538563005 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
8592024-11-25T19:28:35.398ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8602024-11-25T19:28:35.398ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64560
8612024-11-25T19:28:35.407ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9050 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:64560 req_id = c6f6085e-e2e6-4a01-8a94-b9356618b982 response_code = 200 uri = /timesync
8622024-11-25T19:28:35.409ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.201277077 } file = sled-agent/src/rack_setup/service.rs:740
8632024-11-25T19:28:35.409ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8642024-11-25T19:28:35.485ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3191602134441840933 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
8652024-11-25T19:28:36.250ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:50380
8662024-11-25T19:28:36.250ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:50380 req_id = d305f9bc-c27a-4c27-9c49-15be110e8e06 response_code = 200 uri = /baseboard
8672024-11-25T19:28:36.260ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14429237625139708775 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
8682024-11-25T19:28:36.260ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3794891261527998048 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
8692024-11-25T19:28:36.330ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9051884434243860396 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
8702024-11-25T19:28:36.417ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8712024-11-25T19:28:36.417ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57075
8722024-11-25T19:28:36.425ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8366 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:57075 req_id = 363e81e2-99d4-4c3b-9f52-fb70c3c33740 response_code = 200 uri = /timesync
8732024-11-25T19:28:36.427ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.197415397 } file = sled-agent/src/rack_setup/service.rs:740
8742024-11-25T19:28:36.427ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8752024-11-25T19:28:37.913ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8762024-11-25T19:28:37.913ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:38547
8772024-11-25T19:28:37.918ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14677523493110185006 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
8782024-11-25T19:28:37.918ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4713903543762200350 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
8792024-11-25T19:28:37.923ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9425 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:38547 req_id = 246ec2da-2f6b-4760-927c-de69810a228d response_code = 200 uri = /timesync
8802024-11-25T19:28:37.925ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.192720652 } file = sled-agent/src/rack_setup/service.rs:740
8812024-11-25T19:28:37.925ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8822024-11-25T19:28:38.767ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8832024-11-25T19:28:38.767ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41074
8842024-11-25T19:28:38.777ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9056 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:41074 req_id = 567f3fe8-7460-41a5-8d6d-96f8355eb650 response_code = 200 uri = /timesync
8852024-11-25T19:28:38.780ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.190637171 } file = sled-agent/src/rack_setup/service.rs:740
8862024-11-25T19:28:38.780ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8872024-11-25T19:28:39.869ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8882024-11-25T19:28:39.869ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42175
8892024-11-25T19:28:39.878ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8554 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42175 req_id = 7db3f74e-d207-4e3e-8d2f-83572e0a57c5 response_code = 200 uri = /timesync
8902024-11-25T19:28:39.880ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 89013796, ip_addr: 5.78.62.36, stratum: 5, ref_time: 1732562918.6929233, correction: -0.18702893 } file = sled-agent/src/rack_setup/service.rs:740
8912024-11-25T19:28:39.880ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8922024-11-25T19:28:42.456ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8932024-11-25T19:28:42.456ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:36193
8942024-11-25T19:28:42.465ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9022 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:36193 req_id = 024af6cd-58f9-482a-9b54-cdb57e1dd2e2 response_code = 200 uri = /timesync
8952024-11-25T19:28:42.467ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 89013796, ip_addr: 5.78.62.36, stratum: 5, ref_time: 1732562921.6158073, correction: -0.180489749 } file = sled-agent/src/rack_setup/service.rs:740
8962024-11-25T19:28:42.467ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8972024-11-25T19:28:42.586ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1246036174995345413 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
8982024-11-25T19:28:42.586ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4554135899350342217 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
8992024-11-25T19:28:43.992ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9002024-11-25T19:28:43.992ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37653
9012024-11-25T19:28:44.001ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8954 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:37653 req_id = 3155721f-df7a-40f7-a361-a56e4a6841c0 response_code = 200 uri = /timesync
9022024-11-25T19:28:44.003ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 89013796, ip_addr: 5.78.62.36, stratum: 5, ref_time: 1732562922.2198071, correction: -0.176071927 } file = sled-agent/src/rack_setup/service.rs:740
9032024-11-25T19:28:44.003ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9042024-11-25T19:28:45.263ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6548380365538563005 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
9052024-11-25T19:28:45.459ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3191602134441840933 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
9062024-11-25T19:28:46.235ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14429237625139708775 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
9072024-11-25T19:28:46.235ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3794891261527998048 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
9082024-11-25T19:28:46.304ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9051884434243860396 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
9092024-11-25T19:28:47.141ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 312.619346ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
9102024-11-25T19:28:47.474ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9112024-11-25T19:28:47.474ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51228
9122024-11-25T19:28:47.485ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10599 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:51228 req_id = 687390b4-1a6c-458b-8628-98080108c154 response_code = 200 uri = /timesync
9132024-11-25T19:28:47.487ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 89013796, ip_addr: 5.78.62.36, stratum: 5, ref_time: 1732562926.3994803, correction: -0.167273268 } file = sled-agent/src/rack_setup/service.rs:740
9142024-11-25T19:28:47.487ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9152024-11-25T19:28:47.892ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14677523493110185006 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
9162024-11-25T19:28:47.893ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4713903543762200350 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
9172024-11-25T19:28:51.633ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9182024-11-25T19:28:51.633ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45823
9192024-11-25T19:28:51.642ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8940 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:45823 req_id = 0226b38b-4ed2-4a5e-9dd6-9a78b30fc5ad response_code = 200 uri = /timesync
9202024-11-25T19:28:51.645ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 89013796, ip_addr: 5.78.62.36, stratum: 5, ref_time: 1732562930.5201964, correction: -0.1561407 } file = sled-agent/src/rack_setup/service.rs:740
9212024-11-25T19:28:51.645ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9222024-11-25T19:28:52.562ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1246036174995345413 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
9232024-11-25T19:28:52.562ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4554135899350342217 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
9242024-11-25T19:28:55.239ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6548380365538563005 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
9252024-11-25T19:28:55.434ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3191602134441840933 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
9262024-11-25T19:28:56.149ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9272024-11-25T19:28:56.149ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46803
9282024-11-25T19:28:56.158ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8915 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:46803 req_id = 59ef1c0b-0b24-4a11-b6ed-ad94da4d35a9 response_code = 200 uri = /timesync
9292024-11-25T19:28:56.162ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 89013796, ip_addr: 5.78.62.36, stratum: 5, ref_time: 1732562934.4051776, correction: -0.144311547 } file = sled-agent/src/rack_setup/service.rs:740
9302024-11-25T19:28:56.162ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9312024-11-25T19:28:56.210ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 14429237625139708775 reason = Duration(60s) sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
9322024-11-25T19:28:56.211ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 3794891261527998048 reason = Duration(60s) sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
9332024-11-25T19:28:56.280ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9051884434243860396 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
9342024-11-25T19:28:57.868ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14677523493110185006 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
9352024-11-25T19:28:57.868ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4713903543762200350 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
9362024-11-25T19:29:02.476ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.394768501s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
9372024-11-25T19:29:02.537ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1246036174995345413 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
9382024-11-25T19:29:02.537ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4554135899350342217 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
9392024-11-25T19:29:02.964ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9402024-11-25T19:29:02.965ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44890
9412024-11-25T19:29:02.974ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8899 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:44890 req_id = a7eec939-a68c-448c-b2cc-ea4ef3410d76 response_code = 200 uri = /timesync
9422024-11-25T19:29:02.976ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 89013796, ip_addr: 5.78.62.36, stratum: 5, ref_time: 1732562941.840566, correction: -0.126408473 } file = sled-agent/src/rack_setup/service.rs:740
9432024-11-25T19:29:02.976ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9442024-11-25T19:29:05.213ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6548380365538563005 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
9452024-11-25T19:29:05.409ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3191602134441840933 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
9462024-11-25T19:29:06.203ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:60723
9472024-11-25T19:29:06.203ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:60723 req_id = d49e4702-e719-4540-831a-f279388813b7 response_code = 200 uri = /baseboard
9482024-11-25T19:29:06.254ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9051884434243860396 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
9492024-11-25T19:29:07.843ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14677523493110185006 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
9502024-11-25T19:29:07.844ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4713903543762200350 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
9512024-11-25T19:29:10.629ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9522024-11-25T19:29:10.629ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40447
9532024-11-25T19:29:10.638ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8799 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:40447 req_id = 414c2ccd-ba7e-4fb7-bef3-90426b783f72 response_code = 200 uri = /timesync
9542024-11-25T19:29:10.641ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 89013796, ip_addr: 5.78.62.36, stratum: 5, ref_time: 1732562948.4226625, correction: -0.106010966 } file = sled-agent/src/rack_setup/service.rs:740
9552024-11-25T19:29:10.641ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9562024-11-25T19:29:12.511ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1246036174995345413 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
9572024-11-25T19:29:12.511ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4554135899350342217 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
9582024-11-25T19:29:15.187ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 6548380365538563005 reason = Duration(60s) sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
9592024-11-25T19:29:15.383ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 3191602134441840933 reason = Duration(60s) sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
9602024-11-25T19:29:16.229ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 9051884434243860396 reason = Duration(60s) sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
9612024-11-25T19:29:16.871ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9622024-11-25T19:29:16.871ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63837
9632024-11-25T19:29:16.879ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8541 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:63837 req_id = 25ba8afb-dce7-4918-a5f6-c9627721a8e4 response_code = 200 uri = /timesync
9642024-11-25T19:29:16.882ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 89013796, ip_addr: 5.78.62.36, stratum: 5, ref_time: 1732562955.9928997, correction: -0.088278085 } file = sled-agent/src/rack_setup/service.rs:740
9652024-11-25T19:29:16.882ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9662024-11-25T19:29:17.819ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14677523493110185006 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
9672024-11-25T19:29:17.819ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4713903543762200350 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
9682024-11-25T19:29:18.863ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.39240773s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
9692024-11-25T19:29:22.486ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 1246036174995345413 reason = Duration(60s) sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
9702024-11-25T19:29:22.487ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 4554135899350342217 reason = Duration(60s) sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
9712024-11-25T19:29:24.959ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9722024-11-25T19:29:24.959ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46669
9732024-11-25T19:29:24.969ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9294 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:46669 req_id = 7693424d-a9ea-4efa-860a-9c291c3e5f0f response_code = 200 uri = /timesync
9742024-11-25T19:29:24.973ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 89013796, ip_addr: 5.78.62.36, stratum: 5, ref_time: 1732562963.7487357, correction: -0.065616116 } file = sled-agent/src/rack_setup/service.rs:740
9752024-11-25T19:29:24.973ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9762024-11-25T19:29:27.794ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14677523493110185006 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
9772024-11-25T19:29:27.794ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4713903543762200350 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
9782024-11-25T19:29:31.952ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9792024-11-25T19:29:31.953ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40559
9802024-11-25T19:29:31.973ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 20048 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:40559 req_id = 66b2cc4f-1a3f-4cb3-8b5a-b714b8dc75de response_code = 200 uri = /timesync
9812024-11-25T19:29:31.973ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-25T19:29:15.383008595Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 3191602134441840933 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
9822024-11-25T19:29:31.974ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-25T19:29:22.486866307Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 1246036174995345413 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
9832024-11-25T19:29:31.975ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-25T19:28:56.211016933Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 3794891261527998048 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
9842024-11-25T19:29:31.975ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-25T19:29:15.187902871Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 6548380365538563005 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
9852024-11-25T19:29:31.976ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-25T19:29:22.487126633Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 4554135899350342217 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
9862024-11-25T19:29:31.976ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-25T19:28:56.210476192Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 14429237625139708775 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
9872024-11-25T19:29:31.976ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-25T19:29:16.229424422Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 9051884434243860396 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
9882024-11-25T19:29:31.977ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 89013796, ip_addr: 5.78.62.36, stratum: 5, ref_time: 1732562963.7487357, correction: -0.046626098 } file = sled-agent/src/rack_setup/service.rs:740
9892024-11-25T19:29:31.977ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1425
9902024-11-25T19:29:32.006ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 64a08338-1eb5-49da-827e-ddea69a7943c (service), filesystem_pool: Some(ZpoolName { id: 71fa9360-75cf-491a-b7ef-fd270ae2f32c (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 71fa9360-75cf-491a-b7ef-fd270ae2f32c (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: c588016e-a348-47f5-b498-43234ef44320 (service), filesystem_pool: Some(ZpoolName { id: cc26c009-a951-4771-a26a-f2513b9e63e2 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: cc26c009-a951-4771-a26a-f2513b9e63e2 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: dd4b9bd7-7dc8-4c50-b7a6-ad30d3af9195 (service), filesystem_pool: Some(ZpoolName { id: 56aea45f-c451-4174-9b8f-66145c2696e8 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 56aea45f-c451-4174-9b8f-66145c2696e8 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 50534bbc-e79b-4382-9f0d-65daaa00ec78 (service), filesystem_pool: Some(ZpoolName { id: ca727341-d003-494b-b98d-9fa5b5aeeec8 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 9187eec3-ac34-4efc-9cac-ca1119452c7e, kind: Service { id: 50534bbc-e79b-4382-9f0d-65daaa00ec78 }, name: Name("ntp-50534bbc-e79b-4382-9f0d-65daaa00ec78"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 136, 178])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: e75f2650-a245-42d3-9d24-2a4c8145f522 (service), filesystem_pool: Some(ZpoolName { id: 71fa9360-75cf-491a-b7ef-fd270ae2f32c (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 71fa9360-75cf-491a-b7ef-fd270ae2f32c (zpool), kind: External } } } }, OmicronZoneConfig { id: 2f59c006-0a7d-42ea-a0d5-5b48cf7cd990 (service), filesystem_pool: Some(ZpoolName { id: cc26c009-a951-4771-a26a-f2513b9e63e2 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: cc26c009-a951-4771-a26a-f2513b9e63e2 (zpool), kind: External } } } }, OmicronZoneConfig { id: 7e8f0bb3-d78c-423c-95e4-008fd1e3aabc (service), filesystem_pool: Some(ZpoolName { id: 56aea45f-c451-4174-9b8f-66145c2696e8 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 56aea45f-c451-4174-9b8f-66145c2696e8 (zpool), kind: External } } } }, OmicronZoneConfig { id: 0b6bc18d-d78b-4cf7-a684-c6255a25f2ed (service), filesystem_pool: Some(ZpoolName { id: d7af1128-7206-4198-91cb-ef632ea8556e (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d7af1128-7206-4198-91cb-ef632ea8556e (zpool), kind: External } } } }, OmicronZoneConfig { id: 5ead9ee2-e8b0-4593-9027-48635affc5e2 (service), filesystem_pool: Some(ZpoolName { id: fe712103-328f-4ff5-a621-99ae42de7f00 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fe712103-328f-4ff5-a621-99ae42de7f00 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:538 sled_address = [fd00:1122:3344:101::1]:12345
9912024-11-25T19:29:32.006ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37743
9922024-11-25T19:29:32.006ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
9932024-11-25T19:29:32.006ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/dd272387-9bb6-475e-8ebb-47dcac6d1d2a/config/omicron-zones.json file = common/src/ledger.rs:178
9942024-11-25T19:29:32.007ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/a4bf8354-b44e-436c-b4f2-9bd494b77342/config/omicron-zones.json file = common/src/ledger.rs:178
9952024-11-25T19:29:32.007ZINFOSledAgent (StorageManager): Received DatasetsConfigList { tx: ... } file = sled-storage/src/manager.rs:603
9962024-11-25T19:29:32.007ZINFOSledAgent (StorageManager): Reading ledger from /pool/int/dd272387-9bb6-475e-8ebb-47dcac6d1d2a/config/omicron-datasets.json file = common/src/ledger.rs:178 request = datasets_config_list
9972024-11-25T19:29:32.007ZINFOSledAgent (StorageManager): Reading ledger from /pool/int/a4bf8354-b44e-436c-b4f2-9bd494b77342/config/omicron-datasets.json file = common/src/ledger.rs:178 request = datasets_config_list
9982024-11-25T19:29:32.007ZINFOSledAgent (StorageManager): Found ledger on internal storage file = sled-storage/src/manager.rs:992 request = datasets_config_list
9992024-11-25T19:29:32.007ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10002024-11-25T19:29:32.100ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10012024-11-25T19:29:32.100ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10022024-11-25T19:29:32.100ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10032024-11-25T19:29:32.100ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10042024-11-25T19:29:32.100ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10052024-11-25T19:29:32.193ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_2f59c006-0a7d-42ea-a0d5-5b48cf7cd990 file = illumos-utils/src/zone.rs:325
10062024-11-25T19:29:32.197ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_7e8f0bb3-d78c-423c-95e4-008fd1e3aabc file = illumos-utils/src/zone.rs:325
10072024-11-25T19:29:32.201ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_e75f2650-a245-42d3-9d24-2a4c8145f522 file = illumos-utils/src/zone.rs:325
10082024-11-25T19:29:32.206ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_5ead9ee2-e8b0-4593-9027-48635affc5e2 file = illumos-utils/src/zone.rs:325
10092024-11-25T19:29:32.210ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_0b6bc18d-d78b-4cf7-a684-c6255a25f2ed file = illumos-utils/src/zone.rs:325
10102024-11-25T19:29:32.215ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_2f59c006-0a7d-42ea-a0d5-5b48cf7cd990 file = illumos-utils/src/zone.rs:363
10112024-11-25T19:29:32.220ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_7e8f0bb3-d78c-423c-95e4-008fd1e3aabc file = illumos-utils/src/zone.rs:363
10122024-11-25T19:29:32.224ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_e75f2650-a245-42d3-9d24-2a4c8145f522 file = illumos-utils/src/zone.rs:363
10132024-11-25T19:29:32.228ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_5ead9ee2-e8b0-4593-9027-48635affc5e2 file = illumos-utils/src/zone.rs:363
10142024-11-25T19:29:32.233ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_0b6bc18d-d78b-4cf7-a684-c6255a25f2ed file = illumos-utils/src/zone.rs:363
10152024-11-25T19:29:35.161ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_2f59c006-0a7d-42ea-a0d5-5b48cf7cd990: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='2f59c006-0a7d-42ea-a0d5-5b48cf7cd990'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10162024-11-25T19:29:35.162ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_2f59c006-0a7d-42ea-a0d5-5b48cf7cd990 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_2f59c006-0a7d-42ea-a0d5-5b48cf7cd990
10172024-11-25T19:29:35.168ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_7e8f0bb3-d78c-423c-95e4-008fd1e3aabc: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='7e8f0bb3-d78c-423c-95e4-008fd1e3aabc'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10182024-11-25T19:29:35.168ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_7e8f0bb3-d78c-423c-95e4-008fd1e3aabc zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_7e8f0bb3-d78c-423c-95e4-008fd1e3aabc
10192024-11-25T19:29:35.225ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_0b6bc18d-d78b-4cf7-a684-c6255a25f2ed: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='0b6bc18d-d78b-4cf7-a684-c6255a25f2ed'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10202024-11-25T19:29:35.225ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_0b6bc18d-d78b-4cf7-a684-c6255a25f2ed zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_0b6bc18d-d78b-4cf7-a684-c6255a25f2ed
10212024-11-25T19:29:35.247ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 5.647474097s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
10222024-11-25T19:29:35.308ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_e75f2650-a245-42d3-9d24-2a4c8145f522: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='e75f2650-a245-42d3-9d24-2a4c8145f522'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10232024-11-25T19:29:35.308ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_e75f2650-a245-42d3-9d24-2a4c8145f522 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_e75f2650-a245-42d3-9d24-2a4c8145f522
10242024-11-25T19:29:35.335ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2f59c006-0a7d-42ea-a0d5-5b48cf7cd990") failed: Property not found. retry in 29.294011ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2f59c006-0a7d-42ea-a0d5-5b48cf7cd990
10252024-11-25T19:29:35.345ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7e8f0bb3-d78c-423c-95e4-008fd1e3aabc") failed: Property not found. retry in 59.447168ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7e8f0bb3-d78c-423c-95e4-008fd1e3aabc
10262024-11-25T19:29:35.345ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_5ead9ee2-e8b0-4593-9027-48635affc5e2: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='5ead9ee2-e8b0-4593-9027-48635affc5e2'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10272024-11-25T19:29:35.345ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_5ead9ee2-e8b0-4593-9027-48635affc5e2 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_5ead9ee2-e8b0-4593-9027-48635affc5e2
10282024-11-25T19:29:35.376ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2f59c006-0a7d-42ea-a0d5-5b48cf7cd990") failed: Property not found. retry in 67.996702ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2f59c006-0a7d-42ea-a0d5-5b48cf7cd990
10292024-11-25T19:29:35.417ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0b6bc18d-d78b-4cf7-a684-c6255a25f2ed") failed: Property not found. retry in 54.886138ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0b6bc18d-d78b-4cf7-a684-c6255a25f2ed
10302024-11-25T19:29:35.742ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7e8f0bb3-d78c-423c-95e4-008fd1e3aabc") failed: Property not found. retry in 98.593443ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7e8f0bb3-d78c-423c-95e4-008fd1e3aabc
10312024-11-25T19:29:35.851ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2f59c006-0a7d-42ea-a0d5-5b48cf7cd990") failed: Property not found. retry in 242.044422ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2f59c006-0a7d-42ea-a0d5-5b48cf7cd990
10322024-11-25T19:29:35.924ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7e8f0bb3-d78c-423c-95e4-008fd1e3aabc") failed: Property not found. retry in 287.963ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7e8f0bb3-d78c-423c-95e4-008fd1e3aabc
10332024-11-25T19:29:35.936ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0b6bc18d-d78b-4cf7-a684-c6255a25f2ed") failed: Property not found. retry in 86.116745ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0b6bc18d-d78b-4cf7-a684-c6255a25f2ed
10342024-11-25T19:29:35.952ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e75f2650-a245-42d3-9d24-2a4c8145f522") failed: Property not found. retry in 42.315719ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e75f2650-a245-42d3-9d24-2a4c8145f522
10352024-11-25T19:29:36.002ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5ead9ee2-e8b0-4593-9027-48635affc5e2") failed: Property not found. retry in 63.921058ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5ead9ee2-e8b0-4593-9027-48635affc5e2
10362024-11-25T19:29:36.012ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e75f2650-a245-42d3-9d24-2a4c8145f522") failed: Property not found. retry in 117.537386ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e75f2650-a245-42d3-9d24-2a4c8145f522
10372024-11-25T19:29:36.061ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0b6bc18d-d78b-4cf7-a684-c6255a25f2ed") failed: Property not found. retry in 241.851003ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0b6bc18d-d78b-4cf7-a684-c6255a25f2ed
10382024-11-25T19:29:36.090ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5ead9ee2-e8b0-4593-9027-48635affc5e2") failed: Property not found. retry in 99.849661ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5ead9ee2-e8b0-4593-9027-48635affc5e2
10392024-11-25T19:29:36.484ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2f59c006-0a7d-42ea-a0d5-5b48cf7cd990") failed: Property not found. retry in 411.742142ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2f59c006-0a7d-42ea-a0d5-5b48cf7cd990
10402024-11-25T19:29:36.500ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7e8f0bb3-d78c-423c-95e4-008fd1e3aabc") failed: Property not found. retry in 328.675387ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7e8f0bb3-d78c-423c-95e4-008fd1e3aabc
10412024-11-25T19:29:36.536ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e75f2650-a245-42d3-9d24-2a4c8145f522") failed: Property not found. retry in 184.637739ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e75f2650-a245-42d3-9d24-2a4c8145f522
10422024-11-25T19:29:36.587ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:38169
10432024-11-25T19:29:36.588ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 491 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:38169 req_id = 3669ec42-b672-44c0-b724-27da6c5952e6 response_code = 200 uri = /baseboard
10442024-11-25T19:29:36.594ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5ead9ee2-e8b0-4593-9027-48635affc5e2") failed: Property not found. retry in 278.404098ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5ead9ee2-e8b0-4593-9027-48635affc5e2
10452024-11-25T19:29:36.630ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0b6bc18d-d78b-4cf7-a684-c6255a25f2ed") failed: Property not found. retry in 536.426516ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0b6bc18d-d78b-4cf7-a684-c6255a25f2ed
10462024-11-25T19:29:36.740ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e75f2650-a245-42d3-9d24-2a4c8145f522") failed: Property not found. retry in 295.776533ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e75f2650-a245-42d3-9d24-2a4c8145f522
10472024-11-25T19:29:36.842ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7e8f0bb3-d78c-423c-95e4-008fd1e3aabc") failed: Property not found. retry in 1.100467685s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7e8f0bb3-d78c-423c-95e4-008fd1e3aabc
10482024-11-25T19:29:36.889ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5ead9ee2-e8b0-4593-9027-48635affc5e2") failed: Property not found. retry in 246.750511ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5ead9ee2-e8b0-4593-9027-48635affc5e2
10492024-11-25T19:29:36.901ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2f59c006-0a7d-42ea-a0d5-5b48cf7cd990") failed: Property not found. retry in 959.164841ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2f59c006-0a7d-42ea-a0d5-5b48cf7cd990
10502024-11-25T19:29:37.048ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e75f2650-a245-42d3-9d24-2a4c8145f522") failed: Property not found. retry in 1.048658287s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e75f2650-a245-42d3-9d24-2a4c8145f522
10512024-11-25T19:29:37.147ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5ead9ee2-e8b0-4593-9027-48635affc5e2") failed: Property not found. retry in 701.575736ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5ead9ee2-e8b0-4593-9027-48635affc5e2
10522024-11-25T19:29:37.174ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0b6bc18d-d78b-4cf7-a684-c6255a25f2ed") failed: Property not found. retry in 400.436809ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0b6bc18d-d78b-4cf7-a684-c6255a25f2ed
10532024-11-25T19:29:37.585ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0b6bc18d-d78b-4cf7-a684-c6255a25f2ed") failed: Property not found. retry in 1.119300322s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0b6bc18d-d78b-4cf7-a684-c6255a25f2ed
10542024-11-25T19:29:37.857ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5ead9ee2-e8b0-4593-9027-48635affc5e2") failed: Property not found. retry in 1.436840632s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5ead9ee2-e8b0-4593-9027-48635affc5e2
10552024-11-25T19:29:37.867ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2f59c006-0a7d-42ea-a0d5-5b48cf7cd990") failed: Property not found. retry in 1.06851223s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2f59c006-0a7d-42ea-a0d5-5b48cf7cd990
10562024-11-25T19:29:37.950ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7e8f0bb3-d78c-423c-95e4-008fd1e3aabc") failed: Property not found. retry in 1.053728439s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7e8f0bb3-d78c-423c-95e4-008fd1e3aabc
10572024-11-25T19:29:38.105ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e75f2650-a245-42d3-9d24-2a4c8145f522") failed: Property not found. retry in 837.896623ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e75f2650-a245-42d3-9d24-2a4c8145f522
10582024-11-25T19:29:38.713ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0b6bc18d-d78b-4cf7-a684-c6255a25f2ed") failed: Property not found. retry in 1.2785117s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0b6bc18d-d78b-4cf7-a684-c6255a25f2ed
10592024-11-25T19:29:38.941ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2f59c006-0a7d-42ea-a0d5-5b48cf7cd990") failed: Property not found. retry in 1.458549408s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2f59c006-0a7d-42ea-a0d5-5b48cf7cd990
10602024-11-25T19:29:38.949ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e75f2650-a245-42d3-9d24-2a4c8145f522") failed: Property not found. retry in 673.013619ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e75f2650-a245-42d3-9d24-2a4c8145f522
10612024-11-25T19:29:39.009ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7e8f0bb3-d78c-423c-95e4-008fd1e3aabc") failed: Property not found. retry in 1.434126279s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7e8f0bb3-d78c-423c-95e4-008fd1e3aabc
10622024-11-25T19:29:39.300ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5ead9ee2-e8b0-4593-9027-48635affc5e2") failed: Property not found. retry in 502.482228ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5ead9ee2-e8b0-4593-9027-48635affc5e2
10632024-11-25T19:29:39.630ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e75f2650-a245-42d3-9d24-2a4c8145f522") failed: Property not found. retry in 813.781143ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e75f2650-a245-42d3-9d24-2a4c8145f522
10642024-11-25T19:29:39.811ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5ead9ee2-e8b0-4593-9027-48635affc5e2") failed: Property not found. retry in 1.380349416s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5ead9ee2-e8b0-4593-9027-48635affc5e2
10652024-11-25T19:29:40.002ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0b6bc18d-d78b-4cf7-a684-c6255a25f2ed") failed: Property not found. retry in 682.488178ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0b6bc18d-d78b-4cf7-a684-c6255a25f2ed
10662024-11-25T19:29:40.409ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2f59c006-0a7d-42ea-a0d5-5b48cf7cd990") failed: Property not found. retry in 605.597316ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2f59c006-0a7d-42ea-a0d5-5b48cf7cd990
10672024-11-25T19:29:40.452ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7e8f0bb3-d78c-423c-95e4-008fd1e3aabc") failed: Property not found. retry in 580.020931ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7e8f0bb3-d78c-423c-95e4-008fd1e3aabc
10682024-11-25T19:29:40.462ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e75f2650-a245-42d3-9d24-2a4c8145f522") failed: Property not found. retry in 1.271130933s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e75f2650-a245-42d3-9d24-2a4c8145f522
10692024-11-25T19:29:40.693ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0b6bc18d-d78b-4cf7-a684-c6255a25f2ed") failed: Property not found. retry in 1.326156175s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0b6bc18d-d78b-4cf7-a684-c6255a25f2ed
10702024-11-25T19:29:41.023ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2f59c006-0a7d-42ea-a0d5-5b48cf7cd990") failed: Property not found. retry in 969.046439ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2f59c006-0a7d-42ea-a0d5-5b48cf7cd990
10712024-11-25T19:29:41.040ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7e8f0bb3-d78c-423c-95e4-008fd1e3aabc") failed: Property not found. retry in 1.352024526s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7e8f0bb3-d78c-423c-95e4-008fd1e3aabc
10722024-11-25T19:29:41.195ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5ead9ee2-e8b0-4593-9027-48635affc5e2") failed: Property not found. retry in 845.907627ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5ead9ee2-e8b0-4593-9027-48635affc5e2
10732024-11-25T19:29:41.739ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e75f2650-a245-42d3-9d24-2a4c8145f522") failed: Property not found. retry in 654.352487ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e75f2650-a245-42d3-9d24-2a4c8145f522
10742024-11-25T19:29:41.998ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2f59c006-0a7d-42ea-a0d5-5b48cf7cd990") failed: Property not found. retry in 755.911901ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2f59c006-0a7d-42ea-a0d5-5b48cf7cd990
10752024-11-25T19:29:42.024ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0b6bc18d-d78b-4cf7-a684-c6255a25f2ed") failed: Property not found. retry in 1.174009948s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0b6bc18d-d78b-4cf7-a684-c6255a25f2ed
10762024-11-25T19:29:42.047ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5ead9ee2-e8b0-4593-9027-48635affc5e2") failed: Property not found. retry in 641.296217ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5ead9ee2-e8b0-4593-9027-48635affc5e2
10772024-11-25T19:29:42.401ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7e8f0bb3-d78c-423c-95e4-008fd1e3aabc") failed: Property not found. retry in 848.483859ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7e8f0bb3-d78c-423c-95e4-008fd1e3aabc
10782024-11-25T19:29:42.409ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e75f2650-a245-42d3-9d24-2a4c8145f522") failed: Property not found. retry in 1.347998752s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e75f2650-a245-42d3-9d24-2a4c8145f522
10792024-11-25T19:29:42.696ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5ead9ee2-e8b0-4593-9027-48635affc5e2") failed: Property not found. retry in 943.97499ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5ead9ee2-e8b0-4593-9027-48635affc5e2
10802024-11-25T19:29:42.760ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2f59c006-0a7d-42ea-a0d5-5b48cf7cd990") failed: Property not found. retry in 1.027337758s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2f59c006-0a7d-42ea-a0d5-5b48cf7cd990
10812024-11-25T19:29:43.205ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0b6bc18d-d78b-4cf7-a684-c6255a25f2ed") failed: Property not found. retry in 710.665275ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0b6bc18d-d78b-4cf7-a684-c6255a25f2ed
10822024-11-25T19:29:43.257ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7e8f0bb3-d78c-423c-95e4-008fd1e3aabc") failed: Property not found. retry in 949.081889ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7e8f0bb3-d78c-423c-95e4-008fd1e3aabc
10832024-11-25T19:29:44.228ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_cockroachdb_2f59c006-0a7d-42ea-a0d5-5b48cf7cd990
10842024-11-25T19:29:44.228ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_cockroachdb_7e8f0bb3-d78c-423c-95e4-008fd1e3aabc
10852024-11-25T19:29:44.228ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_cockroachdb_e75f2650-a245-42d3-9d24-2a4c8145f522
10862024-11-25T19:29:44.228ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_cockroachdb_5ead9ee2-e8b0-4593-9027-48635affc5e2
10872024-11-25T19:29:44.228ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_cockroachdb_0b6bc18d-d78b-4cf7-a684-c6255a25f2ed
10882024-11-25T19:29:44.228ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/dd272387-9bb6-475e-8ebb-47dcac6d1d2a/config/.omicron-zones.json.tmp file = common/src/ledger.rs:200
10892024-11-25T19:29:44.228ZINFOSledAgent (ServiceManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/dd272387-9bb6-475e-8ebb-47dcac6d1d2a/config/omicron-zones.json"
10902024-11-25T19:29:44.228ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/a4bf8354-b44e-436c-b4f2-9bd494b77342/config/.omicron-zones.json.tmp file = common/src/ledger.rs:200
10912024-11-25T19:29:44.229ZINFOSledAgent (ServiceManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/a4bf8354-b44e-436c-b4f2-9bd494b77342/config/omicron-zones.json"
10922024-11-25T19:29:44.229ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 12255740 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:37743 req_id = feecfc8f-b036-45b5-b7dc-9251effa29c3 response_code = 204 uri = /omicron-zones
10932024-11-25T19:29:44.264ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48712
10942024-11-25T19:29:44.296ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService9/omicron6 in oxz_cockroachdb_0b6bc18d-d78b-4cf7-a684-c6255a25f2ed: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_0b6bc18d-d78b-4cf7-a684-c6255a25f2ed /usr/sbin/ipadm show-addr -p -o ADDR oxControlService9/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 31337 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:48712 req_id = 298ff127-5bcd-4d81-95b7-ceb9c278499a response_code = 500 uri = /cockroachdb
10952024-11-25T19:29:44.296ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "298ff127-5bcd-4d81-95b7-ceb9c278499a", "content-length": "124", "date": "Mon, 25 Nov 2024 19:29:44 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "298ff127-5bcd-4d81-95b7-ceb9c278499a" } file = sled-agent/src/rack_setup/service.rs:1154 retry_after = 84.815218ms
10962024-11-25T19:29:44.410ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService9/omicron6 in oxz_cockroachdb_0b6bc18d-d78b-4cf7-a684-c6255a25f2ed: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_0b6bc18d-d78b-4cf7-a684-c6255a25f2ed /usr/sbin/ipadm show-addr -p -o ADDR oxControlService9/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 27414 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:48712 req_id = b4873db2-e8c4-40a2-a0ad-c05be2d96759 response_code = 500 uri = /cockroachdb
10972024-11-25T19:29:44.410ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "b4873db2-e8c4-40a2-a0ad-c05be2d96759", "content-length": "124", "date": "Mon, 25 Nov 2024 19:29:44 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "b4873db2-e8c4-40a2-a0ad-c05be2d96759" } file = sled-agent/src/rack_setup/service.rs:1154 retry_after = 153.48117ms
10982024-11-25T19:29:44.591ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService9/omicron6 in oxz_cockroachdb_0b6bc18d-d78b-4cf7-a684-c6255a25f2ed: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_0b6bc18d-d78b-4cf7-a684-c6255a25f2ed /usr/sbin/ipadm show-addr -p -o ADDR oxControlService9/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 27262 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:48712 req_id = 8beb8ce6-0c4f-4815-a7e7-de802afa4d02 response_code = 500 uri = /cockroachdb
10992024-11-25T19:29:44.591ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "8beb8ce6-0c4f-4815-a7e7-de802afa4d02", "content-length": "124", "date": "Mon, 25 Nov 2024 19:29:44 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "8beb8ce6-0c4f-4815-a7e7-de802afa4d02" } file = sled-agent/src/rack_setup/service.rs:1154 retry_after = 194.30162ms
11002024-11-25T19:29:44.815ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::6]:32221 file = sled-agent/src/services.rs:3797
11012024-11-25T19:30:08.112ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3815
11022024-11-25T19:30:20.656ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3838
11032024-11-25T19:30:20.658ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35886276 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:48712 req_id = 2e84b397-399b-42cc-8768-9d70ec887736 response_code = 204 uri = /cockroachdb
11042024-11-25T19:30:20.661ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:64529
11052024-11-25T19:30:20.662ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 533 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:64529 req_id = 0fca5e89-44a3-4a99-978f-155a8200f939 response_code = 200 uri = /baseboard
11062024-11-25T19:30:20.677ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 5.790398564s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
11072024-11-25T19:30:20.717ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: 64a08338-1eb5-49da-827e-ddea69a7943c (service), filesystem_pool: Some(ZpoolName { id: 71fa9360-75cf-491a-b7ef-fd270ae2f32c (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 71fa9360-75cf-491a-b7ef-fd270ae2f32c (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: c588016e-a348-47f5-b498-43234ef44320 (service), filesystem_pool: Some(ZpoolName { id: cc26c009-a951-4771-a26a-f2513b9e63e2 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: cc26c009-a951-4771-a26a-f2513b9e63e2 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: dd4b9bd7-7dc8-4c50-b7a6-ad30d3af9195 (service), filesystem_pool: Some(ZpoolName { id: 56aea45f-c451-4174-9b8f-66145c2696e8 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 56aea45f-c451-4174-9b8f-66145c2696e8 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 50534bbc-e79b-4382-9f0d-65daaa00ec78 (service), filesystem_pool: Some(ZpoolName { id: ca727341-d003-494b-b98d-9fa5b5aeeec8 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 9187eec3-ac34-4efc-9cac-ca1119452c7e, kind: Service { id: 50534bbc-e79b-4382-9f0d-65daaa00ec78 }, name: Name("ntp-50534bbc-e79b-4382-9f0d-65daaa00ec78"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 136, 178])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: e75f2650-a245-42d3-9d24-2a4c8145f522 (service), filesystem_pool: Some(ZpoolName { id: 71fa9360-75cf-491a-b7ef-fd270ae2f32c (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 71fa9360-75cf-491a-b7ef-fd270ae2f32c (zpool), kind: External } } } }, OmicronZoneConfig { id: 2f59c006-0a7d-42ea-a0d5-5b48cf7cd990 (service), filesystem_pool: Some(ZpoolName { id: cc26c009-a951-4771-a26a-f2513b9e63e2 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: cc26c009-a951-4771-a26a-f2513b9e63e2 (zpool), kind: External } } } }, OmicronZoneConfig { id: 7e8f0bb3-d78c-423c-95e4-008fd1e3aabc (service), filesystem_pool: Some(ZpoolName { id: 56aea45f-c451-4174-9b8f-66145c2696e8 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 56aea45f-c451-4174-9b8f-66145c2696e8 (zpool), kind: External } } } }, OmicronZoneConfig { id: 0b6bc18d-d78b-4cf7-a684-c6255a25f2ed (service), filesystem_pool: Some(ZpoolName { id: d7af1128-7206-4198-91cb-ef632ea8556e (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d7af1128-7206-4198-91cb-ef632ea8556e (zpool), kind: External } } } }, OmicronZoneConfig { id: 5ead9ee2-e8b0-4593-9027-48635affc5e2 (service), filesystem_pool: Some(ZpoolName { id: fe712103-328f-4ff5-a621-99ae42de7f00 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fe712103-328f-4ff5-a621-99ae42de7f00 (zpool), kind: External } } } }, OmicronZoneConfig { id: 6b3cbeea-c72e-481d-a7a1-e27c601ccb03 (service), filesystem_pool: Some(ZpoolName { id: 71fa9360-75cf-491a-b7ef-fd270ae2f32c (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 71fa9360-75cf-491a-b7ef-fd270ae2f32c (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.1.164:53, nic: NetworkInterface { id: f04f2a94-1775-401c-8f4b-f933311d21a8, kind: Service { id: 6b3cbeea-c72e-481d-a7a1-e27c601ccb03 }, name: Name("external-dns-6b3cbeea-c72e-481d-a7a1-e27c601ccb03"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 175, 189])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 5e357e48-2959-4886-8b9d-557b95c45fb7 (service), filesystem_pool: Some(ZpoolName { id: cc26c009-a951-4771-a26a-f2513b9e63e2 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: cc26c009-a951-4771-a26a-f2513b9e63e2 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.1.165:53, nic: NetworkInterface { id: d231a61b-6b3d-4ea9-b8ff-35ab162113d2, kind: Service { id: 5e357e48-2959-4886-8b9d-557b95c45fb7 }, name: Name("external-dns-5e357e48-2959-4886-8b9d-557b95c45fb7"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 225, 146])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67 (service), filesystem_pool: Some(ZpoolName { id: 71fa9360-75cf-491a-b7ef-fd270ae2f32c (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.1.166, nic: NetworkInterface { id: 7c489787-90c9-4b93-99c1-8a1f226c1096, kind: Service { id: a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67 }, name: Name("nexus-a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 161, 21])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 1d808376-6b5a-46f0-b373-d7ba578556eb (service), filesystem_pool: Some(ZpoolName { id: ca727341-d003-494b-b98d-9fa5b5aeeec8 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.1.167, nic: NetworkInterface { id: 5304be8f-eb23-4485-b885-5b368db0b5b6, kind: Service { id: 1d808376-6b5a-46f0-b373-d7ba578556eb }, name: Name("nexus-1d808376-6b5a-46f0-b373-d7ba578556eb"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 88])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037 (service), filesystem_pool: Some(ZpoolName { id: 1b4c5120-bb11-444d-9c86-edb04be1264c (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.1.168, nic: NetworkInterface { id: d755e6b0-59ef-4a09-9894-b39bfb858111, kind: Service { id: 29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037 }, name: Name("nexus-29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 3])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 4f833d1f-8a98-4545-91ff-69d713fdd1f0 (service), filesystem_pool: Some(ZpoolName { id: 71fa9360-75cf-491a-b7ef-fd270ae2f32c (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: 21786b6f-d071-4762-9de6-138ef833b3de (service), filesystem_pool: Some(ZpoolName { id: 71fa9360-75cf-491a-b7ef-fd270ae2f32c (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 71fa9360-75cf-491a-b7ef-fd270ae2f32c (zpool), kind: External } } } }, OmicronZoneConfig { id: 9bea4b41-0e61-416b-9a60-0c3dff58b905 (service), filesystem_pool: Some(ZpoolName { id: d7af1128-7206-4198-91cb-ef632ea8556e (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: 234660ab-07d6-46bf-8748-19a6e4eb0d61 (service), filesystem_pool: Some(ZpoolName { id: cc26c009-a951-4771-a26a-f2513b9e63e2 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: 0a80d709-bf2b-457a-9df6-b7c61cf35e54 (service), filesystem_pool: Some(ZpoolName { id: 2517e8b2-3022-4575-a6ad-4786cce7adb4 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: 7c96e2c2-1643-4666-b1e3-92a7f608b3f8 (service), filesystem_pool: Some(ZpoolName { id: 71fa9360-75cf-491a-b7ef-fd270ae2f32c (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 71fa9360-75cf-491a-b7ef-fd270ae2f32c (zpool), kind: External } } } }, OmicronZoneConfig { id: 7db61d8a-2b76-4a38-9be0-42b379308323 (service), filesystem_pool: Some(ZpoolName { id: cc26c009-a951-4771-a26a-f2513b9e63e2 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: cc26c009-a951-4771-a26a-f2513b9e63e2 (zpool), kind: External } } } }, OmicronZoneConfig { id: d6f634f5-3528-4e41-966f-f47648523f6a (service), filesystem_pool: Some(ZpoolName { id: 56aea45f-c451-4174-9b8f-66145c2696e8 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 56aea45f-c451-4174-9b8f-66145c2696e8 (zpool), kind: External } } } }, OmicronZoneConfig { id: 863e78e3-a753-4fb2-97de-c46023f03292 (service), filesystem_pool: Some(ZpoolName { id: d7af1128-7206-4198-91cb-ef632ea8556e (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d7af1128-7206-4198-91cb-ef632ea8556e (zpool), kind: External } } } }, OmicronZoneConfig { id: 1287099d-2056-4e10-99e5-632481da2c2b (service), filesystem_pool: Some(ZpoolName { id: fe712103-328f-4ff5-a621-99ae42de7f00 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fe712103-328f-4ff5-a621-99ae42de7f00 (zpool), kind: External } } } }, OmicronZoneConfig { id: 42cf72f4-fa5d-45b0-b91f-af1c2e33690d (service), filesystem_pool: Some(ZpoolName { id: ca727341-d003-494b-b98d-9fa5b5aeeec8 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ca727341-d003-494b-b98d-9fa5b5aeeec8 (zpool), kind: External } } } }, OmicronZoneConfig { id: 3a33ba47-8706-4469-959c-acd4a6a8404e (service), filesystem_pool: Some(ZpoolName { id: 1b4c5120-bb11-444d-9c86-edb04be1264c (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1b4c5120-bb11-444d-9c86-edb04be1264c (zpool), kind: External } } } }, OmicronZoneConfig { id: fa3bd66a-1a51-4937-9188-36e5fc334f7c (service), filesystem_pool: Some(ZpoolName { id: df57d550-ef00-4438-9a9e-b1b08bdaa525 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: df57d550-ef00-4438-9a9e-b1b08bdaa525 (zpool), kind: External } } } }, OmicronZoneConfig { id: 34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3 (service), filesystem_pool: Some(ZpoolName { id: 2517e8b2-3022-4575-a6ad-4786cce7adb4 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2517e8b2-3022-4575-a6ad-4786cce7adb4 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:538 sled_address = [fd00:1122:3344:101::1]:12345
11082024-11-25T19:30:20.718ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:49163
11092024-11-25T19:30:20.721ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11102024-11-25T19:30:20.721ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/dd272387-9bb6-475e-8ebb-47dcac6d1d2a/config/omicron-zones.json file = common/src/ledger.rs:178
11112024-11-25T19:30:20.721ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/a4bf8354-b44e-436c-b4f2-9bd494b77342/config/omicron-zones.json file = common/src/ledger.rs:178
11122024-11-25T19:30:20.721ZINFOSledAgent (StorageManager): Received DatasetsConfigList { tx: ... } file = sled-storage/src/manager.rs:603
11132024-11-25T19:30:20.722ZINFOSledAgent (StorageManager): Reading ledger from /pool/int/dd272387-9bb6-475e-8ebb-47dcac6d1d2a/config/omicron-datasets.json file = common/src/ledger.rs:178 request = datasets_config_list
11142024-11-25T19:30:20.722ZINFOSledAgent (StorageManager): Reading ledger from /pool/int/a4bf8354-b44e-436c-b4f2-9bd494b77342/config/omicron-datasets.json file = common/src/ledger.rs:178 request = datasets_config_list
11152024-11-25T19:30:20.723ZINFOSledAgent (StorageManager): Found ledger on internal storage file = sled-storage/src/manager.rs:992 request = datasets_config_list
11162024-11-25T19:30:20.724ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11172024-11-25T19:30:20.951ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11182024-11-25T19:30:20.952ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11192024-11-25T19:30:20.952ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11202024-11-25T19:30:20.952ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11212024-11-25T19:30:20.952ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11222024-11-25T19:30:20.952ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11232024-11-25T19:30:20.952ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11242024-11-25T19:30:20.952ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11252024-11-25T19:30:20.954ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11262024-11-25T19:30:20.955ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11272024-11-25T19:30:21.142ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11282024-11-25T19:30:21.142ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11292024-11-25T19:30:21.142ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11302024-11-25T19:30:21.142ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11312024-11-25T19:30:21.144ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11322024-11-25T19:30:21.145ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11332024-11-25T19:30:21.190ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11342024-11-25T19:30:21.190ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11352024-11-25T19:30:21.190ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11362024-11-25T19:30:21.190ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_7c96e2c2-1643-4666-b1e3-92a7f608b3f8 file = illumos-utils/src/zone.rs:325
11372024-11-25T19:30:21.196ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_863e78e3-a753-4fb2-97de-c46023f03292 file = illumos-utils/src/zone.rs:325
11382024-11-25T19:30:21.202ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_fa3bd66a-1a51-4937-9188-36e5fc334f7c file = illumos-utils/src/zone.rs:325
11392024-11-25T19:30:21.207ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_7db61d8a-2b76-4a38-9be0-42b379308323 file = illumos-utils/src/zone.rs:325
11402024-11-25T19:30:21.211ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3 file = illumos-utils/src/zone.rs:325
11412024-11-25T19:30:21.216ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_1287099d-2056-4e10-99e5-632481da2c2b file = illumos-utils/src/zone.rs:325
11422024-11-25T19:30:21.221ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_4f833d1f-8a98-4545-91ff-69d713fdd1f0 file = illumos-utils/src/zone.rs:325
11432024-11-25T19:30:21.226ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_9bea4b41-0e61-416b-9a60-0c3dff58b905 file = illumos-utils/src/zone.rs:325
11442024-11-25T19:30:21.348ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_7c96e2c2-1643-4666-b1e3-92a7f608b3f8 file = illumos-utils/src/zone.rs:363
11452024-11-25T19:30:21.352ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_863e78e3-a753-4fb2-97de-c46023f03292 file = illumos-utils/src/zone.rs:363
11462024-11-25T19:30:21.356ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_fa3bd66a-1a51-4937-9188-36e5fc334f7c file = illumos-utils/src/zone.rs:363
11472024-11-25T19:30:21.360ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_7db61d8a-2b76-4a38-9be0-42b379308323 file = illumos-utils/src/zone.rs:363
11482024-11-25T19:30:21.364ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3 file = illumos-utils/src/zone.rs:363
11492024-11-25T19:30:21.369ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_1287099d-2056-4e10-99e5-632481da2c2b file = illumos-utils/src/zone.rs:363
11502024-11-25T19:30:21.374ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_4f833d1f-8a98-4545-91ff-69d713fdd1f0 file = illumos-utils/src/zone.rs:363
11512024-11-25T19:30:21.379ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_9bea4b41-0e61-416b-9a60-0c3dff58b905 file = illumos-utils/src/zone.rs:363
11522024-11-25T19:30:21.385ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_234660ab-07d6-46bf-8748-19a6e4eb0d61 file = illumos-utils/src/zone.rs:325
11532024-11-25T19:30:21.389ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_0a80d709-bf2b-457a-9df6-b7c61cf35e54 file = illumos-utils/src/zone.rs:325
11542024-11-25T19:30:21.394ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_d6f634f5-3528-4e41-966f-f47648523f6a file = illumos-utils/src/zone.rs:325
11552024-11-25T19:30:21.401ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_21786b6f-d071-4762-9de6-138ef833b3de file = illumos-utils/src/zone.rs:325
11562024-11-25T19:30:21.406ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_42cf72f4-fa5d-45b0-b91f-af1c2e33690d file = illumos-utils/src/zone.rs:325
11572024-11-25T19:30:21.412ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_3a33ba47-8706-4469-959c-acd4a6a8404e file = illumos-utils/src/zone.rs:325
11582024-11-25T19:30:21.420ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_234660ab-07d6-46bf-8748-19a6e4eb0d61 file = illumos-utils/src/zone.rs:363
11592024-11-25T19:30:21.427ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_0a80d709-bf2b-457a-9df6-b7c61cf35e54 file = illumos-utils/src/zone.rs:363
11602024-11-25T19:30:21.435ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_d6f634f5-3528-4e41-966f-f47648523f6a file = illumos-utils/src/zone.rs:363
11612024-11-25T19:30:21.443ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_21786b6f-d071-4762-9de6-138ef833b3de file = illumos-utils/src/zone.rs:363
11622024-11-25T19:30:21.451ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_42cf72f4-fa5d-45b0-b91f-af1c2e33690d file = illumos-utils/src/zone.rs:363
11632024-11-25T19:30:21.457ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_3a33ba47-8706-4469-959c-acd4a6a8404e file = illumos-utils/src/zone.rs:363
11642024-11-25T19:30:21.527ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11652024-11-25T19:30:21.616ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11662024-11-25T19:30:21.695ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11672024-11-25T19:30:21.757ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11682024-11-25T19:30:21.814ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11692024-11-25T19:30:21.816ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11702024-11-25T19:30:21.816ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11712024-11-25T19:30:21.880ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 175, 189]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
11722024-11-25T19:30:21.880ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1271 zone_type = external_dns
11732024-11-25T19:30:21.882ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11742024-11-25T19:30:21.882ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11752024-11-25T19:30:21.939ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 225, 146]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
11762024-11-25T19:30:21.939ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1271 zone_type = external_dns
11772024-11-25T19:30:21.941ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11782024-11-25T19:30:21.941ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11792024-11-25T19:30:21.998ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 233, 3]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11802024-11-25T19:30:21.998ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1271 zone_type = nexus
11812024-11-25T19:30:22.003ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11822024-11-25T19:30:22.003ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11832024-11-25T19:30:22.059ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 161, 21]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11842024-11-25T19:30:22.059ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1271 zone_type = nexus
11852024-11-25T19:30:22.061ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11862024-11-25T19:30:22.061ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11872024-11-25T19:30:22.118ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 147, 88]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11882024-11-25T19:30:22.118ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1271 zone_type = nexus
11892024-11-25T19:30:22.118ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:83
11902024-11-25T19:30:22.118ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:90
11912024-11-25T19:30:22.118ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:83
11922024-11-25T19:30:22.118ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:90
11932024-11-25T19:30:22.118ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:83
11942024-11-25T19:30:22.118ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:90
11952024-11-25T19:30:22.129ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:118
11962024-11-25T19:30:22.131ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11972024-11-25T19:30:22.208ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:83
11982024-11-25T19:30:22.208ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:90
11992024-11-25T19:30:22.209ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:83
12002024-11-25T19:30:22.209ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:90
12012024-11-25T19:30:22.209ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:118
12022024-11-25T19:30:22.214ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:118
12032024-11-25T19:30:22.217ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:118
12042024-11-25T19:30:22.217ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12052024-11-25T19:30:22.217ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12062024-11-25T19:30:22.221ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:118
12072024-11-25T19:30:22.224ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12082024-11-25T19:30:22.224ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12092024-11-25T19:30:22.326ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_5e357e48-2959-4886-8b9d-557b95c45fb7 file = illumos-utils/src/zone.rs:325
12102024-11-25T19:30:22.421ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_6b3cbeea-c72e-481d-a7a1-e27c601ccb03 file = illumos-utils/src/zone.rs:325
12112024-11-25T19:30:22.431ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037 file = illumos-utils/src/zone.rs:325
12122024-11-25T19:30:22.439ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_5e357e48-2959-4886-8b9d-557b95c45fb7 file = illumos-utils/src/zone.rs:363
12132024-11-25T19:30:22.450ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67 file = illumos-utils/src/zone.rs:325
12142024-11-25T19:30:22.458ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_1d808376-6b5a-46f0-b373-d7ba578556eb file = illumos-utils/src/zone.rs:325
12152024-11-25T19:30:22.468ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_6b3cbeea-c72e-481d-a7a1-e27c601ccb03 file = illumos-utils/src/zone.rs:363
12162024-11-25T19:30:22.475ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037 file = illumos-utils/src/zone.rs:363
12172024-11-25T19:30:22.490ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67 file = illumos-utils/src/zone.rs:363
12182024-11-25T19:30:22.499ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_1d808376-6b5a-46f0-b373-d7ba578556eb file = illumos-utils/src/zone.rs:363
12192024-11-25T19:30:28.815ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_9bea4b41-0e61-416b-9a60-0c3dff58b905: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12202024-11-25T19:30:28.860ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_0a80d709-bf2b-457a-9df6-b7c61cf35e54: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12212024-11-25T19:30:29.028ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_9bea4b41-0e61-416b-9a60-0c3dff58b905 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_9bea4b41-0e61-416b-9a60-0c3dff58b905
12222024-11-25T19:30:29.044ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_0a80d709-bf2b-457a-9df6-b7c61cf35e54 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_0a80d709-bf2b-457a-9df6-b7c61cf35e54
12232024-11-25T19:30:30.038ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_fa3bd66a-1a51-4937-9188-36e5fc334f7c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_df57d550-ef00-4438-9a9e-b1b08bdaa525/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='39ced12c-43e7-4998-94d6-c33d6d286dc1'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12242024-11-25T19:30:30.038ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_2517e8b2-3022-4575-a6ad-4786cce7adb4/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='afb87b96-86ca-4dfd-a4cf-016224069155'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12252024-11-25T19:30:30.038ZINFOSledAgent (ServiceManager): Booting oxz_crucible_fa3bd66a-1a51-4937-9188-36e5fc334f7c zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_fa3bd66a-1a51-4937-9188-36e5fc334f7c
12262024-11-25T19:30:30.041ZINFOSledAgent (ServiceManager): Booting oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3
12272024-11-25T19:30:30.047ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_1287099d-2056-4e10-99e5-632481da2c2b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_fe712103-328f-4ff5-a621-99ae42de7f00/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='0ddcdfa6-d364-47ad-ab25-51392df3eb31'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12282024-11-25T19:30:30.048ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_d6f634f5-3528-4e41-966f-f47648523f6a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_56aea45f-c451-4174-9b8f-66145c2696e8/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='c21cde3a-83b6-4a88-b03b-bad14917f78a'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12292024-11-25T19:30:30.048ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_42cf72f4-fa5d-45b0-b91f-af1c2e33690d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_ca727341-d003-494b-b98d-9fa5b5aeeec8/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='13a6f5ce-f905-4292-bc52-0c9daf9fda1d'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12302024-11-25T19:30:30.048ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_3a33ba47-8706-4469-959c-acd4a6a8404e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_1b4c5120-bb11-444d-9c86-edb04be1264c/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='3b306b2e-a1e3-4d6c-93a0-245c3e5e9acc'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12312024-11-25T19:30:30.048ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_863e78e3-a753-4fb2-97de-c46023f03292: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_d7af1128-7206-4198-91cb-ef632ea8556e/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='b35bb00e-a503-4698-a631-d23e9761f762'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12322024-11-25T19:30:30.051ZINFOSledAgent (ServiceManager): Booting oxz_crucible_1287099d-2056-4e10-99e5-632481da2c2b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_1287099d-2056-4e10-99e5-632481da2c2b
12332024-11-25T19:30:30.057ZINFOSledAgent (ServiceManager): Booting oxz_crucible_d6f634f5-3528-4e41-966f-f47648523f6a zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_d6f634f5-3528-4e41-966f-f47648523f6a
12342024-11-25T19:30:30.063ZINFOSledAgent (ServiceManager): Booting oxz_crucible_42cf72f4-fa5d-45b0-b91f-af1c2e33690d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_42cf72f4-fa5d-45b0-b91f-af1c2e33690d
12352024-11-25T19:30:30.069ZINFOSledAgent (ServiceManager): Booting oxz_crucible_3a33ba47-8706-4469-959c-acd4a6a8404e zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_3a33ba47-8706-4469-959c-acd4a6a8404e
12362024-11-25T19:30:30.075ZINFOSledAgent (ServiceManager): Booting oxz_crucible_863e78e3-a753-4fb2-97de-c46023f03292 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_863e78e3-a753-4fb2-97de-c46023f03292
12372024-11-25T19:30:30.250ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0a80d709-bf2b-457a-9df6-b7c61cf35e54") failed: Property not found. retry in 26.346537ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0a80d709-bf2b-457a-9df6-b7c61cf35e54
12382024-11-25T19:30:30.262ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9bea4b41-0e61-416b-9a60-0c3dff58b905") failed: Property not found. retry in 41.472128ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9bea4b41-0e61-416b-9a60-0c3dff58b905
12392024-11-25T19:30:30.273ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fa3bd66a-1a51-4937-9188-36e5fc334f7c") failed: Property not found. retry in 29.03554ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fa3bd66a-1a51-4937-9188-36e5fc334f7c
12402024-11-25T19:30:30.289ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0a80d709-bf2b-457a-9df6-b7c61cf35e54") failed: Property not found. retry in 139.667806ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0a80d709-bf2b-457a-9df6-b7c61cf35e54
12412024-11-25T19:30:30.299ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3") failed: Property not found. retry in 38.311824ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3
12422024-11-25T19:30:30.309ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6f634f5-3528-4e41-966f-f47648523f6a") failed: Property not found. retry in 43.638889ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6f634f5-3528-4e41-966f-f47648523f6a
12432024-11-25T19:30:30.319ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_863e78e3-a753-4fb2-97de-c46023f03292") failed: Property not found. retry in 57.651739ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_863e78e3-a753-4fb2-97de-c46023f03292
12442024-11-25T19:30:30.330ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fa3bd66a-1a51-4937-9188-36e5fc334f7c") failed: Property not found. retry in 108.840846ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fa3bd66a-1a51-4937-9188-36e5fc334f7c
12452024-11-25T19:30:30.339ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1287099d-2056-4e10-99e5-632481da2c2b") failed: Property not found. retry in 37.647179ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1287099d-2056-4e10-99e5-632481da2c2b
12462024-11-25T19:30:30.349ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9bea4b41-0e61-416b-9a60-0c3dff58b905") failed: Property not found. retry in 71.404476ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9bea4b41-0e61-416b-9a60-0c3dff58b905
12472024-11-25T19:30:30.359ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3") failed: Property not found. retry in 113.39713ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3
12482024-11-25T19:30:30.368ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42cf72f4-fa5d-45b0-b91f-af1c2e33690d") failed: Property not found. retry in 34.308552ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42cf72f4-fa5d-45b0-b91f-af1c2e33690d
12492024-11-25T19:30:30.379ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a33ba47-8706-4469-959c-acd4a6a8404e") failed: Property not found. retry in 70.869594ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a33ba47-8706-4469-959c-acd4a6a8404e
12502024-11-25T19:30:30.389ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_863e78e3-a753-4fb2-97de-c46023f03292") failed: Property not found. retry in 75.990047ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_863e78e3-a753-4fb2-97de-c46023f03292
12512024-11-25T19:30:30.399ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1287099d-2056-4e10-99e5-632481da2c2b") failed: Property not found. retry in 99.08082ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1287099d-2056-4e10-99e5-632481da2c2b
12522024-11-25T19:30:30.409ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6f634f5-3528-4e41-966f-f47648523f6a") failed: Property not found. retry in 139.409508ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6f634f5-3528-4e41-966f-f47648523f6a
12532024-11-25T19:30:30.420ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42cf72f4-fa5d-45b0-b91f-af1c2e33690d") failed: Property not found. retry in 60.860028ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42cf72f4-fa5d-45b0-b91f-af1c2e33690d
12542024-11-25T19:30:30.431ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9bea4b41-0e61-416b-9a60-0c3dff58b905") failed: Property not found. retry in 209.452285ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9bea4b41-0e61-416b-9a60-0c3dff58b905
12552024-11-25T19:30:30.442ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0a80d709-bf2b-457a-9df6-b7c61cf35e54") failed: Property not found. retry in 296.228371ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0a80d709-bf2b-457a-9df6-b7c61cf35e54
12562024-11-25T19:30:30.452ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fa3bd66a-1a51-4937-9188-36e5fc334f7c") failed: Property not found. retry in 248.940318ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fa3bd66a-1a51-4937-9188-36e5fc334f7c
12572024-11-25T19:30:30.464ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a33ba47-8706-4469-959c-acd4a6a8404e") failed: Property not found. retry in 132.310827ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a33ba47-8706-4469-959c-acd4a6a8404e
12582024-11-25T19:30:30.478ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_863e78e3-a753-4fb2-97de-c46023f03292") failed: Property not found. retry in 181.797751ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_863e78e3-a753-4fb2-97de-c46023f03292
12592024-11-25T19:30:30.490ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3") failed: Property not found. retry in 121.175893ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3
12602024-11-25T19:30:30.508ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42cf72f4-fa5d-45b0-b91f-af1c2e33690d") failed: Property not found. retry in 281.927616ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42cf72f4-fa5d-45b0-b91f-af1c2e33690d
12612024-11-25T19:30:30.524ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1287099d-2056-4e10-99e5-632481da2c2b") failed: Property not found. retry in 281.769508ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1287099d-2056-4e10-99e5-632481da2c2b
12622024-11-25T19:30:30.570ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6f634f5-3528-4e41-966f-f47648523f6a") failed: Property not found. retry in 266.651857ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6f634f5-3528-4e41-966f-f47648523f6a
12632024-11-25T19:30:30.825ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a33ba47-8706-4469-959c-acd4a6a8404e") failed: Property not found. retry in 170.421841ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a33ba47-8706-4469-959c-acd4a6a8404e
12642024-11-25T19:30:30.842ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_863e78e3-a753-4fb2-97de-c46023f03292") failed: Property not found. retry in 366.761045ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_863e78e3-a753-4fb2-97de-c46023f03292
12652024-11-25T19:30:30.995ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fa3bd66a-1a51-4937-9188-36e5fc334f7c") failed: Property not found. retry in 562.844576ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fa3bd66a-1a51-4937-9188-36e5fc334f7c
12662024-11-25T19:30:31.012ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3") failed: Property not found. retry in 307.367283ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3
12672024-11-25T19:30:31.026ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1287099d-2056-4e10-99e5-632481da2c2b") failed: Property not found. retry in 413.1715ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1287099d-2056-4e10-99e5-632481da2c2b
12682024-11-25T19:30:31.036ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9bea4b41-0e61-416b-9a60-0c3dff58b905") failed: Property not found. retry in 274.412278ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9bea4b41-0e61-416b-9a60-0c3dff58b905
12692024-11-25T19:30:31.048ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0a80d709-bf2b-457a-9df6-b7c61cf35e54") failed: Property not found. retry in 549.062991ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0a80d709-bf2b-457a-9df6-b7c61cf35e54
12702024-11-25T19:30:31.061ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6f634f5-3528-4e41-966f-f47648523f6a") failed: Property not found. retry in 320.577017ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6f634f5-3528-4e41-966f-f47648523f6a
12712024-11-25T19:30:31.073ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42cf72f4-fa5d-45b0-b91f-af1c2e33690d") failed: Property not found. retry in 296.52936ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42cf72f4-fa5d-45b0-b91f-af1c2e33690d
12722024-11-25T19:30:31.084ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a33ba47-8706-4469-959c-acd4a6a8404e") failed: Property not found. retry in 473.24769ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a33ba47-8706-4469-959c-acd4a6a8404e
12732024-11-25T19:30:31.222ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_863e78e3-a753-4fb2-97de-c46023f03292") failed: Property not found. retry in 1.061932708s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_863e78e3-a753-4fb2-97de-c46023f03292
12742024-11-25T19:30:31.325ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9bea4b41-0e61-416b-9a60-0c3dff58b905") failed: Property not found. retry in 757.057012ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9bea4b41-0e61-416b-9a60-0c3dff58b905
12752024-11-25T19:30:31.337ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3") failed: Property not found. retry in 1.059239996s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3
12762024-11-25T19:30:31.383ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42cf72f4-fa5d-45b0-b91f-af1c2e33690d") failed: Property not found. retry in 1.192648603s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42cf72f4-fa5d-45b0-b91f-af1c2e33690d
12772024-11-25T19:30:31.394ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6f634f5-3528-4e41-966f-f47648523f6a") failed: Property not found. retry in 1.081040543s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6f634f5-3528-4e41-966f-f47648523f6a
12782024-11-25T19:30:31.451ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1287099d-2056-4e10-99e5-632481da2c2b") failed: Property not found. retry in 426.874649ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1287099d-2056-4e10-99e5-632481da2c2b
12792024-11-25T19:30:31.570ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a33ba47-8706-4469-959c-acd4a6a8404e") failed: Property not found. retry in 563.978986ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a33ba47-8706-4469-959c-acd4a6a8404e
12802024-11-25T19:30:31.585ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fa3bd66a-1a51-4937-9188-36e5fc334f7c") failed: Property not found. retry in 984.379684ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fa3bd66a-1a51-4937-9188-36e5fc334f7c
12812024-11-25T19:30:31.610ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0a80d709-bf2b-457a-9df6-b7c61cf35e54") failed: Property not found. retry in 849.316912ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0a80d709-bf2b-457a-9df6-b7c61cf35e54
12822024-11-25T19:30:31.893ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1287099d-2056-4e10-99e5-632481da2c2b") failed: Property not found. retry in 1.243724901s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1287099d-2056-4e10-99e5-632481da2c2b
12832024-11-25T19:30:32.095ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9bea4b41-0e61-416b-9a60-0c3dff58b905") failed: Property not found. retry in 745.465548ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9bea4b41-0e61-416b-9a60-0c3dff58b905
12842024-11-25T19:30:32.150ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a33ba47-8706-4469-959c-acd4a6a8404e") failed: Property not found. retry in 1.028987736s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a33ba47-8706-4469-959c-acd4a6a8404e
12852024-11-25T19:30:32.162ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12862024-11-25T19:30:32.162ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_1d808376-6b5a-46f0-b373-d7ba578556eb: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12872024-11-25T19:30:32.162ZINFOSledAgent (ServiceManager): Booting oxz_nexus_29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
12882024-11-25T19:30:32.170ZINFOSledAgent (ServiceManager): Booting oxz_nexus_1d808376-6b5a-46f0-b373-d7ba578556eb zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_1d808376-6b5a-46f0-b373-d7ba578556eb
12892024-11-25T19:30:32.298ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_863e78e3-a753-4fb2-97de-c46023f03292") failed: Property not found. retry in 989.363406ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_863e78e3-a753-4fb2-97de-c46023f03292
12902024-11-25T19:30:32.397ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1d808376-6b5a-46f0-b373-d7ba578556eb") failed: Property not found. retry in 33.16249ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1d808376-6b5a-46f0-b373-d7ba578556eb
12912024-11-25T19:30:32.412ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3") failed: Property not found. retry in 600.24429ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3
12922024-11-25T19:30:32.422ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037") failed: Property not found. retry in 30.040212ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
12932024-11-25T19:30:32.444ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1d808376-6b5a-46f0-b373-d7ba578556eb") failed: Property not found. retry in 115.396176ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1d808376-6b5a-46f0-b373-d7ba578556eb
12942024-11-25T19:30:32.464ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037") failed: Property not found. retry in 134.7879ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
12952024-11-25T19:30:32.475ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0a80d709-bf2b-457a-9df6-b7c61cf35e54") failed: Property not found. retry in 1.363974153s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0a80d709-bf2b-457a-9df6-b7c61cf35e54
12962024-11-25T19:30:32.487ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6f634f5-3528-4e41-966f-f47648523f6a") failed: Property not found. retry in 1.447621119s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6f634f5-3528-4e41-966f-f47648523f6a
12972024-11-25T19:30:32.572ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1d808376-6b5a-46f0-b373-d7ba578556eb") failed: Property not found. retry in 248.638128ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1d808376-6b5a-46f0-b373-d7ba578556eb
12982024-11-25T19:30:32.585ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fa3bd66a-1a51-4937-9188-36e5fc334f7c") failed: Property not found. retry in 1.251587325s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fa3bd66a-1a51-4937-9188-36e5fc334f7c
12992024-11-25T19:30:32.597ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42cf72f4-fa5d-45b0-b91f-af1c2e33690d") failed: Property not found. retry in 1.270309701s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42cf72f4-fa5d-45b0-b91f-af1c2e33690d
13002024-11-25T19:30:32.609ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037") failed: Property not found. retry in 228.388415ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
13012024-11-25T19:30:32.835ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1d808376-6b5a-46f0-b373-d7ba578556eb") failed: Property not found. retry in 449.383758ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1d808376-6b5a-46f0-b373-d7ba578556eb
13022024-11-25T19:30:32.852ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037") failed: Property not found. retry in 391.549111ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
13032024-11-25T19:30:32.863ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9bea4b41-0e61-416b-9a60-0c3dff58b905") failed: Property not found. retry in 1.365813987s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9bea4b41-0e61-416b-9a60-0c3dff58b905
13042024-11-25T19:30:33.027ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3") failed: Property not found. retry in 538.979372ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3
13052024-11-25T19:30:33.151ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1287099d-2056-4e10-99e5-632481da2c2b") failed: Property not found. retry in 1.480233527s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1287099d-2056-4e10-99e5-632481da2c2b
13062024-11-25T19:30:33.197ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a33ba47-8706-4469-959c-acd4a6a8404e") failed: Property not found. retry in 769.258483ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a33ba47-8706-4469-959c-acd4a6a8404e
13072024-11-25T19:30:33.257ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037") failed: Property not found. retry in 936.343128ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
13082024-11-25T19:30:33.298ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1d808376-6b5a-46f0-b373-d7ba578556eb") failed: Property not found. retry in 855.63417ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1d808376-6b5a-46f0-b373-d7ba578556eb
13092024-11-25T19:30:33.309ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_863e78e3-a753-4fb2-97de-c46023f03292") failed: Property not found. retry in 1.164124411s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_863e78e3-a753-4fb2-97de-c46023f03292
13102024-11-25T19:30:33.580ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3") failed: Property not found. retry in 661.262359ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3
13112024-11-25T19:30:33.851ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fa3bd66a-1a51-4937-9188-36e5fc334f7c") failed: Property not found. retry in 753.008601ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fa3bd66a-1a51-4937-9188-36e5fc334f7c
13122024-11-25T19:30:33.862ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0a80d709-bf2b-457a-9df6-b7c61cf35e54") failed: Property not found. retry in 1.303543219s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0a80d709-bf2b-457a-9df6-b7c61cf35e54
13132024-11-25T19:30:33.879ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42cf72f4-fa5d-45b0-b91f-af1c2e33690d") failed: Property not found. retry in 1.339199269s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42cf72f4-fa5d-45b0-b91f-af1c2e33690d
13142024-11-25T19:30:33.947ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6f634f5-3528-4e41-966f-f47648523f6a") failed: Property not found. retry in 675.895313ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6f634f5-3528-4e41-966f-f47648523f6a
13152024-11-25T19:30:33.979ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a33ba47-8706-4469-959c-acd4a6a8404e") failed: Property not found. retry in 770.470549ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a33ba47-8706-4469-959c-acd4a6a8404e
13162024-11-25T19:30:34.168ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1d808376-6b5a-46f0-b373-d7ba578556eb") failed: Property not found. retry in 1.453702616s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1d808376-6b5a-46f0-b373-d7ba578556eb
13172024-11-25T19:30:34.202ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037") failed: Property not found. retry in 758.746807ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
13182024-11-25T19:30:34.239ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9bea4b41-0e61-416b-9a60-0c3dff58b905") failed: Property not found. retry in 1.031228484s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9bea4b41-0e61-416b-9a60-0c3dff58b905
13192024-11-25T19:30:34.253ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3") failed: Property not found. retry in 576.374772ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3
13202024-11-25T19:30:34.482ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_863e78e3-a753-4fb2-97de-c46023f03292") failed: Property not found. retry in 1.014018294s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_863e78e3-a753-4fb2-97de-c46023f03292
13212024-11-25T19:30:34.614ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fa3bd66a-1a51-4937-9188-36e5fc334f7c") failed: Property not found. retry in 740.667203ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fa3bd66a-1a51-4937-9188-36e5fc334f7c
13222024-11-25T19:30:34.633ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6f634f5-3528-4e41-966f-f47648523f6a") failed: Property not found. retry in 699.388227ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6f634f5-3528-4e41-966f-f47648523f6a
13232024-11-25T19:30:34.641ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1287099d-2056-4e10-99e5-632481da2c2b") failed: Property not found. retry in 674.685109ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1287099d-2056-4e10-99e5-632481da2c2b
13242024-11-25T19:30:34.758ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a33ba47-8706-4469-959c-acd4a6a8404e") failed: Property not found. retry in 1.398570948s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a33ba47-8706-4469-959c-acd4a6a8404e
13252024-11-25T19:30:34.837ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3") failed: Property not found. retry in 563.711182ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3
13262024-11-25T19:30:34.970ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037") failed: Property not found. retry in 1.100670343s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
13272024-11-25T19:30:35.176ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0a80d709-bf2b-457a-9df6-b7c61cf35e54") failed: Property not found. retry in 805.797214ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0a80d709-bf2b-457a-9df6-b7c61cf35e54
13282024-11-25T19:30:35.228ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42cf72f4-fa5d-45b0-b91f-af1c2e33690d") failed: Property not found. retry in 634.98532ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42cf72f4-fa5d-45b0-b91f-af1c2e33690d
13292024-11-25T19:30:35.279ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9bea4b41-0e61-416b-9a60-0c3dff58b905") failed: Property not found. retry in 1.031921187s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9bea4b41-0e61-416b-9a60-0c3dff58b905
13302024-11-25T19:30:35.325ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1287099d-2056-4e10-99e5-632481da2c2b") failed: Property not found. retry in 883.54285ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1287099d-2056-4e10-99e5-632481da2c2b
13312024-11-25T19:30:35.341ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6f634f5-3528-4e41-966f-f47648523f6a") failed: Property not found. retry in 1.209839681s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6f634f5-3528-4e41-966f-f47648523f6a
13322024-11-25T19:30:35.363ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fa3bd66a-1a51-4937-9188-36e5fc334f7c") failed: Property not found. retry in 1.339940098s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fa3bd66a-1a51-4937-9188-36e5fc334f7c
13332024-11-25T19:30:35.411ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3") failed: Property not found. retry in 534.315801ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3
13342024-11-25T19:30:35.505ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_863e78e3-a753-4fb2-97de-c46023f03292") failed: Property not found. retry in 551.478162ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_863e78e3-a753-4fb2-97de-c46023f03292
13352024-11-25T19:30:35.631ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1d808376-6b5a-46f0-b373-d7ba578556eb") failed: Property not found. retry in 861.946447ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1d808376-6b5a-46f0-b373-d7ba578556eb
13362024-11-25T19:30:35.871ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42cf72f4-fa5d-45b0-b91f-af1c2e33690d") failed: Property not found. retry in 803.529701ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42cf72f4-fa5d-45b0-b91f-af1c2e33690d
13372024-11-25T19:30:35.955ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3") failed: Property not found. retry in 1.051747089s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3
13382024-11-25T19:30:35.990ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0a80d709-bf2b-457a-9df6-b7c61cf35e54") failed: Property not found. retry in 666.429398ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0a80d709-bf2b-457a-9df6-b7c61cf35e54
13392024-11-25T19:30:36.067ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_863e78e3-a753-4fb2-97de-c46023f03292") failed: Property not found. retry in 851.159349ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_863e78e3-a753-4fb2-97de-c46023f03292
13402024-11-25T19:30:36.079ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037") failed: Property not found. retry in 722.142189ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
13412024-11-25T19:30:36.165ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a33ba47-8706-4469-959c-acd4a6a8404e") failed: Property not found. retry in 709.289867ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a33ba47-8706-4469-959c-acd4a6a8404e
13422024-11-25T19:30:36.217ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1287099d-2056-4e10-99e5-632481da2c2b") failed: Property not found. retry in 1.196839564s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1287099d-2056-4e10-99e5-632481da2c2b
13432024-11-25T19:30:36.320ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9bea4b41-0e61-416b-9a60-0c3dff58b905") failed: Property not found. retry in 866.126214ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9bea4b41-0e61-416b-9a60-0c3dff58b905
13442024-11-25T19:30:36.501ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1d808376-6b5a-46f0-b373-d7ba578556eb") failed: Property not found. retry in 1.362027211s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1d808376-6b5a-46f0-b373-d7ba578556eb
13452024-11-25T19:30:36.561ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6f634f5-3528-4e41-966f-f47648523f6a") failed: Property not found. retry in 854.184862ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6f634f5-3528-4e41-966f-f47648523f6a
13462024-11-25T19:30:36.665ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0a80d709-bf2b-457a-9df6-b7c61cf35e54") failed: Property not found. retry in 1.373103188s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0a80d709-bf2b-457a-9df6-b7c61cf35e54
13472024-11-25T19:30:36.685ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42cf72f4-fa5d-45b0-b91f-af1c2e33690d") failed: Property not found. retry in 1.03873801s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42cf72f4-fa5d-45b0-b91f-af1c2e33690d
13482024-11-25T19:30:36.713ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fa3bd66a-1a51-4937-9188-36e5fc334f7c") failed: Property not found. retry in 825.472578ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fa3bd66a-1a51-4937-9188-36e5fc334f7c
13492024-11-25T19:30:36.810ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037") failed: Property not found. retry in 1.009220389s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
13502024-11-25T19:30:36.883ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a33ba47-8706-4469-959c-acd4a6a8404e") failed: Property not found. retry in 806.28582ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a33ba47-8706-4469-959c-acd4a6a8404e
13512024-11-25T19:30:36.927ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_863e78e3-a753-4fb2-97de-c46023f03292") failed: Property not found. retry in 707.323283ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_863e78e3-a753-4fb2-97de-c46023f03292
13522024-11-25T19:30:37.016ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3") failed: Property not found. retry in 616.359428ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3
13532024-11-25T19:30:37.195ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9bea4b41-0e61-416b-9a60-0c3dff58b905") failed: Property not found. retry in 1.11880659s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9bea4b41-0e61-416b-9a60-0c3dff58b905
13542024-11-25T19:30:37.423ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1287099d-2056-4e10-99e5-632481da2c2b") failed: Property not found. retry in 881.640669ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1287099d-2056-4e10-99e5-632481da2c2b
13552024-11-25T19:30:37.430ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6f634f5-3528-4e41-966f-f47648523f6a") failed: Property not found. retry in 963.022184ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6f634f5-3528-4e41-966f-f47648523f6a
13562024-11-25T19:30:37.548ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fa3bd66a-1a51-4937-9188-36e5fc334f7c") failed: Property not found. retry in 849.596541ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fa3bd66a-1a51-4937-9188-36e5fc334f7c
13572024-11-25T19:30:37.641ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3") failed: Property not found. retry in 965.331573ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3
13582024-11-25T19:30:37.648ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_863e78e3-a753-4fb2-97de-c46023f03292") failed: Property not found. retry in 956.573197ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_863e78e3-a753-4fb2-97de-c46023f03292
13592024-11-25T19:30:37.698ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a33ba47-8706-4469-959c-acd4a6a8404e") failed: Property not found. retry in 1.269384587s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a33ba47-8706-4469-959c-acd4a6a8404e
13602024-11-25T19:30:37.732ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42cf72f4-fa5d-45b0-b91f-af1c2e33690d") failed: Property not found. retry in 750.536801ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42cf72f4-fa5d-45b0-b91f-af1c2e33690d
13612024-11-25T19:30:37.828ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037") failed: Property not found. retry in 1.394335473s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
13622024-11-25T19:30:37.872ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1d808376-6b5a-46f0-b373-d7ba578556eb") failed: Property not found. retry in 552.690631ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1d808376-6b5a-46f0-b373-d7ba578556eb
13632024-11-25T19:30:38.048ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0a80d709-bf2b-457a-9df6-b7c61cf35e54") failed: Property not found. retry in 1.229038364s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0a80d709-bf2b-457a-9df6-b7c61cf35e54
13642024-11-25T19:30:38.313ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1287099d-2056-4e10-99e5-632481da2c2b") failed: Property not found. retry in 507.718055ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1287099d-2056-4e10-99e5-632481da2c2b
13652024-11-25T19:30:38.322ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9bea4b41-0e61-416b-9a60-0c3dff58b905") failed: Property not found. retry in 856.877944ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9bea4b41-0e61-416b-9a60-0c3dff58b905
13662024-11-25T19:30:38.403ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6f634f5-3528-4e41-966f-f47648523f6a") failed: Property not found. retry in 1.097527055s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6f634f5-3528-4e41-966f-f47648523f6a
13672024-11-25T19:30:38.411ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fa3bd66a-1a51-4937-9188-36e5fc334f7c") failed: Property not found. retry in 1.104432262s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fa3bd66a-1a51-4937-9188-36e5fc334f7c
13682024-11-25T19:30:38.434ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1d808376-6b5a-46f0-b373-d7ba578556eb") failed: Property not found. retry in 1.460733082s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1d808376-6b5a-46f0-b373-d7ba578556eb
13692024-11-25T19:30:38.492ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42cf72f4-fa5d-45b0-b91f-af1c2e33690d") failed: Property not found. retry in 1.032273607s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42cf72f4-fa5d-45b0-b91f-af1c2e33690d
13702024-11-25T19:30:38.614ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_863e78e3-a753-4fb2-97de-c46023f03292") failed: Property not found. retry in 1.138307467s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_863e78e3-a753-4fb2-97de-c46023f03292
13712024-11-25T19:30:38.622ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3") failed: Property not found. retry in 802.725702ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3
13722024-11-25T19:30:38.829ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1287099d-2056-4e10-99e5-632481da2c2b") failed: Property not found. retry in 1.374435197s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1287099d-2056-4e10-99e5-632481da2c2b
13732024-11-25T19:30:38.977ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a33ba47-8706-4469-959c-acd4a6a8404e") failed: Property not found. retry in 1.263023456s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a33ba47-8706-4469-959c-acd4a6a8404e
13742024-11-25T19:30:39.189ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9bea4b41-0e61-416b-9a60-0c3dff58b905") failed: Property not found. retry in 923.027032ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9bea4b41-0e61-416b-9a60-0c3dff58b905
13752024-11-25T19:30:39.232ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037") failed: Property not found. retry in 829.768336ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
13762024-11-25T19:30:39.286ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0a80d709-bf2b-457a-9df6-b7c61cf35e54") failed: Property not found. retry in 578.911385ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0a80d709-bf2b-457a-9df6-b7c61cf35e54
13772024-11-25T19:30:39.434ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3") failed: Property not found. retry in 1.164688228s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3
13782024-11-25T19:30:39.509ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6f634f5-3528-4e41-966f-f47648523f6a") failed: Property not found. retry in 682.399907ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6f634f5-3528-4e41-966f-f47648523f6a
13792024-11-25T19:30:39.525ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fa3bd66a-1a51-4937-9188-36e5fc334f7c") failed: Property not found. retry in 1.128770618s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fa3bd66a-1a51-4937-9188-36e5fc334f7c
13802024-11-25T19:30:39.533ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42cf72f4-fa5d-45b0-b91f-af1c2e33690d") failed: Property not found. retry in 920.184039ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42cf72f4-fa5d-45b0-b91f-af1c2e33690d
13812024-11-25T19:30:39.760ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_863e78e3-a753-4fb2-97de-c46023f03292") failed: Property not found. retry in 594.526608ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_863e78e3-a753-4fb2-97de-c46023f03292
13822024-11-25T19:30:39.873ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0a80d709-bf2b-457a-9df6-b7c61cf35e54") failed: Property not found. retry in 1.064315639s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0a80d709-bf2b-457a-9df6-b7c61cf35e54
13832024-11-25T19:30:39.903ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1d808376-6b5a-46f0-b373-d7ba578556eb") failed: Property not found. retry in 536.142935ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1d808376-6b5a-46f0-b373-d7ba578556eb
13842024-11-25T19:30:40.070ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037") failed: Property not found. retry in 1.207511212s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
13852024-11-25T19:30:40.121ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9bea4b41-0e61-416b-9a60-0c3dff58b905") failed: Property not found. retry in 898.197607ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9bea4b41-0e61-416b-9a60-0c3dff58b905
13862024-11-25T19:30:40.202ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6f634f5-3528-4e41-966f-f47648523f6a") failed: Property not found. retry in 1.400624209s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6f634f5-3528-4e41-966f-f47648523f6a
13872024-11-25T19:30:40.213ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1287099d-2056-4e10-99e5-632481da2c2b") failed: Property not found. retry in 1.016713235s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1287099d-2056-4e10-99e5-632481da2c2b
13882024-11-25T19:30:40.249ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a33ba47-8706-4469-959c-acd4a6a8404e") failed: Property not found. retry in 801.175362ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a33ba47-8706-4469-959c-acd4a6a8404e
13892024-11-25T19:30:40.364ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_863e78e3-a753-4fb2-97de-c46023f03292") failed: Property not found. retry in 1.130320774s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_863e78e3-a753-4fb2-97de-c46023f03292
13902024-11-25T19:30:40.449ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1d808376-6b5a-46f0-b373-d7ba578556eb") failed: Property not found. retry in 1.190272816s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1d808376-6b5a-46f0-b373-d7ba578556eb
13912024-11-25T19:30:40.462ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42cf72f4-fa5d-45b0-b91f-af1c2e33690d") failed: Property not found. retry in 772.572059ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42cf72f4-fa5d-45b0-b91f-af1c2e33690d
13922024-11-25T19:30:40.607ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3") failed: Property not found. retry in 955.876438ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3
13932024-11-25T19:30:40.663ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fa3bd66a-1a51-4937-9188-36e5fc334f7c") failed: Property not found. retry in 1.446381143s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fa3bd66a-1a51-4937-9188-36e5fc334f7c
13942024-11-25T19:30:40.946ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0a80d709-bf2b-457a-9df6-b7c61cf35e54") failed: Property not found. retry in 1.466352983s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0a80d709-bf2b-457a-9df6-b7c61cf35e54
13952024-11-25T19:30:41.049ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9bea4b41-0e61-416b-9a60-0c3dff58b905") failed: Property not found. retry in 1.089774462s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9bea4b41-0e61-416b-9a60-0c3dff58b905
13962024-11-25T19:30:41.059ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a33ba47-8706-4469-959c-acd4a6a8404e") failed: Property not found. retry in 523.89191ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a33ba47-8706-4469-959c-acd4a6a8404e
13972024-11-25T19:30:41.239ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1287099d-2056-4e10-99e5-632481da2c2b") failed: Property not found. retry in 951.950941ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1287099d-2056-4e10-99e5-632481da2c2b
13982024-11-25T19:30:41.247ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42cf72f4-fa5d-45b0-b91f-af1c2e33690d") failed: Property not found. retry in 1.492410881s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42cf72f4-fa5d-45b0-b91f-af1c2e33690d
13992024-11-25T19:30:41.287ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037") failed: Property not found. retry in 771.862874ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
14002024-11-25T19:30:41.503ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_863e78e3-a753-4fb2-97de-c46023f03292") failed: Property not found. retry in 1.261792433s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_863e78e3-a753-4fb2-97de-c46023f03292
14012024-11-25T19:30:41.572ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3") failed: Property not found. retry in 1.318079823s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3
14022024-11-25T19:30:41.592ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a33ba47-8706-4469-959c-acd4a6a8404e") failed: Property not found. retry in 783.273059ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a33ba47-8706-4469-959c-acd4a6a8404e
14032024-11-25T19:30:41.612ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6f634f5-3528-4e41-966f-f47648523f6a") failed: Property not found. retry in 1.171702151s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6f634f5-3528-4e41-966f-f47648523f6a
14042024-11-25T19:30:41.648ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1d808376-6b5a-46f0-b373-d7ba578556eb") failed: Property not found. retry in 1.050766735s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1d808376-6b5a-46f0-b373-d7ba578556eb
14052024-11-25T19:30:42.070ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037") failed: Property not found. retry in 1.451029668s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
14062024-11-25T19:30:42.119ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fa3bd66a-1a51-4937-9188-36e5fc334f7c") failed: Property not found. retry in 667.412715ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fa3bd66a-1a51-4937-9188-36e5fc334f7c
14072024-11-25T19:30:42.153ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9bea4b41-0e61-416b-9a60-0c3dff58b905") failed: Property not found. retry in 672.237466ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9bea4b41-0e61-416b-9a60-0c3dff58b905
14082024-11-25T19:30:42.588ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1287099d-2056-4e10-99e5-632481da2c2b") failed: Property not found. retry in 1.212767618s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1287099d-2056-4e10-99e5-632481da2c2b
14092024-11-25T19:30:42.653ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0a80d709-bf2b-457a-9df6-b7c61cf35e54") failed: Property not found. retry in 1.488360614s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0a80d709-bf2b-457a-9df6-b7c61cf35e54
14102024-11-25T19:30:42.684ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a33ba47-8706-4469-959c-acd4a6a8404e") failed: Property not found. retry in 1.084783458s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a33ba47-8706-4469-959c-acd4a6a8404e
14112024-11-25T19:30:42.725ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1d808376-6b5a-46f0-b373-d7ba578556eb") failed: Property not found. retry in 951.970563ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1d808376-6b5a-46f0-b373-d7ba578556eb
14122024-11-25T19:30:42.865ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42cf72f4-fa5d-45b0-b91f-af1c2e33690d") failed: Property not found. retry in 1.230194645s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42cf72f4-fa5d-45b0-b91f-af1c2e33690d
14132024-11-25T19:30:42.883ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_863e78e3-a753-4fb2-97de-c46023f03292") failed: Property not found. retry in 918.219769ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_863e78e3-a753-4fb2-97de-c46023f03292
14142024-11-25T19:30:42.896ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fa3bd66a-1a51-4937-9188-36e5fc334f7c") failed: Property not found. retry in 722.159722ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fa3bd66a-1a51-4937-9188-36e5fc334f7c
14152024-11-25T19:30:42.912ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3") failed: Property not found. retry in 862.742105ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3
14162024-11-25T19:30:42.927ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9bea4b41-0e61-416b-9a60-0c3dff58b905") failed: Property not found. retry in 612.137271ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9bea4b41-0e61-416b-9a60-0c3dff58b905
14172024-11-25T19:30:42.943ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6f634f5-3528-4e41-966f-f47648523f6a") failed: Property not found. retry in 521.140328ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6f634f5-3528-4e41-966f-f47648523f6a
14182024-11-25T19:30:43.478ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6f634f5-3528-4e41-966f-f47648523f6a") failed: Property not found. retry in 926.605836ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6f634f5-3528-4e41-966f-f47648523f6a
14192024-11-25T19:30:43.535ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037") failed: Property not found. retry in 972.743578ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
14202024-11-25T19:30:43.552ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9bea4b41-0e61-416b-9a60-0c3dff58b905") failed: Property not found. retry in 1.119001865s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9bea4b41-0e61-416b-9a60-0c3dff58b905
14212024-11-25T19:30:43.631ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fa3bd66a-1a51-4937-9188-36e5fc334f7c") failed: Property not found. retry in 1.305714415s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fa3bd66a-1a51-4937-9188-36e5fc334f7c
14222024-11-25T19:30:43.691ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1d808376-6b5a-46f0-b373-d7ba578556eb") failed: Property not found. retry in 706.43309ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1d808376-6b5a-46f0-b373-d7ba578556eb
14232024-11-25T19:30:43.782ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a33ba47-8706-4469-959c-acd4a6a8404e") failed: Property not found. retry in 662.821002ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a33ba47-8706-4469-959c-acd4a6a8404e
14242024-11-25T19:30:43.795ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3") failed: Property not found. retry in 707.258331ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3
14252024-11-25T19:30:43.808ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1287099d-2056-4e10-99e5-632481da2c2b") failed: Property not found. retry in 756.422628ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1287099d-2056-4e10-99e5-632481da2c2b
14262024-11-25T19:30:43.821ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_863e78e3-a753-4fb2-97de-c46023f03292") failed: Property not found. retry in 1.02033064s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_863e78e3-a753-4fb2-97de-c46023f03292
14272024-11-25T19:30:43.999ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 21.842751769s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
14282024-11-25T19:30:44.109ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42cf72f4-fa5d-45b0-b91f-af1c2e33690d") failed: Property not found. retry in 1.424407943s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42cf72f4-fa5d-45b0-b91f-af1c2e33690d
14292024-11-25T19:30:44.154ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0a80d709-bf2b-457a-9df6-b7c61cf35e54") failed: Property not found. retry in 1.05349047s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0a80d709-bf2b-457a-9df6-b7c61cf35e54
14302024-11-25T19:30:44.408ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1d808376-6b5a-46f0-b373-d7ba578556eb") failed: Property not found. retry in 630.249676ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1d808376-6b5a-46f0-b373-d7ba578556eb
14312024-11-25T19:30:44.416ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6f634f5-3528-4e41-966f-f47648523f6a") failed: Property not found. retry in 872.277649ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6f634f5-3528-4e41-966f-f47648523f6a
14322024-11-25T19:30:44.455ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a33ba47-8706-4469-959c-acd4a6a8404e") failed: Property not found. retry in 1.074300075s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a33ba47-8706-4469-959c-acd4a6a8404e
14332024-11-25T19:30:44.512ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3") failed: Property not found. retry in 985.693099ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3
14342024-11-25T19:30:44.521ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037") failed: Property not found. retry in 724.645514ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
14352024-11-25T19:30:44.574ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1287099d-2056-4e10-99e5-632481da2c2b") failed: Property not found. retry in 1.029360522s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1287099d-2056-4e10-99e5-632481da2c2b
14362024-11-25T19:30:44.682ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9bea4b41-0e61-416b-9a60-0c3dff58b905") failed: Property not found. retry in 625.992157ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9bea4b41-0e61-416b-9a60-0c3dff58b905
14372024-11-25T19:30:44.850ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_863e78e3-a753-4fb2-97de-c46023f03292") failed: Property not found. retry in 1.132859868s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_863e78e3-a753-4fb2-97de-c46023f03292
14382024-11-25T19:30:44.946ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fa3bd66a-1a51-4937-9188-36e5fc334f7c") failed: Property not found. retry in 1.478010263s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fa3bd66a-1a51-4937-9188-36e5fc334f7c
14392024-11-25T19:30:45.047ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1d808376-6b5a-46f0-b373-d7ba578556eb") failed: Property not found. retry in 1.149801079s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1d808376-6b5a-46f0-b373-d7ba578556eb
14402024-11-25T19:30:45.076ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_234660ab-07d6-46bf-8748-19a6e4eb0d61: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14412024-11-25T19:30:45.077ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_234660ab-07d6-46bf-8748-19a6e4eb0d61 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_234660ab-07d6-46bf-8748-19a6e4eb0d61
14422024-11-25T19:30:45.218ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0a80d709-bf2b-457a-9df6-b7c61cf35e54") failed: Property not found. retry in 511.153573ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0a80d709-bf2b-457a-9df6-b7c61cf35e54
14432024-11-25T19:30:45.255ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037") failed: Property not found. retry in 1.415116097s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
14442024-11-25T19:30:45.299ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6f634f5-3528-4e41-966f-f47648523f6a") failed: Property not found. retry in 1.406338781s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6f634f5-3528-4e41-966f-f47648523f6a
14452024-11-25T19:30:45.317ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9bea4b41-0e61-416b-9a60-0c3dff58b905") failed: Property not found. retry in 958.192897ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9bea4b41-0e61-416b-9a60-0c3dff58b905
14462024-11-25T19:30:45.453ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_234660ab-07d6-46bf-8748-19a6e4eb0d61") failed: Property not found. retry in 53.509884ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_234660ab-07d6-46bf-8748-19a6e4eb0d61
14472024-11-25T19:30:45.507ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3") failed: Property not found. retry in 650.679294ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3
14482024-11-25T19:30:45.515ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_234660ab-07d6-46bf-8748-19a6e4eb0d61") failed: Property not found. retry in 50.159363ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_234660ab-07d6-46bf-8748-19a6e4eb0d61
14492024-11-25T19:30:45.539ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a33ba47-8706-4469-959c-acd4a6a8404e") failed: Property not found. retry in 611.21749ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a33ba47-8706-4469-959c-acd4a6a8404e
14502024-11-25T19:30:45.547ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42cf72f4-fa5d-45b0-b91f-af1c2e33690d") failed: Property not found. retry in 718.11182ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42cf72f4-fa5d-45b0-b91f-af1c2e33690d
14512024-11-25T19:30:45.548ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_7db61d8a-2b76-4a38-9be0-42b379308323: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_cc26c009-a951-4771-a26a-f2513b9e63e2/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='4399a6e0-51f8-47f1-b9ae-fae9750d726f'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14522024-11-25T19:30:45.548ZINFOSledAgent (ServiceManager): Booting oxz_crucible_7db61d8a-2b76-4a38-9be0-42b379308323 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_7db61d8a-2b76-4a38-9be0-42b379308323
14532024-11-25T19:30:45.574ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_234660ab-07d6-46bf-8748-19a6e4eb0d61") failed: Property not found. retry in 179.289218ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_234660ab-07d6-46bf-8748-19a6e4eb0d61
14542024-11-25T19:30:45.612ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1287099d-2056-4e10-99e5-632481da2c2b") failed: Property not found. retry in 1.332563132s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1287099d-2056-4e10-99e5-632481da2c2b
14552024-11-25T19:30:45.723ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7db61d8a-2b76-4a38-9be0-42b379308323") failed: Property not found. retry in 30.72138ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7db61d8a-2b76-4a38-9be0-42b379308323
14562024-11-25T19:30:45.738ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0a80d709-bf2b-457a-9df6-b7c61cf35e54") failed: Property not found. retry in 623.168207ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0a80d709-bf2b-457a-9df6-b7c61cf35e54
14572024-11-25T19:30:45.804ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7db61d8a-2b76-4a38-9be0-42b379308323") failed: Property not found. retry in 100.166388ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7db61d8a-2b76-4a38-9be0-42b379308323
14582024-11-25T19:30:45.813ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_234660ab-07d6-46bf-8748-19a6e4eb0d61") failed: Property not found. retry in 542.511512ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_234660ab-07d6-46bf-8748-19a6e4eb0d61
14592024-11-25T19:30:45.914ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7db61d8a-2b76-4a38-9be0-42b379308323") failed: Property not found. retry in 249.604694ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7db61d8a-2b76-4a38-9be0-42b379308323
14602024-11-25T19:30:45.992ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_863e78e3-a753-4fb2-97de-c46023f03292") failed: Property not found. retry in 1.377465364s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_863e78e3-a753-4fb2-97de-c46023f03292
14612024-11-25T19:30:46.048ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_5e357e48-2959-4886-8b9d-557b95c45fb7: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14622024-11-25T19:30:46.048ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_5e357e48-2959-4886-8b9d-557b95c45fb7 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_5e357e48-2959-4886-8b9d-557b95c45fb7
14632024-11-25T19:30:46.161ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a33ba47-8706-4469-959c-acd4a6a8404e") failed: Property not found. retry in 1.070329494s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a33ba47-8706-4469-959c-acd4a6a8404e
14642024-11-25T19:30:46.169ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3") failed: Property not found. retry in 1.498057783s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3
14652024-11-25T19:30:46.177ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7db61d8a-2b76-4a38-9be0-42b379308323") failed: Property not found. retry in 461.566157ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7db61d8a-2b76-4a38-9be0-42b379308323
14662024-11-25T19:30:46.206ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1d808376-6b5a-46f0-b373-d7ba578556eb") failed: Property not found. retry in 1.409671977s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1d808376-6b5a-46f0-b373-d7ba578556eb
14672024-11-25T19:30:46.220ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5e357e48-2959-4886-8b9d-557b95c45fb7") failed: Property not found. retry in 60.194516ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5e357e48-2959-4886-8b9d-557b95c45fb7
14682024-11-25T19:30:46.274ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42cf72f4-fa5d-45b0-b91f-af1c2e33690d") failed: Property not found. retry in 1.214101075s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42cf72f4-fa5d-45b0-b91f-af1c2e33690d
14692024-11-25T19:30:46.285ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9bea4b41-0e61-416b-9a60-0c3dff58b905") failed: Property not found. retry in 708.963228ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9bea4b41-0e61-416b-9a60-0c3dff58b905
14702024-11-25T19:30:46.292ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5e357e48-2959-4886-8b9d-557b95c45fb7") failed: Property not found. retry in 142.625536ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5e357e48-2959-4886-8b9d-557b95c45fb7
14712024-11-25T19:30:46.365ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_234660ab-07d6-46bf-8748-19a6e4eb0d61") failed: Property not found. retry in 880.489444ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_234660ab-07d6-46bf-8748-19a6e4eb0d61
14722024-11-25T19:30:46.373ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0a80d709-bf2b-457a-9df6-b7c61cf35e54") failed: Property not found. retry in 1.171999384s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0a80d709-bf2b-457a-9df6-b7c61cf35e54
14732024-11-25T19:30:46.434ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fa3bd66a-1a51-4937-9188-36e5fc334f7c") failed: Property not found. retry in 1.344324137s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fa3bd66a-1a51-4937-9188-36e5fc334f7c
14742024-11-25T19:30:46.444ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5e357e48-2959-4886-8b9d-557b95c45fb7") failed: Property not found. retry in 123.878356ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5e357e48-2959-4886-8b9d-557b95c45fb7
14752024-11-25T19:30:46.577ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5e357e48-2959-4886-8b9d-557b95c45fb7") failed: Property not found. retry in 568.375076ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5e357e48-2959-4886-8b9d-557b95c45fb7
14762024-11-25T19:30:46.649ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7db61d8a-2b76-4a38-9be0-42b379308323") failed: Property not found. retry in 846.930344ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7db61d8a-2b76-4a38-9be0-42b379308323
14772024-11-25T19:30:46.680ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037") failed: Property not found. retry in 1.135401929s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
14782024-11-25T19:30:46.713ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6f634f5-3528-4e41-966f-f47648523f6a") failed: Property not found. retry in 524.944143ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6f634f5-3528-4e41-966f-f47648523f6a
14792024-11-25T19:30:46.954ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1287099d-2056-4e10-99e5-632481da2c2b") failed: Property not found. retry in 1.274613715s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1287099d-2056-4e10-99e5-632481da2c2b
14802024-11-25T19:30:47.003ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9bea4b41-0e61-416b-9a60-0c3dff58b905") failed: Property not found. retry in 718.36987ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9bea4b41-0e61-416b-9a60-0c3dff58b905
14812024-11-25T19:30:47.154ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5e357e48-2959-4886-8b9d-557b95c45fb7") failed: Property not found. retry in 484.220455ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5e357e48-2959-4886-8b9d-557b95c45fb7
14822024-11-25T19:30:47.240ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a33ba47-8706-4469-959c-acd4a6a8404e") failed: Property not found. retry in 1.46475023s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a33ba47-8706-4469-959c-acd4a6a8404e
14832024-11-25T19:30:47.249ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6f634f5-3528-4e41-966f-f47648523f6a") failed: Property not found. retry in 886.057127ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6f634f5-3528-4e41-966f-f47648523f6a
14842024-11-25T19:30:47.256ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_234660ab-07d6-46bf-8748-19a6e4eb0d61") failed: Property not found. retry in 1.007860329s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_234660ab-07d6-46bf-8748-19a6e4eb0d61
14852024-11-25T19:30:47.379ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_863e78e3-a753-4fb2-97de-c46023f03292") failed: Property not found. retry in 1.334238475s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_863e78e3-a753-4fb2-97de-c46023f03292
14862024-11-25T19:30:47.581ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42cf72f4-fa5d-45b0-b91f-af1c2e33690d") failed: Property not found. retry in 617.019171ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42cf72f4-fa5d-45b0-b91f-af1c2e33690d
14872024-11-25T19:30:47.692ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7db61d8a-2b76-4a38-9be0-42b379308323") failed: Property not found. retry in 1.304818575s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7db61d8a-2b76-4a38-9be0-42b379308323
14882024-11-25T19:30:47.740ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0a80d709-bf2b-457a-9df6-b7c61cf35e54") failed: Property not found. retry in 951.834003ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0a80d709-bf2b-457a-9df6-b7c61cf35e54
14892024-11-25T19:30:47.782ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3") failed: Property not found. retry in 1.232128897s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3
14902024-11-25T19:30:47.828ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9bea4b41-0e61-416b-9a60-0c3dff58b905") failed: Property not found. retry in 1.151431323s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9bea4b41-0e61-416b-9a60-0c3dff58b905
14912024-11-25T19:30:47.867ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5e357e48-2959-4886-8b9d-557b95c45fb7") failed: Property not found. retry in 1.20564388s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5e357e48-2959-4886-8b9d-557b95c45fb7
14922024-11-25T19:30:47.915ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1d808376-6b5a-46f0-b373-d7ba578556eb") failed: Property not found. retry in 1.094455642s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1d808376-6b5a-46f0-b373-d7ba578556eb
14932024-11-25T19:30:47.959ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fa3bd66a-1a51-4937-9188-36e5fc334f7c") failed: Property not found. retry in 1.176769831s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fa3bd66a-1a51-4937-9188-36e5fc334f7c
14942024-11-25T19:30:48.009ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037") failed: Property not found. retry in 794.804408ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
14952024-11-25T19:30:48.145ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6f634f5-3528-4e41-966f-f47648523f6a") failed: Property not found. retry in 1.025033213s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6f634f5-3528-4e41-966f-f47648523f6a
14962024-11-25T19:30:48.208ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42cf72f4-fa5d-45b0-b91f-af1c2e33690d") failed: Property not found. retry in 643.945039ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42cf72f4-fa5d-45b0-b91f-af1c2e33690d
14972024-11-25T19:30:48.238ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1287099d-2056-4e10-99e5-632481da2c2b") failed: Property not found. retry in 949.694361ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1287099d-2056-4e10-99e5-632481da2c2b
14982024-11-25T19:30:48.273ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_234660ab-07d6-46bf-8748-19a6e4eb0d61") failed: Property not found. retry in 1.212640584s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_234660ab-07d6-46bf-8748-19a6e4eb0d61
14992024-11-25T19:30:48.701ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0a80d709-bf2b-457a-9df6-b7c61cf35e54") failed: Property not found. retry in 663.898534ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0a80d709-bf2b-457a-9df6-b7c61cf35e54
15002024-11-25T19:30:48.713ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a33ba47-8706-4469-959c-acd4a6a8404e") failed: Property not found. retry in 1.425850921s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a33ba47-8706-4469-959c-acd4a6a8404e
15012024-11-25T19:30:48.723ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_863e78e3-a753-4fb2-97de-c46023f03292") failed: Property not found. retry in 808.614376ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_863e78e3-a753-4fb2-97de-c46023f03292
15022024-11-25T19:30:48.812ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037") failed: Property not found. retry in 1.286198424s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
15032024-11-25T19:30:48.941ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42cf72f4-fa5d-45b0-b91f-af1c2e33690d") failed: Property not found. retry in 543.566721ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42cf72f4-fa5d-45b0-b91f-af1c2e33690d
15042024-11-25T19:30:49.085ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9bea4b41-0e61-416b-9a60-0c3dff58b905") failed: Property not found. retry in 1.204069644s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9bea4b41-0e61-416b-9a60-0c3dff58b905
15052024-11-25T19:30:49.102ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7db61d8a-2b76-4a38-9be0-42b379308323") failed: Property not found. retry in 923.156799ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7db61d8a-2b76-4a38-9be0-42b379308323
15062024-11-25T19:30:49.118ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3") failed: Property not found. retry in 745.10542ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3
15072024-11-25T19:30:49.132ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5e357e48-2959-4886-8b9d-557b95c45fb7") failed: Property not found. retry in 1.346979124s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5e357e48-2959-4886-8b9d-557b95c45fb7
15082024-11-25T19:30:49.150ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1d808376-6b5a-46f0-b373-d7ba578556eb") failed: Property not found. retry in 1.347283556s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1d808376-6b5a-46f0-b373-d7ba578556eb
15092024-11-25T19:30:49.167ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fa3bd66a-1a51-4937-9188-36e5fc334f7c") failed: Property not found. retry in 567.280444ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fa3bd66a-1a51-4937-9188-36e5fc334f7c
15102024-11-25T19:30:49.187ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6f634f5-3528-4e41-966f-f47648523f6a") failed: Property not found. retry in 998.244955ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6f634f5-3528-4e41-966f-f47648523f6a
15112024-11-25T19:30:49.204ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1287099d-2056-4e10-99e5-632481da2c2b") failed: Property not found. retry in 1.201677089s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1287099d-2056-4e10-99e5-632481da2c2b
15122024-11-25T19:30:49.377ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0a80d709-bf2b-457a-9df6-b7c61cf35e54") failed: Property not found. retry in 1.187310885s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0a80d709-bf2b-457a-9df6-b7c61cf35e54
15132024-11-25T19:30:49.495ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42cf72f4-fa5d-45b0-b91f-af1c2e33690d") failed: Property not found. retry in 642.038034ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42cf72f4-fa5d-45b0-b91f-af1c2e33690d
15142024-11-25T19:30:49.503ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_234660ab-07d6-46bf-8748-19a6e4eb0d61") failed: Property not found. retry in 998.426769ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_234660ab-07d6-46bf-8748-19a6e4eb0d61
15152024-11-25T19:30:49.540ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_863e78e3-a753-4fb2-97de-c46023f03292") failed: Property not found. retry in 1.042834347s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_863e78e3-a753-4fb2-97de-c46023f03292
15162024-11-25T19:30:49.745ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fa3bd66a-1a51-4937-9188-36e5fc334f7c") failed: Property not found. retry in 923.141021ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fa3bd66a-1a51-4937-9188-36e5fc334f7c
15172024-11-25T19:30:49.873ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3") failed: Property not found. retry in 965.475947ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3
15182024-11-25T19:30:50.035ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7db61d8a-2b76-4a38-9be0-42b379308323") failed: Property not found. retry in 768.021976ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7db61d8a-2b76-4a38-9be0-42b379308323
15192024-11-25T19:30:50.107ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037") failed: Property not found. retry in 514.511431ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
15202024-11-25T19:30:50.146ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42cf72f4-fa5d-45b0-b91f-af1c2e33690d") failed: Property not found. retry in 961.274953ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42cf72f4-fa5d-45b0-b91f-af1c2e33690d
15212024-11-25T19:30:50.154ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a33ba47-8706-4469-959c-acd4a6a8404e") failed: Property not found. retry in 914.667562ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a33ba47-8706-4469-959c-acd4a6a8404e
15222024-11-25T19:30:50.194ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6f634f5-3528-4e41-966f-f47648523f6a") failed: Property not found. retry in 1.454132039s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6f634f5-3528-4e41-966f-f47648523f6a
15232024-11-25T19:30:50.297ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9bea4b41-0e61-416b-9a60-0c3dff58b905") failed: Property not found. retry in 1.479257654s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9bea4b41-0e61-416b-9a60-0c3dff58b905
15242024-11-25T19:30:50.414ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1287099d-2056-4e10-99e5-632481da2c2b") failed: Property not found. retry in 630.352094ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1287099d-2056-4e10-99e5-632481da2c2b
15252024-11-25T19:30:50.488ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5e357e48-2959-4886-8b9d-557b95c45fb7") failed: Property not found. retry in 1.354151486s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5e357e48-2959-4886-8b9d-557b95c45fb7
15262024-11-25T19:30:50.505ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1d808376-6b5a-46f0-b373-d7ba578556eb") failed: Property not found. retry in 602.820066ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1d808376-6b5a-46f0-b373-d7ba578556eb
15272024-11-25T19:30:50.512ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_234660ab-07d6-46bf-8748-19a6e4eb0d61") failed: Property not found. retry in 1.463126394s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_234660ab-07d6-46bf-8748-19a6e4eb0d61
15282024-11-25T19:30:50.572ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0a80d709-bf2b-457a-9df6-b7c61cf35e54") failed: Property not found. retry in 611.139232ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0a80d709-bf2b-457a-9df6-b7c61cf35e54
15292024-11-25T19:30:50.593ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_863e78e3-a753-4fb2-97de-c46023f03292") failed: Property not found. retry in 568.274667ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_863e78e3-a753-4fb2-97de-c46023f03292
15302024-11-25T19:30:50.632ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037") failed: Property not found. retry in 879.951186ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
15312024-11-25T19:30:50.678ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fa3bd66a-1a51-4937-9188-36e5fc334f7c") failed: Property not found. retry in 559.025211ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fa3bd66a-1a51-4937-9188-36e5fc334f7c
15322024-11-25T19:30:50.812ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7db61d8a-2b76-4a38-9be0-42b379308323") failed: Property not found. retry in 1.15884397s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7db61d8a-2b76-4a38-9be0-42b379308323
15332024-11-25T19:30:50.818ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:63388
15342024-11-25T19:30:50.847ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 27312 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:63388 req_id = d006d083-3774-4223-a59b-c58d8ec46279 response_code = 200 uri = /baseboard
15352024-11-25T19:30:50.855ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3") failed: Property not found. retry in 825.416358ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3
15362024-11-25T19:30:51.056ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1287099d-2056-4e10-99e5-632481da2c2b") failed: Property not found. retry in 589.451615ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1287099d-2056-4e10-99e5-632481da2c2b
15372024-11-25T19:30:51.113ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a33ba47-8706-4469-959c-acd4a6a8404e") failed: Property not found. retry in 1.402651606s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a33ba47-8706-4469-959c-acd4a6a8404e
15382024-11-25T19:30:51.122ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1d808376-6b5a-46f0-b373-d7ba578556eb") failed: Property not found. retry in 1.021678329s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1d808376-6b5a-46f0-b373-d7ba578556eb
15392024-11-25T19:30:51.131ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42cf72f4-fa5d-45b0-b91f-af1c2e33690d") failed: Property not found. retry in 1.470603079s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42cf72f4-fa5d-45b0-b91f-af1c2e33690d
15402024-11-25T19:30:51.169ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_863e78e3-a753-4fb2-97de-c46023f03292") failed: Property not found. retry in 1.486760262s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_863e78e3-a753-4fb2-97de-c46023f03292
15412024-11-25T19:30:51.191ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0a80d709-bf2b-457a-9df6-b7c61cf35e54") failed: Property not found. retry in 1.105125519s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0a80d709-bf2b-457a-9df6-b7c61cf35e54
15422024-11-25T19:30:51.246ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fa3bd66a-1a51-4937-9188-36e5fc334f7c") failed: Property not found. retry in 807.075701ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fa3bd66a-1a51-4937-9188-36e5fc334f7c
15432024-11-25T19:30:51.521ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037") failed: Property not found. retry in 843.449729ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
15442024-11-25T19:30:51.655ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1287099d-2056-4e10-99e5-632481da2c2b") failed: Property not found. retry in 1.414245015s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1287099d-2056-4e10-99e5-632481da2c2b
15452024-11-25T19:30:51.663ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6f634f5-3528-4e41-966f-f47648523f6a") failed: Property not found. retry in 918.691137ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6f634f5-3528-4e41-966f-f47648523f6a
15462024-11-25T19:30:51.689ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3") failed: Property not found. retry in 548.002497ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3
15472024-11-25T19:30:51.785ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9bea4b41-0e61-416b-9a60-0c3dff58b905") failed: Property not found. retry in 1.403152829s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9bea4b41-0e61-416b-9a60-0c3dff58b905
15482024-11-25T19:30:51.850ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5e357e48-2959-4886-8b9d-557b95c45fb7") failed: Property not found. retry in 1.085008508s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5e357e48-2959-4886-8b9d-557b95c45fb7
15492024-11-25T19:30:51.979ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7db61d8a-2b76-4a38-9be0-42b379308323") failed: Property not found. retry in 1.173124429s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7db61d8a-2b76-4a38-9be0-42b379308323
15502024-11-25T19:30:51.985ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_234660ab-07d6-46bf-8748-19a6e4eb0d61") failed: Property not found. retry in 515.873518ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_234660ab-07d6-46bf-8748-19a6e4eb0d61
15512024-11-25T19:30:52.061ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fa3bd66a-1a51-4937-9188-36e5fc334f7c") failed: Property not found. retry in 1.034739221s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fa3bd66a-1a51-4937-9188-36e5fc334f7c
15522024-11-25T19:30:52.153ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1d808376-6b5a-46f0-b373-d7ba578556eb") failed: Property not found. retry in 890.56703ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1d808376-6b5a-46f0-b373-d7ba578556eb
15532024-11-25T19:30:52.245ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3") failed: Property not found. retry in 1.056483987s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3
15542024-11-25T19:30:52.303ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0a80d709-bf2b-457a-9df6-b7c61cf35e54") failed: Property not found. retry in 1.095954809s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0a80d709-bf2b-457a-9df6-b7c61cf35e54
15552024-11-25T19:30:52.372ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037") failed: Property not found. retry in 1.444900741s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
15562024-11-25T19:30:52.509ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_234660ab-07d6-46bf-8748-19a6e4eb0d61") failed: Property not found. retry in 759.603792ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_234660ab-07d6-46bf-8748-19a6e4eb0d61
15572024-11-25T19:30:52.524ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a33ba47-8706-4469-959c-acd4a6a8404e") failed: Property not found. retry in 891.717008ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a33ba47-8706-4469-959c-acd4a6a8404e
15582024-11-25T19:30:52.589ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6f634f5-3528-4e41-966f-f47648523f6a") failed: Property not found. retry in 556.746475ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6f634f5-3528-4e41-966f-f47648523f6a
15592024-11-25T19:30:52.609ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42cf72f4-fa5d-45b0-b91f-af1c2e33690d") failed: Property not found. retry in 947.525036ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42cf72f4-fa5d-45b0-b91f-af1c2e33690d
15602024-11-25T19:30:52.665ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_863e78e3-a753-4fb2-97de-c46023f03292") failed: Property not found. retry in 1.265821816s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_863e78e3-a753-4fb2-97de-c46023f03292
15612024-11-25T19:30:52.943ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5e357e48-2959-4886-8b9d-557b95c45fb7") failed: Property not found. retry in 1.378694869s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5e357e48-2959-4886-8b9d-557b95c45fb7
15622024-11-25T19:30:53.052ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1d808376-6b5a-46f0-b373-d7ba578556eb") failed: Property not found. retry in 1.19135383s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1d808376-6b5a-46f0-b373-d7ba578556eb
15632024-11-25T19:30:53.078ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1287099d-2056-4e10-99e5-632481da2c2b") failed: Property not found. retry in 840.700694ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1287099d-2056-4e10-99e5-632481da2c2b
15642024-11-25T19:30:53.104ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fa3bd66a-1a51-4937-9188-36e5fc334f7c") failed: Property not found. retry in 1.368793572s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fa3bd66a-1a51-4937-9188-36e5fc334f7c
15652024-11-25T19:30:53.154ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6f634f5-3528-4e41-966f-f47648523f6a") failed: Property not found. retry in 620.921942ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6f634f5-3528-4e41-966f-f47648523f6a
15662024-11-25T19:30:53.161ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7db61d8a-2b76-4a38-9be0-42b379308323") failed: Property not found. retry in 1.375902993s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7db61d8a-2b76-4a38-9be0-42b379308323
15672024-11-25T19:30:53.196ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9bea4b41-0e61-416b-9a60-0c3dff58b905") failed: Property not found. retry in 977.971738ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9bea4b41-0e61-416b-9a60-0c3dff58b905
15682024-11-25T19:30:53.278ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_234660ab-07d6-46bf-8748-19a6e4eb0d61") failed: Property not found. retry in 838.743572ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_234660ab-07d6-46bf-8748-19a6e4eb0d61
15692024-11-25T19:30:53.310ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3") failed: Property not found. retry in 1.096214669s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3
15702024-11-25T19:30:53.411ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0a80d709-bf2b-457a-9df6-b7c61cf35e54") failed: Property not found. retry in 808.970749ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0a80d709-bf2b-457a-9df6-b7c61cf35e54
15712024-11-25T19:30:53.425ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a33ba47-8706-4469-959c-acd4a6a8404e") failed: Property not found. retry in 1.019260503s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a33ba47-8706-4469-959c-acd4a6a8404e
15722024-11-25T19:30:53.570ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42cf72f4-fa5d-45b0-b91f-af1c2e33690d") failed: Property not found. retry in 712.6383ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42cf72f4-fa5d-45b0-b91f-af1c2e33690d
15732024-11-25T19:30:53.701ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_6b3cbeea-c72e-481d-a7a1-e27c601ccb03: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
15742024-11-25T19:30:53.701ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_6b3cbeea-c72e-481d-a7a1-e27c601ccb03 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_6b3cbeea-c72e-481d-a7a1-e27c601ccb03
15752024-11-25T19:30:53.740ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_7c96e2c2-1643-4666-b1e3-92a7f608b3f8: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_71fa9360-75cf-491a-b7ef-fd270ae2f32c/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='87ef6a10-7e3a-465b-bfc2-6c59cbca209a'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
15762024-11-25T19:30:53.740ZINFOSledAgent (ServiceManager): Booting oxz_crucible_7c96e2c2-1643-4666-b1e3-92a7f608b3f8 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_7c96e2c2-1643-4666-b1e3-92a7f608b3f8
15772024-11-25T19:30:53.786ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6f634f5-3528-4e41-966f-f47648523f6a") failed: Property not found. retry in 1.230188929s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6f634f5-3528-4e41-966f-f47648523f6a
15782024-11-25T19:30:53.828ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037") failed: Property not found. retry in 1.001553974s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
15792024-11-25T19:30:53.935ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1287099d-2056-4e10-99e5-632481da2c2b") failed: Property not found. retry in 999.338815ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1287099d-2056-4e10-99e5-632481da2c2b
15802024-11-25T19:30:53.947ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_863e78e3-a753-4fb2-97de-c46023f03292") failed: Property not found. retry in 1.456392919s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_863e78e3-a753-4fb2-97de-c46023f03292
15812024-11-25T19:30:53.961ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6b3cbeea-c72e-481d-a7a1-e27c601ccb03") failed: Property not found. retry in 68.492536ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6b3cbeea-c72e-481d-a7a1-e27c601ccb03
15822024-11-25T19:30:53.989ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7c96e2c2-1643-4666-b1e3-92a7f608b3f8") failed: Property not found. retry in 42.13153ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7c96e2c2-1643-4666-b1e3-92a7f608b3f8
15832024-11-25T19:30:54.038ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6b3cbeea-c72e-481d-a7a1-e27c601ccb03") failed: Property not found. retry in 142.255869ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6b3cbeea-c72e-481d-a7a1-e27c601ccb03
15842024-11-25T19:30:54.046ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7c96e2c2-1643-4666-b1e3-92a7f608b3f8") failed: Property not found. retry in 131.351781ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7c96e2c2-1643-4666-b1e3-92a7f608b3f8
15852024-11-25T19:30:54.128ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_234660ab-07d6-46bf-8748-19a6e4eb0d61") failed: Property not found. retry in 1.450642222s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_234660ab-07d6-46bf-8748-19a6e4eb0d61
15862024-11-25T19:30:54.187ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9bea4b41-0e61-416b-9a60-0c3dff58b905") failed: Property not found. retry in 737.367077ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9bea4b41-0e61-416b-9a60-0c3dff58b905
15872024-11-25T19:30:54.200ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7c96e2c2-1643-4666-b1e3-92a7f608b3f8") failed: Property not found. retry in 276.650682ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7c96e2c2-1643-4666-b1e3-92a7f608b3f8
15882024-11-25T19:30:54.211ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6b3cbeea-c72e-481d-a7a1-e27c601ccb03") failed: Property not found. retry in 210.677202ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6b3cbeea-c72e-481d-a7a1-e27c601ccb03
15892024-11-25T19:30:54.230ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0a80d709-bf2b-457a-9df6-b7c61cf35e54") failed: Property not found. retry in 1.168702689s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0a80d709-bf2b-457a-9df6-b7c61cf35e54
15902024-11-25T19:30:54.253ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1d808376-6b5a-46f0-b373-d7ba578556eb") failed: Property not found. retry in 915.575701ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1d808376-6b5a-46f0-b373-d7ba578556eb
15912024-11-25T19:30:54.294ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42cf72f4-fa5d-45b0-b91f-af1c2e33690d") failed: Property not found. retry in 1.182011844s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42cf72f4-fa5d-45b0-b91f-af1c2e33690d
15922024-11-25T19:30:54.333ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5e357e48-2959-4886-8b9d-557b95c45fb7") failed: Property not found. retry in 768.049234ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5e357e48-2959-4886-8b9d-557b95c45fb7
15932024-11-25T19:30:54.416ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3") failed: Property not found. retry in 1.398897062s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3
15942024-11-25T19:30:54.432ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6b3cbeea-c72e-481d-a7a1-e27c601ccb03") failed: Property not found. retry in 422.504752ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6b3cbeea-c72e-481d-a7a1-e27c601ccb03
15952024-11-25T19:30:54.454ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a33ba47-8706-4469-959c-acd4a6a8404e") failed: Property not found. retry in 1.482679064s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a33ba47-8706-4469-959c-acd4a6a8404e
15962024-11-25T19:30:54.454ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_4f833d1f-8a98-4545-91ff-69d713fdd1f0: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='4f833d1f-8a98-4545-91ff-69d713fdd1f0'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
15972024-11-25T19:30:54.454ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_4f833d1f-8a98-4545-91ff-69d713fdd1f0 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_oximeter_4f833d1f-8a98-4545-91ff-69d713fdd1f0
15982024-11-25T19:30:54.483ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fa3bd66a-1a51-4937-9188-36e5fc334f7c") failed: Property not found. retry in 1.260984098s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fa3bd66a-1a51-4937-9188-36e5fc334f7c
15992024-11-25T19:30:54.490ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7c96e2c2-1643-4666-b1e3-92a7f608b3f8") failed: Property not found. retry in 284.265167ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7c96e2c2-1643-4666-b1e3-92a7f608b3f8
16002024-11-25T19:30:54.546ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7db61d8a-2b76-4a38-9be0-42b379308323") failed: Property not found. retry in 609.068865ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7db61d8a-2b76-4a38-9be0-42b379308323
16012024-11-25T19:30:54.644ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_4f833d1f-8a98-4545-91ff-69d713fdd1f0") failed: Property not found. retry in 55.852231ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_4f833d1f-8a98-4545-91ff-69d713fdd1f0
16022024-11-25T19:30:54.711ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_4f833d1f-8a98-4545-91ff-69d713fdd1f0") failed: Property not found. retry in 140.090456ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_4f833d1f-8a98-4545-91ff-69d713fdd1f0
16032024-11-25T19:30:54.786ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7c96e2c2-1643-4666-b1e3-92a7f608b3f8") failed: Property not found. retry in 1.0924197s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7c96e2c2-1643-4666-b1e3-92a7f608b3f8
16042024-11-25T19:30:54.844ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037") failed: Property not found. retry in 1.371506427s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
16052024-11-25T19:30:54.863ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_4f833d1f-8a98-4545-91ff-69d713fdd1f0") failed: Property not found. retry in 133.730189ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_4f833d1f-8a98-4545-91ff-69d713fdd1f0
16062024-11-25T19:30:54.871ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6b3cbeea-c72e-481d-a7a1-e27c601ccb03") failed: Property not found. retry in 433.778422ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6b3cbeea-c72e-481d-a7a1-e27c601ccb03
16072024-11-25T19:30:54.934ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9bea4b41-0e61-416b-9a60-0c3dff58b905") failed: Property not found. retry in 865.568557ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9bea4b41-0e61-416b-9a60-0c3dff58b905
16082024-11-25T19:30:54.944ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1287099d-2056-4e10-99e5-632481da2c2b") failed: Property not found. retry in 1.228123381s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1287099d-2056-4e10-99e5-632481da2c2b
16092024-11-25T19:30:55.007ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_4f833d1f-8a98-4545-91ff-69d713fdd1f0") failed: Property not found. retry in 550.287206ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_4f833d1f-8a98-4545-91ff-69d713fdd1f0
16102024-11-25T19:30:55.026ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6f634f5-3528-4e41-966f-f47648523f6a") failed: Property not found. retry in 968.601985ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6f634f5-3528-4e41-966f-f47648523f6a
16112024-11-25T19:30:55.111ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5e357e48-2959-4886-8b9d-557b95c45fb7") failed: Property not found. retry in 658.890058ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5e357e48-2959-4886-8b9d-557b95c45fb7
16122024-11-25T19:30:55.165ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7db61d8a-2b76-4a38-9be0-42b379308323") failed: Property not found. retry in 1.157441932s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7db61d8a-2b76-4a38-9be0-42b379308323
16132024-11-25T19:30:55.183ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1d808376-6b5a-46f0-b373-d7ba578556eb") failed: Property not found. retry in 1.055192651s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1d808376-6b5a-46f0-b373-d7ba578556eb
16142024-11-25T19:30:55.320ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6b3cbeea-c72e-481d-a7a1-e27c601ccb03") failed: Property not found. retry in 668.295672ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6b3cbeea-c72e-481d-a7a1-e27c601ccb03
16152024-11-25T19:30:55.320ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
16162024-11-25T19:30:55.320ZINFOSledAgent (ServiceManager): Booting oxz_nexus_a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67
16172024-11-25T19:30:55.409ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0a80d709-bf2b-457a-9df6-b7c61cf35e54") failed: Property not found. retry in 1.08217925s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0a80d709-bf2b-457a-9df6-b7c61cf35e54
16182024-11-25T19:30:55.417ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_863e78e3-a753-4fb2-97de-c46023f03292") failed: Property not found. retry in 959.623156ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_863e78e3-a753-4fb2-97de-c46023f03292
16192024-11-25T19:30:55.465ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67") failed: Property not found. retry in 72.316938ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67
16202024-11-25T19:30:55.485ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42cf72f4-fa5d-45b0-b91f-af1c2e33690d") failed: Property not found. retry in 1.04432081s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42cf72f4-fa5d-45b0-b91f-af1c2e33690d
16212024-11-25T19:30:55.548ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67") failed: Property not found. retry in 114.867487ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67
16222024-11-25T19:30:55.579ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_4f833d1f-8a98-4545-91ff-69d713fdd1f0") failed: Property not found. retry in 1.13623818s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_4f833d1f-8a98-4545-91ff-69d713fdd1f0
16232024-11-25T19:30:55.594ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_234660ab-07d6-46bf-8748-19a6e4eb0d61") failed: Property not found. retry in 1.176823364s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_234660ab-07d6-46bf-8748-19a6e4eb0d61
16242024-11-25T19:30:55.676ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67") failed: Property not found. retry in 196.251121ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67
16252024-11-25T19:30:55.756ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fa3bd66a-1a51-4937-9188-36e5fc334f7c") failed: Property not found. retry in 1.446269881s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fa3bd66a-1a51-4937-9188-36e5fc334f7c
16262024-11-25T19:30:55.781ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5e357e48-2959-4886-8b9d-557b95c45fb7") failed: Property not found. retry in 1.286307977s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5e357e48-2959-4886-8b9d-557b95c45fb7
16272024-11-25T19:30:55.813ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9bea4b41-0e61-416b-9a60-0c3dff58b905") failed: Property not found. retry in 1.31253306s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9bea4b41-0e61-416b-9a60-0c3dff58b905
16282024-11-25T19:30:55.826ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3") failed: Property not found. retry in 574.313424ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3
16292024-11-25T19:30:55.885ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67") failed: Property not found. retry in 225.487617ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67
16302024-11-25T19:30:55.896ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7c96e2c2-1643-4666-b1e3-92a7f608b3f8") failed: Property not found. retry in 1.468947808s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7c96e2c2-1643-4666-b1e3-92a7f608b3f8
16312024-11-25T19:30:55.948ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a33ba47-8706-4469-959c-acd4a6a8404e") failed: Property not found. retry in 1.475535821s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a33ba47-8706-4469-959c-acd4a6a8404e
16322024-11-25T19:30:56.000ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6b3cbeea-c72e-481d-a7a1-e27c601ccb03") failed: Property not found. retry in 1.307004277s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6b3cbeea-c72e-481d-a7a1-e27c601ccb03
16332024-11-25T19:30:56.012ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6f634f5-3528-4e41-966f-f47648523f6a") failed: Property not found. retry in 1.376921079s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6f634f5-3528-4e41-966f-f47648523f6a
16342024-11-25T19:30:56.124ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67") failed: Property not found. retry in 800.01292ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67
16352024-11-25T19:30:56.184ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1287099d-2056-4e10-99e5-632481da2c2b") failed: Property not found. retry in 1.081331201s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1287099d-2056-4e10-99e5-632481da2c2b
16362024-11-25T19:30:56.226ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037") failed: Property not found. retry in 1.178682587s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
16372024-11-25T19:30:56.248ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1d808376-6b5a-46f0-b373-d7ba578556eb") failed: Property not found. retry in 1.082183181s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1d808376-6b5a-46f0-b373-d7ba578556eb
16382024-11-25T19:30:56.334ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7db61d8a-2b76-4a38-9be0-42b379308323") failed: Property not found. retry in 1.354283781s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7db61d8a-2b76-4a38-9be0-42b379308323
16392024-11-25T19:30:56.389ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_863e78e3-a753-4fb2-97de-c46023f03292") failed: Property not found. retry in 525.387188ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_863e78e3-a753-4fb2-97de-c46023f03292
16402024-11-25T19:30:56.413ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3") failed: Property not found. retry in 579.365955ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3
16412024-11-25T19:30:56.504ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0a80d709-bf2b-457a-9df6-b7c61cf35e54") failed: Property not found. retry in 1.225065004s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0a80d709-bf2b-457a-9df6-b7c61cf35e54
16422024-11-25T19:30:56.540ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42cf72f4-fa5d-45b0-b91f-af1c2e33690d") failed: Property not found. retry in 1.334179504s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42cf72f4-fa5d-45b0-b91f-af1c2e33690d
16432024-11-25T19:30:56.726ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_4f833d1f-8a98-4545-91ff-69d713fdd1f0") failed: Property not found. retry in 644.357353ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_4f833d1f-8a98-4545-91ff-69d713fdd1f0
16442024-11-25T19:30:56.781ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_234660ab-07d6-46bf-8748-19a6e4eb0d61") failed: Property not found. retry in 913.217982ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_234660ab-07d6-46bf-8748-19a6e4eb0d61
16452024-11-25T19:30:56.927ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_863e78e3-a753-4fb2-97de-c46023f03292") failed: Property not found. retry in 1.321897945s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_863e78e3-a753-4fb2-97de-c46023f03292
16462024-11-25T19:30:56.938ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67") failed: Property not found. retry in 1.000457091s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67
16472024-11-25T19:30:57.004ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3") failed: Property not found. retry in 1.218804971s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3
16482024-11-25T19:30:57.080ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5e357e48-2959-4886-8b9d-557b95c45fb7") failed: Property not found. retry in 1.24102312s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5e357e48-2959-4886-8b9d-557b95c45fb7
16492024-11-25T19:30:57.140ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9bea4b41-0e61-416b-9a60-0c3dff58b905") failed: Property not found. retry in 578.904442ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9bea4b41-0e61-416b-9a60-0c3dff58b905
16502024-11-25T19:30:57.217ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fa3bd66a-1a51-4937-9188-36e5fc334f7c") failed: Property not found. retry in 834.875553ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fa3bd66a-1a51-4937-9188-36e5fc334f7c
16512024-11-25T19:30:57.279ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1287099d-2056-4e10-99e5-632481da2c2b") failed: Property not found. retry in 1.462836928s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1287099d-2056-4e10-99e5-632481da2c2b
16522024-11-25T19:30:57.321ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6b3cbeea-c72e-481d-a7a1-e27c601ccb03") failed: Property not found. retry in 1.163117091s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6b3cbeea-c72e-481d-a7a1-e27c601ccb03
16532024-11-25T19:30:57.344ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1d808376-6b5a-46f0-b373-d7ba578556eb") failed: Property not found. retry in 830.10152ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1d808376-6b5a-46f0-b373-d7ba578556eb
16542024-11-25T19:30:57.378ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7c96e2c2-1643-4666-b1e3-92a7f608b3f8") failed: Property not found. retry in 1.325870417s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7c96e2c2-1643-4666-b1e3-92a7f608b3f8
16552024-11-25T19:30:57.389ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_4f833d1f-8a98-4545-91ff-69d713fdd1f0") failed: Property not found. retry in 1.484261135s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_4f833d1f-8a98-4545-91ff-69d713fdd1f0
16562024-11-25T19:30:57.401ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6f634f5-3528-4e41-966f-f47648523f6a") failed: Property not found. retry in 1.15962547s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6f634f5-3528-4e41-966f-f47648523f6a
16572024-11-25T19:30:57.417ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037") failed: Property not found. retry in 1.373127187s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
16582024-11-25T19:30:57.438ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a33ba47-8706-4469-959c-acd4a6a8404e") failed: Property not found. retry in 1.302732549s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a33ba47-8706-4469-959c-acd4a6a8404e
16592024-11-25T19:30:57.703ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7db61d8a-2b76-4a38-9be0-42b379308323") failed: Property not found. retry in 1.180013577s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7db61d8a-2b76-4a38-9be0-42b379308323
16602024-11-25T19:30:57.716ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_234660ab-07d6-46bf-8748-19a6e4eb0d61") failed: Property not found. retry in 1.013888584s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_234660ab-07d6-46bf-8748-19a6e4eb0d61
16612024-11-25T19:30:57.736ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9bea4b41-0e61-416b-9a60-0c3dff58b905") failed: Property not found. retry in 803.589775ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9bea4b41-0e61-416b-9a60-0c3dff58b905
16622024-11-25T19:30:57.763ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0a80d709-bf2b-457a-9df6-b7c61cf35e54") failed: Property not found. retry in 749.398813ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0a80d709-bf2b-457a-9df6-b7c61cf35e54
16632024-11-25T19:30:57.890ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42cf72f4-fa5d-45b0-b91f-af1c2e33690d") failed: Property not found. retry in 1.3039575s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42cf72f4-fa5d-45b0-b91f-af1c2e33690d
16642024-11-25T19:30:57.953ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67") failed: Property not found. retry in 766.49034ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67
16652024-11-25T19:30:58.064ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fa3bd66a-1a51-4937-9188-36e5fc334f7c") failed: Property not found. retry in 1.41062736s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fa3bd66a-1a51-4937-9188-36e5fc334f7c
16662024-11-25T19:30:58.192ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1d808376-6b5a-46f0-b373-d7ba578556eb") failed: Property not found. retry in 682.658067ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1d808376-6b5a-46f0-b373-d7ba578556eb
16672024-11-25T19:30:58.236ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3") failed: Property not found. retry in 1.489293921s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3
16682024-11-25T19:30:58.262ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_863e78e3-a753-4fb2-97de-c46023f03292") failed: Property not found. retry in 1.401344117s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_863e78e3-a753-4fb2-97de-c46023f03292
16692024-11-25T19:30:58.336ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5e357e48-2959-4886-8b9d-557b95c45fb7") failed: Property not found. retry in 1.260900033s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5e357e48-2959-4886-8b9d-557b95c45fb7
16702024-11-25T19:30:58.502ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6b3cbeea-c72e-481d-a7a1-e27c601ccb03") failed: Property not found. retry in 1.278871128s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6b3cbeea-c72e-481d-a7a1-e27c601ccb03
16712024-11-25T19:30:58.529ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0a80d709-bf2b-457a-9df6-b7c61cf35e54") failed: Property not found. retry in 1.356427102s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0a80d709-bf2b-457a-9df6-b7c61cf35e54
16722024-11-25T19:30:58.552ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9bea4b41-0e61-416b-9a60-0c3dff58b905") failed: Property not found. retry in 699.43132ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9bea4b41-0e61-416b-9a60-0c3dff58b905
16732024-11-25T19:30:58.574ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6f634f5-3528-4e41-966f-f47648523f6a") failed: Property not found. retry in 557.917296ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6f634f5-3528-4e41-966f-f47648523f6a
16742024-11-25T19:30:58.719ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7c96e2c2-1643-4666-b1e3-92a7f608b3f8") failed: Property not found. retry in 1.11155664s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7c96e2c2-1643-4666-b1e3-92a7f608b3f8
16752024-11-25T19:30:58.737ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67") failed: Property not found. retry in 533.824638ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67
16762024-11-25T19:30:58.752ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_234660ab-07d6-46bf-8748-19a6e4eb0d61") failed: Property not found. retry in 779.440538ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_234660ab-07d6-46bf-8748-19a6e4eb0d61
16772024-11-25T19:30:58.765ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1287099d-2056-4e10-99e5-632481da2c2b") failed: Property not found. retry in 1.001103184s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1287099d-2056-4e10-99e5-632481da2c2b
16782024-11-25T19:30:58.780ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a33ba47-8706-4469-959c-acd4a6a8404e") failed: Property not found. retry in 885.757531ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a33ba47-8706-4469-959c-acd4a6a8404e
16792024-11-25T19:30:58.805ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037") failed: Property not found. retry in 951.106944ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
16802024-11-25T19:30:58.884ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_4f833d1f-8a98-4545-91ff-69d713fdd1f0") failed: Property not found. retry in 527.206028ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_4f833d1f-8a98-4545-91ff-69d713fdd1f0
16812024-11-25T19:30:58.894ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7db61d8a-2b76-4a38-9be0-42b379308323") failed: Property not found. retry in 1.02662223s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7db61d8a-2b76-4a38-9be0-42b379308323
16822024-11-25T19:30:58.903ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1d808376-6b5a-46f0-b373-d7ba578556eb") failed: Property not found. retry in 988.501751ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1d808376-6b5a-46f0-b373-d7ba578556eb
16832024-11-25T19:30:59.143ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6f634f5-3528-4e41-966f-f47648523f6a") failed: Property not found. retry in 853.900101ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6f634f5-3528-4e41-966f-f47648523f6a
16842024-11-25T19:30:59.208ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42cf72f4-fa5d-45b0-b91f-af1c2e33690d") failed: Property not found. retry in 1.014244803s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42cf72f4-fa5d-45b0-b91f-af1c2e33690d
16852024-11-25T19:30:59.264ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9bea4b41-0e61-416b-9a60-0c3dff58b905") failed: Property not found. retry in 719.314682ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9bea4b41-0e61-416b-9a60-0c3dff58b905
16862024-11-25T19:30:59.281ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67") failed: Property not found. retry in 1.028227368s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67
16872024-11-25T19:30:59.425ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_4f833d1f-8a98-4545-91ff-69d713fdd1f0") failed: Property not found. retry in 585.961535ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_4f833d1f-8a98-4545-91ff-69d713fdd1f0
16882024-11-25T19:30:59.487ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fa3bd66a-1a51-4937-9188-36e5fc334f7c") failed: Property not found. retry in 1.340674818s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fa3bd66a-1a51-4937-9188-36e5fc334f7c
16892024-11-25T19:30:59.547ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_234660ab-07d6-46bf-8748-19a6e4eb0d61") failed: Property not found. retry in 1.068280947s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_234660ab-07d6-46bf-8748-19a6e4eb0d61
16902024-11-25T19:30:59.608ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5e357e48-2959-4886-8b9d-557b95c45fb7") failed: Property not found. retry in 1.103522882s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5e357e48-2959-4886-8b9d-557b95c45fb7
16912024-11-25T19:30:59.619ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_21786b6f-d071-4762-9de6-138ef833b3de: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin-single"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:8123'/> <propval type="astring" name="ch_binary" value='/opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
16922024-11-25T19:30:59.620ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_21786b6f-d071-4762-9de6-138ef833b3de zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_clickhouse_21786b6f-d071-4762-9de6-138ef833b3de
16932024-11-25T19:30:59.676ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_863e78e3-a753-4fb2-97de-c46023f03292") failed: Property not found. retry in 1.068152814s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_863e78e3-a753-4fb2-97de-c46023f03292
16942024-11-25T19:30:59.688ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a33ba47-8706-4469-959c-acd4a6a8404e") failed: Property not found. retry in 1.439516454s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a33ba47-8706-4469-959c-acd4a6a8404e
16952024-11-25T19:30:59.738ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3") failed: Property not found. retry in 1.146155392s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3
16962024-11-25T19:30:59.769ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037") failed: Property not found. retry in 984.205827ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
16972024-11-25T19:30:59.782ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1287099d-2056-4e10-99e5-632481da2c2b") failed: Property not found. retry in 813.128816ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1287099d-2056-4e10-99e5-632481da2c2b
16982024-11-25T19:30:59.796ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6b3cbeea-c72e-481d-a7a1-e27c601ccb03") failed: Property not found. retry in 1.07330333s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6b3cbeea-c72e-481d-a7a1-e27c601ccb03
16992024-11-25T19:30:59.844ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7c96e2c2-1643-4666-b1e3-92a7f608b3f8") failed: Property not found. retry in 769.270529ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7c96e2c2-1643-4666-b1e3-92a7f608b3f8
17002024-11-25T19:30:59.853ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_21786b6f-d071-4762-9de6-138ef833b3de") failed: Property not found. retry in 49.784891ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_21786b6f-d071-4762-9de6-138ef833b3de
17012024-11-25T19:30:59.899ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0a80d709-bf2b-457a-9df6-b7c61cf35e54") failed: Property not found. retry in 1.316300571s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0a80d709-bf2b-457a-9df6-b7c61cf35e54
17022024-11-25T19:30:59.911ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1d808376-6b5a-46f0-b373-d7ba578556eb") failed: Property not found. retry in 1.433888481s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1d808376-6b5a-46f0-b373-d7ba578556eb
17032024-11-25T19:30:59.921ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_21786b6f-d071-4762-9de6-138ef833b3de") failed: Property not found. retry in 92.921211ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_21786b6f-d071-4762-9de6-138ef833b3de
17042024-11-25T19:30:59.931ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7db61d8a-2b76-4a38-9be0-42b379308323") failed: Property not found. retry in 562.106094ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7db61d8a-2b76-4a38-9be0-42b379308323
17052024-11-25T19:31:00.027ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9bea4b41-0e61-416b-9a60-0c3dff58b905") failed: Property not found. retry in 1.025753452s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9bea4b41-0e61-416b-9a60-0c3dff58b905
17062024-11-25T19:31:00.078ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_4f833d1f-8a98-4545-91ff-69d713fdd1f0") failed: Property not found. retry in 737.128633ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_4f833d1f-8a98-4545-91ff-69d713fdd1f0
17072024-11-25T19:31:00.111ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6f634f5-3528-4e41-966f-f47648523f6a") failed: Property not found. retry in 1.185853066s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6f634f5-3528-4e41-966f-f47648523f6a
17082024-11-25T19:31:00.166ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_21786b6f-d071-4762-9de6-138ef833b3de") failed: Property not found. retry in 227.685525ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_21786b6f-d071-4762-9de6-138ef833b3de
17092024-11-25T19:31:00.243ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42cf72f4-fa5d-45b0-b91f-af1c2e33690d") failed: Property not found. retry in 1.032615401s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42cf72f4-fa5d-45b0-b91f-af1c2e33690d
17102024-11-25T19:31:00.322ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67") failed: Property not found. retry in 634.051282ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67
17112024-11-25T19:31:00.405ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_21786b6f-d071-4762-9de6-138ef833b3de") failed: Property not found. retry in 563.020508ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_21786b6f-d071-4762-9de6-138ef833b3de
17122024-11-25T19:31:00.503ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7db61d8a-2b76-4a38-9be0-42b379308323") failed: Property not found. retry in 1.087399245s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7db61d8a-2b76-4a38-9be0-42b379308323
17132024-11-25T19:31:00.606ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1287099d-2056-4e10-99e5-632481da2c2b") failed: Property not found. retry in 1.349454865s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1287099d-2056-4e10-99e5-632481da2c2b
17142024-11-25T19:31:00.623ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7c96e2c2-1643-4666-b1e3-92a7f608b3f8") failed: Property not found. retry in 627.974947ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7c96e2c2-1643-4666-b1e3-92a7f608b3f8
17152024-11-25T19:31:00.633ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_234660ab-07d6-46bf-8748-19a6e4eb0d61") failed: Property not found. retry in 1.172155314s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_234660ab-07d6-46bf-8748-19a6e4eb0d61
17162024-11-25T19:31:00.722ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5e357e48-2959-4886-8b9d-557b95c45fb7") failed: Property not found. retry in 1.485292892s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5e357e48-2959-4886-8b9d-557b95c45fb7
17172024-11-25T19:31:00.754ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_863e78e3-a753-4fb2-97de-c46023f03292") failed: Property not found. retry in 531.451302ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_863e78e3-a753-4fb2-97de-c46023f03292
17182024-11-25T19:31:00.766ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037") failed: Property not found. retry in 1.083266347s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
17192024-11-25T19:31:00.824ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_4f833d1f-8a98-4545-91ff-69d713fdd1f0") failed: Property not found. retry in 511.575302ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_4f833d1f-8a98-4545-91ff-69d713fdd1f0
17202024-11-25T19:31:00.837ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fa3bd66a-1a51-4937-9188-36e5fc334f7c") failed: Property not found. retry in 615.019296ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fa3bd66a-1a51-4937-9188-36e5fc334f7c
17212024-11-25T19:31:00.879ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6b3cbeea-c72e-481d-a7a1-e27c601ccb03") failed: Property not found. retry in 1.207974135s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6b3cbeea-c72e-481d-a7a1-e27c601ccb03
17222024-11-25T19:31:00.893ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3") failed: Property not found. retry in 1.052843208s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3
17232024-11-25T19:31:00.965ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67") failed: Property not found. retry in 862.65832ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67
17242024-11-25T19:31:00.978ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_21786b6f-d071-4762-9de6-138ef833b3de") failed: Property not found. retry in 1.174372605s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_21786b6f-d071-4762-9de6-138ef833b3de
17252024-11-25T19:31:01.064ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9bea4b41-0e61-416b-9a60-0c3dff58b905") failed: Property not found. retry in 952.923768ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9bea4b41-0e61-416b-9a60-0c3dff58b905
17262024-11-25T19:31:01.137ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a33ba47-8706-4469-959c-acd4a6a8404e") failed: Property not found. retry in 579.822071ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a33ba47-8706-4469-959c-acd4a6a8404e
17272024-11-25T19:31:01.225ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0a80d709-bf2b-457a-9df6-b7c61cf35e54") failed: Property not found. retry in 1.363998902s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0a80d709-bf2b-457a-9df6-b7c61cf35e54
17282024-11-25T19:31:01.259ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7c96e2c2-1643-4666-b1e3-92a7f608b3f8") failed: Property not found. retry in 599.43319ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7c96e2c2-1643-4666-b1e3-92a7f608b3f8
17292024-11-25T19:31:01.285ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42cf72f4-fa5d-45b0-b91f-af1c2e33690d") failed: Property not found. retry in 1.207672811s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42cf72f4-fa5d-45b0-b91f-af1c2e33690d
17302024-11-25T19:31:01.295ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_863e78e3-a753-4fb2-97de-c46023f03292") failed: Property not found. retry in 751.792863ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_863e78e3-a753-4fb2-97de-c46023f03292
17312024-11-25T19:31:01.306ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6f634f5-3528-4e41-966f-f47648523f6a") failed: Property not found. retry in 1.247530439s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6f634f5-3528-4e41-966f-f47648523f6a
17322024-11-25T19:31:01.344ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_4f833d1f-8a98-4545-91ff-69d713fdd1f0") failed: Property not found. retry in 1.35466599s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_4f833d1f-8a98-4545-91ff-69d713fdd1f0
17332024-11-25T19:31:01.356ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1d808376-6b5a-46f0-b373-d7ba578556eb") failed: Property not found. retry in 647.527315ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1d808376-6b5a-46f0-b373-d7ba578556eb
17342024-11-25T19:31:01.464ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fa3bd66a-1a51-4937-9188-36e5fc334f7c") failed: Property not found. retry in 1.478381251s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fa3bd66a-1a51-4937-9188-36e5fc334f7c
17352024-11-25T19:31:01.604ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7db61d8a-2b76-4a38-9be0-42b379308323") failed: Property not found. retry in 660.031363ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7db61d8a-2b76-4a38-9be0-42b379308323
17362024-11-25T19:31:01.734ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a33ba47-8706-4469-959c-acd4a6a8404e") failed: Property not found. retry in 801.664428ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a33ba47-8706-4469-959c-acd4a6a8404e
17372024-11-25T19:31:01.819ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_234660ab-07d6-46bf-8748-19a6e4eb0d61") failed: Property not found. retry in 541.490794ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_234660ab-07d6-46bf-8748-19a6e4eb0d61
17382024-11-25T19:31:01.840ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67") failed: Property not found. retry in 865.180943ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67
17392024-11-25T19:31:01.861ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037") failed: Property not found. retry in 1.266420922s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
17402024-11-25T19:31:01.871ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7c96e2c2-1643-4666-b1e3-92a7f608b3f8") failed: Property not found. retry in 517.606978ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7c96e2c2-1643-4666-b1e3-92a7f608b3f8
17412024-11-25T19:31:01.957ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3") failed: Property not found. retry in 504.566753ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3
17422024-11-25T19:31:01.970ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1287099d-2056-4e10-99e5-632481da2c2b") failed: Property not found. retry in 1.429270992s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1287099d-2056-4e10-99e5-632481da2c2b
17432024-11-25T19:31:02.022ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1d808376-6b5a-46f0-b373-d7ba578556eb") failed: Property not found. retry in 1.001525075s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1d808376-6b5a-46f0-b373-d7ba578556eb
17442024-11-25T19:31:02.039ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9bea4b41-0e61-416b-9a60-0c3dff58b905") failed: Property not found. retry in 502.008472ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9bea4b41-0e61-416b-9a60-0c3dff58b905
17452024-11-25T19:31:02.059ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_863e78e3-a753-4fb2-97de-c46023f03292") failed: Property not found. retry in 1.020512108s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_863e78e3-a753-4fb2-97de-c46023f03292
17462024-11-25T19:31:02.099ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6b3cbeea-c72e-481d-a7a1-e27c601ccb03") failed: Property not found. retry in 912.814537ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6b3cbeea-c72e-481d-a7a1-e27c601ccb03
17472024-11-25T19:31:02.168ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_21786b6f-d071-4762-9de6-138ef833b3de") failed: Property not found. retry in 1.287325706s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_21786b6f-d071-4762-9de6-138ef833b3de
17482024-11-25T19:31:02.223ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5e357e48-2959-4886-8b9d-557b95c45fb7") failed: Property not found. retry in 519.790845ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5e357e48-2959-4886-8b9d-557b95c45fb7
17492024-11-25T19:31:02.277ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7db61d8a-2b76-4a38-9be0-42b379308323") failed: Property not found. retry in 960.667258ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7db61d8a-2b76-4a38-9be0-42b379308323
17502024-11-25T19:31:02.374ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_234660ab-07d6-46bf-8748-19a6e4eb0d61") failed: Property not found. retry in 1.170488366s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_234660ab-07d6-46bf-8748-19a6e4eb0d61
17512024-11-25T19:31:02.402ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7c96e2c2-1643-4666-b1e3-92a7f608b3f8") failed: Property not found. retry in 1.212981793s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7c96e2c2-1643-4666-b1e3-92a7f608b3f8
17522024-11-25T19:31:02.474ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3") failed: Property not found. retry in 1.237223935s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3
17532024-11-25T19:31:02.511ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42cf72f4-fa5d-45b0-b91f-af1c2e33690d") failed: Property not found. retry in 931.130606ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42cf72f4-fa5d-45b0-b91f-af1c2e33690d
17542024-11-25T19:31:02.551ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a33ba47-8706-4469-959c-acd4a6a8404e") failed: Property not found. retry in 793.049931ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a33ba47-8706-4469-959c-acd4a6a8404e
17552024-11-25T19:31:02.566ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9bea4b41-0e61-416b-9a60-0c3dff58b905") failed: Property not found. retry in 980.231405ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9bea4b41-0e61-416b-9a60-0c3dff58b905
17562024-11-25T19:31:02.580ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6f634f5-3528-4e41-966f-f47648523f6a") failed: Property not found. retry in 1.41349574s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6f634f5-3528-4e41-966f-f47648523f6a
17572024-11-25T19:31:02.603ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0a80d709-bf2b-457a-9df6-b7c61cf35e54") failed: Property not found. retry in 528.080006ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0a80d709-bf2b-457a-9df6-b7c61cf35e54
17582024-11-25T19:31:02.716ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_4f833d1f-8a98-4545-91ff-69d713fdd1f0") failed: Property not found. retry in 890.768752ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_4f833d1f-8a98-4545-91ff-69d713fdd1f0
17592024-11-25T19:31:02.731ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67") failed: Property not found. retry in 542.867874ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67
17602024-11-25T19:31:02.756ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5e357e48-2959-4886-8b9d-557b95c45fb7") failed: Property not found. retry in 1.279093997s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5e357e48-2959-4886-8b9d-557b95c45fb7
17612024-11-25T19:31:02.956ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fa3bd66a-1a51-4937-9188-36e5fc334f7c") failed: Property not found. retry in 742.0896ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fa3bd66a-1a51-4937-9188-36e5fc334f7c
17622024-11-25T19:31:03.029ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6b3cbeea-c72e-481d-a7a1-e27c601ccb03") failed: Property not found. retry in 1.302393343s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6b3cbeea-c72e-481d-a7a1-e27c601ccb03
17632024-11-25T19:31:03.045ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1d808376-6b5a-46f0-b373-d7ba578556eb") failed: Property not found. retry in 780.586234ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1d808376-6b5a-46f0-b373-d7ba578556eb
17642024-11-25T19:31:03.096ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_863e78e3-a753-4fb2-97de-c46023f03292") failed: Property not found. retry in 696.693256ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_863e78e3-a753-4fb2-97de-c46023f03292
17652024-11-25T19:31:03.149ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037") failed: Property not found. retry in 1.336961312s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
17662024-11-25T19:31:03.168ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0a80d709-bf2b-457a-9df6-b7c61cf35e54") failed: Property not found. retry in 823.171738ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0a80d709-bf2b-457a-9df6-b7c61cf35e54
17672024-11-25T19:31:03.251ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7db61d8a-2b76-4a38-9be0-42b379308323") failed: Property not found. retry in 604.484547ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7db61d8a-2b76-4a38-9be0-42b379308323
17682024-11-25T19:31:03.286ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67") failed: Property not found. retry in 1.065347854s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67
17692024-11-25T19:31:03.358ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a33ba47-8706-4469-959c-acd4a6a8404e") failed: Property not found. retry in 641.484973ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a33ba47-8706-4469-959c-acd4a6a8404e
17702024-11-25T19:31:03.412ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1287099d-2056-4e10-99e5-632481da2c2b") failed: Property not found. retry in 706.652454ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1287099d-2056-4e10-99e5-632481da2c2b
17712024-11-25T19:31:03.453ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42cf72f4-fa5d-45b0-b91f-af1c2e33690d") failed: Property not found. retry in 1.317775176s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42cf72f4-fa5d-45b0-b91f-af1c2e33690d
17722024-11-25T19:31:03.466ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_21786b6f-d071-4762-9de6-138ef833b3de") failed: Property not found. retry in 906.692668ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_21786b6f-d071-4762-9de6-138ef833b3de
17732024-11-25T19:31:03.617ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_4f833d1f-8a98-4545-91ff-69d713fdd1f0") failed: Property not found. retry in 850.853779ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_4f833d1f-8a98-4545-91ff-69d713fdd1f0
17742024-11-25T19:31:03.626ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7c96e2c2-1643-4666-b1e3-92a7f608b3f8") failed: Property not found. retry in 1.459797933s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7c96e2c2-1643-4666-b1e3-92a7f608b3f8
17752024-11-25T19:31:03.709ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fa3bd66a-1a51-4937-9188-36e5fc334f7c") failed: Property not found. retry in 1.292718566s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fa3bd66a-1a51-4937-9188-36e5fc334f7c
17762024-11-25T19:31:03.721ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3") failed: Property not found. retry in 684.971924ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3
17772024-11-25T19:31:03.803ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_863e78e3-a753-4fb2-97de-c46023f03292") failed: Property not found. retry in 1.340727009s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_863e78e3-a753-4fb2-97de-c46023f03292
17782024-11-25T19:31:03.835ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1d808376-6b5a-46f0-b373-d7ba578556eb") failed: Property not found. retry in 960.533222ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1d808376-6b5a-46f0-b373-d7ba578556eb
17792024-11-25T19:31:03.867ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7db61d8a-2b76-4a38-9be0-42b379308323") failed: Property not found. retry in 780.160416ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7db61d8a-2b76-4a38-9be0-42b379308323
17802024-11-25T19:31:04.001ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0a80d709-bf2b-457a-9df6-b7c61cf35e54") failed: Property not found. retry in 992.382274ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0a80d709-bf2b-457a-9df6-b7c61cf35e54
17812024-11-25T19:31:04.011ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6f634f5-3528-4e41-966f-f47648523f6a") failed: Property not found. retry in 1.347858233s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6f634f5-3528-4e41-966f-f47648523f6a
17822024-11-25T19:31:04.022ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a33ba47-8706-4469-959c-acd4a6a8404e") failed: Property not found. retry in 1.386019489s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a33ba47-8706-4469-959c-acd4a6a8404e
17832024-11-25T19:31:04.046ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5e357e48-2959-4886-8b9d-557b95c45fb7") failed: Property not found. retry in 689.961524ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5e357e48-2959-4886-8b9d-557b95c45fb7
17842024-11-25T19:31:04.129ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1287099d-2056-4e10-99e5-632481da2c2b") failed: Property not found. retry in 1.175261846s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1287099d-2056-4e10-99e5-632481da2c2b
17852024-11-25T19:31:04.343ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6b3cbeea-c72e-481d-a7a1-e27c601ccb03") failed: Property not found. retry in 970.68952ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6b3cbeea-c72e-481d-a7a1-e27c601ccb03
17862024-11-25T19:31:04.364ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67") failed: Property not found. retry in 1.410317821s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67
17872024-11-25T19:31:04.384ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_21786b6f-d071-4762-9de6-138ef833b3de") failed: Property not found. retry in 1.256884393s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_21786b6f-d071-4762-9de6-138ef833b3de
17882024-11-25T19:31:04.418ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3") failed: Property not found. retry in 1.047559199s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3
17892024-11-25T19:31:04.482ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_4f833d1f-8a98-4545-91ff-69d713fdd1f0") failed: Property not found. retry in 889.592033ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_4f833d1f-8a98-4545-91ff-69d713fdd1f0
17902024-11-25T19:31:04.501ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037") failed: Property not found. retry in 1.187209812s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
17912024-11-25T19:31:04.661ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7db61d8a-2b76-4a38-9be0-42b379308323") failed: Property not found. retry in 855.681648ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7db61d8a-2b76-4a38-9be0-42b379308323
17922024-11-25T19:31:04.748ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5e357e48-2959-4886-8b9d-557b95c45fb7") failed: Property not found. retry in 905.829599ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5e357e48-2959-4886-8b9d-557b95c45fb7
17932024-11-25T19:31:04.784ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42cf72f4-fa5d-45b0-b91f-af1c2e33690d") failed: Property not found. retry in 1.360176841s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42cf72f4-fa5d-45b0-b91f-af1c2e33690d
17942024-11-25T19:31:04.808ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1d808376-6b5a-46f0-b373-d7ba578556eb") failed: Property not found. retry in 879.248115ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1d808376-6b5a-46f0-b373-d7ba578556eb
17952024-11-25T19:31:05.007ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0a80d709-bf2b-457a-9df6-b7c61cf35e54") failed: Property not found. retry in 628.799522ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0a80d709-bf2b-457a-9df6-b7c61cf35e54
17962024-11-25T19:31:05.018ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fa3bd66a-1a51-4937-9188-36e5fc334f7c") failed: Property not found. retry in 985.212071ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fa3bd66a-1a51-4937-9188-36e5fc334f7c
17972024-11-25T19:31:05.097ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7c96e2c2-1643-4666-b1e3-92a7f608b3f8") failed: Property not found. retry in 936.059506ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7c96e2c2-1643-4666-b1e3-92a7f608b3f8
17982024-11-25T19:31:05.158ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_863e78e3-a753-4fb2-97de-c46023f03292") failed: Property not found. retry in 554.31474ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_863e78e3-a753-4fb2-97de-c46023f03292
17992024-11-25T19:31:05.316ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1287099d-2056-4e10-99e5-632481da2c2b") failed: Property not found. retry in 1.379498108s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1287099d-2056-4e10-99e5-632481da2c2b
18002024-11-25T19:31:05.326ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6b3cbeea-c72e-481d-a7a1-e27c601ccb03") failed: Property not found. retry in 946.444862ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6b3cbeea-c72e-481d-a7a1-e27c601ccb03
18012024-11-25T19:31:05.371ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6f634f5-3528-4e41-966f-f47648523f6a") failed: Property not found. retry in 1.190116576s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6f634f5-3528-4e41-966f-f47648523f6a
18022024-11-25T19:31:05.385ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_4f833d1f-8a98-4545-91ff-69d713fdd1f0") failed: Property not found. retry in 795.049303ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_4f833d1f-8a98-4545-91ff-69d713fdd1f0
18032024-11-25T19:31:05.420ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a33ba47-8706-4469-959c-acd4a6a8404e") failed: Property not found. retry in 974.082014ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a33ba47-8706-4469-959c-acd4a6a8404e
18042024-11-25T19:31:05.477ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3") failed: Property not found. retry in 567.633647ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3
18052024-11-25T19:31:05.684ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_21786b6f-d071-4762-9de6-138ef833b3de") failed: Property not found. retry in 1.311421201s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_21786b6f-d071-4762-9de6-138ef833b3de
18062024-11-25T19:31:05.734ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_863e78e3-a753-4fb2-97de-c46023f03292") failed: Property not found. retry in 1.196280068s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_863e78e3-a753-4fb2-97de-c46023f03292
18072024-11-25T19:31:05.792ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67") failed: Property not found. retry in 1.472491216s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67
18082024-11-25T19:31:07.012ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_21786b6f-d071-4762-9de6-138ef833b3de") failed: Property not found. retry in 1.383881586s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_21786b6f-d071-4762-9de6-138ef833b3de
18092024-11-25T19:31:08.416ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_21786b6f-d071-4762-9de6-138ef833b3de") failed: Property not found. retry in 812.417543ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_21786b6f-d071-4762-9de6-138ef833b3de
18102024-11-25T19:31:09.283ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_crucible_7c96e2c2-1643-4666-b1e3-92a7f608b3f8
18112024-11-25T19:31:09.283ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_crucible_863e78e3-a753-4fb2-97de-c46023f03292
18122024-11-25T19:31:09.283ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_crucible_fa3bd66a-1a51-4937-9188-36e5fc334f7c
18132024-11-25T19:31:09.283ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_crucible_7db61d8a-2b76-4a38-9be0-42b379308323
18142024-11-25T19:31:09.283ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_crucible_34fd6dc9-ab3e-4062-b891-fdd4c6d2c5b3
18152024-11-25T19:31:09.283ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_crucible_1287099d-2056-4e10-99e5-632481da2c2b
18162024-11-25T19:31:09.283ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_oximeter_4f833d1f-8a98-4545-91ff-69d713fdd1f0
18172024-11-25T19:31:09.283ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_external_dns_6b3cbeea-c72e-481d-a7a1-e27c601ccb03
18182024-11-25T19:31:09.283ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_nexus_29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
18192024-11-25T19:31:09.283ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_crucible_pantry_9bea4b41-0e61-416b-9a60-0c3dff58b905
18202024-11-25T19:31:09.283ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_crucible_pantry_234660ab-07d6-46bf-8748-19a6e4eb0d61
18212024-11-25T19:31:09.283ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_crucible_pantry_0a80d709-bf2b-457a-9df6-b7c61cf35e54
18222024-11-25T19:31:09.283ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_crucible_d6f634f5-3528-4e41-966f-f47648523f6a
18232024-11-25T19:31:09.283ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_external_dns_5e357e48-2959-4886-8b9d-557b95c45fb7
18242024-11-25T19:31:09.283ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_nexus_a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67
18252024-11-25T19:31:09.283ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_nexus_1d808376-6b5a-46f0-b373-d7ba578556eb
18262024-11-25T19:31:09.283ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_clickhouse_21786b6f-d071-4762-9de6-138ef833b3de
18272024-11-25T19:31:09.283ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_crucible_42cf72f4-fa5d-45b0-b91f-af1c2e33690d
18282024-11-25T19:31:09.283ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_crucible_3a33ba47-8706-4469-959c-acd4a6a8404e
18292024-11-25T19:31:09.284ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/dd272387-9bb6-475e-8ebb-47dcac6d1d2a/config/.omicron-zones.json.tmp file = common/src/ledger.rs:200
18302024-11-25T19:31:09.290ZINFOSledAgent (ServiceManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/dd272387-9bb6-475e-8ebb-47dcac6d1d2a/config/omicron-zones.json"
18312024-11-25T19:31:09.291ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/a4bf8354-b44e-436c-b4f2-9bd494b77342/config/.omicron-zones.json.tmp file = common/src/ledger.rs:200
18322024-11-25T19:31:09.294ZINFOSledAgent (ServiceManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/a4bf8354-b44e-436c-b4f2-9bd494b77342/config/omicron-zones.json"
18332024-11-25T19:31:09.295ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48573088 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:49163 req_id = 31a141df-4358-43a6-ad7c-3b996e280a3a response_code = 204 uri = /omicron-zones
18342024-11-25T19:31:09.308ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1448
18352024-11-25T19:31:09.310ZINFOSledAgent (RSS): Writing ledger to /pool/int/dd272387-9bb6-475e-8ebb-47dcac6d1d2a/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:200
18362024-11-25T19:31:09.310ZINFOSledAgent (RSS): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/dd272387-9bb6-475e-8ebb-47dcac6d1d2a/config/rss-plan-completed.marker"
18372024-11-25T19:31:09.310ZINFOSledAgent (RSS): Writing ledger to /pool/int/a4bf8354-b44e-436c-b4f2-9bd494b77342/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:200
18382024-11-25T19:31:09.310ZINFOSledAgent (RSS): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/a4bf8354-b44e-436c-b4f2-9bd494b77342/config/rss-plan-completed.marker"
18392024-11-25T19:31:09.516ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:787
18402024-11-25T19:31:09.518ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::b]:12221 file = sled-agent/src/rack_setup/service.rs:799
18412024-11-25T19:31:09.555ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, rib_priority: None, vlan_id: None, }, ], switch: Switch0, tx_eq: None, uplink_port_fec: Some( None, ), uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:1013
18422024-11-25T19:31:09.563ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
18432024-11-25T19:31:09.564ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 18.857377295s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
18442024-11-25T19:31:09.622ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
18452024-11-25T19:31:09.692ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
18462024-11-25T19:31:09.766ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
18472024-11-25T19:31:10.006ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
18482024-11-25T19:31:10.222ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
18492024-11-25T19:31:10.399ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
18502024-11-25T19:31:10.821ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
18512024-11-25T19:31:11.345ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
18522024-11-25T19:31:11.638ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
18532024-11-25T19:31:12.356ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
18542024-11-25T19:31:13.145ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
18552024-11-25T19:31:14.241ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
18562024-11-25T19:31:15.691ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "3c47d5a2-bfff-48f3-a063-ac481a76e992", "content-length": "173", "date": "Mon, 25 Nov 2024 19:31:15 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c\"", request_id: "3c47d5a2-bfff-48f3-a063-ac481a76e992" } file = sled-agent/src/rack_setup/service.rs:1075
18572024-11-25T19:31:16.703ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "ac9c8ba7-7b2e-4692-9a04-5cfa36b6d0a6", "content-length": "173", "date": "Mon, 25 Nov 2024 19:31:16 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c\"", request_id: "ac9c8ba7-7b2e-4692-9a04-5cfa36b6d0a6" } file = sled-agent/src/rack_setup/service.rs:1075
18582024-11-25T19:31:19.245ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "ccf9a2fc-d510-4af7-841e-c1212a491b5a", "content-length": "173", "date": "Mon, 25 Nov 2024 19:31:18 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"38711855-ef69-4d79-bb75-aebd85b1280b\"", request_id: "ccf9a2fc-d510-4af7-841e-c1212a491b5a" } file = sled-agent/src/rack_setup/service.rs:1075
18592024-11-25T19:31:20.904ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:38954
18602024-11-25T19:31:20.905ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 28 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:38954 req_id = 48088876-ace1-4c11-a11a-ef5b13d35342 response_code = 200 uri = /baseboard
18612024-11-25T19:31:21.670ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "35cea67c-2c12-4b64-adee-ad9d9417d63d", "content-length": "173", "date": "Mon, 25 Nov 2024 19:31:21 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"38711855-ef69-4d79-bb75-aebd85b1280b\"", request_id: "35cea67c-2c12-4b64-adee-ad9d9417d63d" } file = sled-agent/src/rack_setup/service.rs:1075
18622024-11-25T19:31:24.472ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "93ed4652-1815-4a8c-a692-6a207c9bc365", "content-length": "173", "date": "Mon, 25 Nov 2024 19:31:24 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"38711855-ef69-4d79-bb75-aebd85b1280b\"", request_id: "93ed4652-1815-4a8c-a692-6a207c9bc365" } file = sled-agent/src/rack_setup/service.rs:1075
18632024-11-25T19:31:26.567ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "8cc7d22e-8220-4952-9668-db22842da52e", "content-length": "173", "date": "Mon, 25 Nov 2024 19:31:26 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"38711855-ef69-4d79-bb75-aebd85b1280b\"", request_id: "8cc7d22e-8220-4952-9668-db22842da52e" } file = sled-agent/src/rack_setup/service.rs:1075
18642024-11-25T19:31:30.467ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "5092a5c3-ca41-49c9-bac6-e263a87ac15d", "content-length": "173", "date": "Mon, 25 Nov 2024 19:31:29 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"38711855-ef69-4d79-bb75-aebd85b1280b\"", request_id: "5092a5c3-ca41-49c9-bac6-e263a87ac15d" } file = sled-agent/src/rack_setup/service.rs:1075
18652024-11-25T19:31:33.350ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:500 new_generation = 1 old_generation = 1 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
18662024-11-25T19:31:33.996ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62702
18672024-11-25T19:31:33.999ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
18682024-11-25T19:31:33.999ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
18692024-11-25T19:31:33.999ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/dd272387-9bb6-475e-8ebb-47dcac6d1d2a/config/omicron-zones.json file = common/src/ledger.rs:178
18702024-11-25T19:31:34.000ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/a4bf8354-b44e-436c-b4f2-9bd494b77342/config/omicron-zones.json file = common/src/ledger.rs:178
18712024-11-25T19:31:34.014ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 71fa9360-75cf-491a-b7ef-fd270ae2f32c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18722024-11-25T19:31:34.014ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_71fa9360-75cf-491a-b7ef-fd270ae2f32c
18732024-11-25T19:31:34.040ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: cc26c009-a951-4771-a26a-f2513b9e63e2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18742024-11-25T19:31:34.040ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_cc26c009-a951-4771-a26a-f2513b9e63e2
18752024-11-25T19:31:34.063ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 56aea45f-c451-4174-9b8f-66145c2696e8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18762024-11-25T19:31:34.063ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_56aea45f-c451-4174-9b8f-66145c2696e8
18772024-11-25T19:31:34.086ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d7af1128-7206-4198-91cb-ef632ea8556e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18782024-11-25T19:31:34.086ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_d7af1128-7206-4198-91cb-ef632ea8556e
18792024-11-25T19:31:34.105ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44597
18802024-11-25T19:31:34.107ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: fe712103-328f-4ff5-a621-99ae42de7f00 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18812024-11-25T19:31:34.107ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_fe712103-328f-4ff5-a621-99ae42de7f00
18822024-11-25T19:31:34.115ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: d231a61b-6b3d-4ea9-b8ff-35ab162113d2, kind: Service { id: 5e357e48-2959-4886-8b9d-557b95c45fb7 }, name: Name("external-dns-5e357e48-2959-4886-8b9d-557b95c45fb7"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 225, 146])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f04f2a94-1775-401c-8f4b-f933311d21a8, kind: Service { id: 6b3cbeea-c72e-481d-a7a1-e27c601ccb03 }, name: Name("external-dns-6b3cbeea-c72e-481d-a7a1-e27c601ccb03"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 175, 189])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5304be8f-eb23-4485-b885-5b368db0b5b6, kind: Service { id: 1d808376-6b5a-46f0-b373-d7ba578556eb }, name: Name("nexus-1d808376-6b5a-46f0-b373-d7ba578556eb"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 88])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7c489787-90c9-4b93-99c1-8a1f226c1096, kind: Service { id: a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67 }, name: Name("nexus-a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 161, 21])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d755e6b0-59ef-4a09-9894-b39bfb858111, kind: Service { id: 29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037 }, name: Name("nexus-29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 3])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18832024-11-25T19:31:34.115ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18842024-11-25T19:31:34.115ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18852024-11-25T19:31:34.115ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
18862024-11-25T19:31:34.115ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18872024-11-25T19:31:34.115ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18882024-11-25T19:31:34.115ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18892024-11-25T19:31:34.115ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10005 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44597 req_id = 748d5700-584a-4ca0-98d0-fcba3324f1e6 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18902024-11-25T19:31:34.117ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:1085
18912024-11-25T19:31:34.133ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ca727341-d003-494b-b98d-9fa5b5aeeec8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18922024-11-25T19:31:34.133ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_ca727341-d003-494b-b98d-9fa5b5aeeec8
18932024-11-25T19:31:34.157ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1b4c5120-bb11-444d-9c86-edb04be1264c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18942024-11-25T19:31:34.157ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_1b4c5120-bb11-444d-9c86-edb04be1264c
18952024-11-25T19:31:34.180ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: df57d550-ef00-4438-9a9e-b1b08bdaa525 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18962024-11-25T19:31:34.180ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_df57d550-ef00-4438-9a9e-b1b08bdaa525
18972024-11-25T19:31:34.203ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2517e8b2-3022-4575-a6ad-4786cce7adb4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18982024-11-25T19:31:34.203ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_2517e8b2-3022-4575-a6ad-4786cce7adb4
18992024-11-25T19:31:34.216ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 220405 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62702 req_id = 8240c3a1-474e-46cc-bf98-dd9103359844 response_code = 200 uri = /inventory
19002024-11-25T19:31:34.265ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41454
19012024-11-25T19:31:34.266ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
19022024-11-25T19:31:34.266ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
19032024-11-25T19:31:34.266ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/dd272387-9bb6-475e-8ebb-47dcac6d1d2a/config/omicron-zones.json file = common/src/ledger.rs:178
19042024-11-25T19:31:34.267ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/a4bf8354-b44e-436c-b4f2-9bd494b77342/config/omicron-zones.json file = common/src/ledger.rs:178
19052024-11-25T19:31:34.278ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 71fa9360-75cf-491a-b7ef-fd270ae2f32c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19062024-11-25T19:31:34.278ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_71fa9360-75cf-491a-b7ef-fd270ae2f32c
19072024-11-25T19:31:34.302ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: cc26c009-a951-4771-a26a-f2513b9e63e2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19082024-11-25T19:31:34.302ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_cc26c009-a951-4771-a26a-f2513b9e63e2
19092024-11-25T19:31:34.324ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 56aea45f-c451-4174-9b8f-66145c2696e8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19102024-11-25T19:31:34.324ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_56aea45f-c451-4174-9b8f-66145c2696e8
19112024-11-25T19:31:34.344ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d7af1128-7206-4198-91cb-ef632ea8556e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19122024-11-25T19:31:34.344ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_d7af1128-7206-4198-91cb-ef632ea8556e
19132024-11-25T19:31:34.364ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: fe712103-328f-4ff5-a621-99ae42de7f00 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19142024-11-25T19:31:34.364ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_fe712103-328f-4ff5-a621-99ae42de7f00
19152024-11-25T19:31:34.386ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ca727341-d003-494b-b98d-9fa5b5aeeec8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19162024-11-25T19:31:34.386ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_ca727341-d003-494b-b98d-9fa5b5aeeec8
19172024-11-25T19:31:34.411ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1b4c5120-bb11-444d-9c86-edb04be1264c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19182024-11-25T19:31:34.411ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_1b4c5120-bb11-444d-9c86-edb04be1264c
19192024-11-25T19:31:34.435ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: df57d550-ef00-4438-9a9e-b1b08bdaa525 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19202024-11-25T19:31:34.435ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_df57d550-ef00-4438-9a9e-b1b08bdaa525
19212024-11-25T19:31:34.460ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2517e8b2-3022-4575-a6ad-4786cce7adb4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19222024-11-25T19:31:34.461ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_2517e8b2-3022-4575-a6ad-4786cce7adb4
19232024-11-25T19:31:34.474ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 208705 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41454 req_id = 611c6461-1fc7-4bc6-8081-79d090325b08 response_code = 200 uri = /inventory
19242024-11-25T19:31:34.803ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60114
19252024-11-25T19:31:34.803ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: d231a61b-6b3d-4ea9-b8ff-35ab162113d2, kind: Service { id: 5e357e48-2959-4886-8b9d-557b95c45fb7 }, name: Name("external-dns-5e357e48-2959-4886-8b9d-557b95c45fb7"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 225, 146])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f04f2a94-1775-401c-8f4b-f933311d21a8, kind: Service { id: 6b3cbeea-c72e-481d-a7a1-e27c601ccb03 }, name: Name("external-dns-6b3cbeea-c72e-481d-a7a1-e27c601ccb03"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 175, 189])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5304be8f-eb23-4485-b885-5b368db0b5b6, kind: Service { id: 1d808376-6b5a-46f0-b373-d7ba578556eb }, name: Name("nexus-1d808376-6b5a-46f0-b373-d7ba578556eb"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 88])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7c489787-90c9-4b93-99c1-8a1f226c1096, kind: Service { id: a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67 }, name: Name("nexus-a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 161, 21])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d755e6b0-59ef-4a09-9894-b39bfb858111, kind: Service { id: 29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037 }, name: Name("nexus-29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 3])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
19262024-11-25T19:31:34.803ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19272024-11-25T19:31:34.803ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19282024-11-25T19:31:34.803ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
19292024-11-25T19:31:34.803ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19302024-11-25T19:31:34.803ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19312024-11-25T19:31:34.803ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19322024-11-25T19:31:34.803ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 306 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60114 req_id = 35d031c3-af77-4996-a504-34272ef0fc7e response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
19332024-11-25T19:31:34.919ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41139
19342024-11-25T19:31:34.919ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: d231a61b-6b3d-4ea9-b8ff-35ab162113d2, kind: Service { id: 5e357e48-2959-4886-8b9d-557b95c45fb7 }, name: Name("external-dns-5e357e48-2959-4886-8b9d-557b95c45fb7"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 225, 146])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f04f2a94-1775-401c-8f4b-f933311d21a8, kind: Service { id: 6b3cbeea-c72e-481d-a7a1-e27c601ccb03 }, name: Name("external-dns-6b3cbeea-c72e-481d-a7a1-e27c601ccb03"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 175, 189])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5304be8f-eb23-4485-b885-5b368db0b5b6, kind: Service { id: 1d808376-6b5a-46f0-b373-d7ba578556eb }, name: Name("nexus-1d808376-6b5a-46f0-b373-d7ba578556eb"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 88])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7c489787-90c9-4b93-99c1-8a1f226c1096, kind: Service { id: a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67 }, name: Name("nexus-a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 161, 21])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d755e6b0-59ef-4a09-9894-b39bfb858111, kind: Service { id: 29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037 }, name: Name("nexus-29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 3])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
19352024-11-25T19:31:34.919ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19362024-11-25T19:31:34.919ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19372024-11-25T19:31:34.919ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
19382024-11-25T19:31:34.919ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19392024-11-25T19:31:34.919ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19402024-11-25T19:31:34.919ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19412024-11-25T19:31:34.919ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 202 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41139 req_id = 06de0c69-39f0-4295-9437-6bd0327351e2 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
19422024-11-25T19:31:35.653ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39877
19432024-11-25T19:31:35.653ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: d231a61b-6b3d-4ea9-b8ff-35ab162113d2, kind: Service { id: 5e357e48-2959-4886-8b9d-557b95c45fb7 }, name: Name("external-dns-5e357e48-2959-4886-8b9d-557b95c45fb7"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 225, 146])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f04f2a94-1775-401c-8f4b-f933311d21a8, kind: Service { id: 6b3cbeea-c72e-481d-a7a1-e27c601ccb03 }, name: Name("external-dns-6b3cbeea-c72e-481d-a7a1-e27c601ccb03"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 175, 189])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5304be8f-eb23-4485-b885-5b368db0b5b6, kind: Service { id: 1d808376-6b5a-46f0-b373-d7ba578556eb }, name: Name("nexus-1d808376-6b5a-46f0-b373-d7ba578556eb"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 88])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7c489787-90c9-4b93-99c1-8a1f226c1096, kind: Service { id: a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67 }, name: Name("nexus-a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 161, 21])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d755e6b0-59ef-4a09-9894-b39bfb858111, kind: Service { id: 29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037 }, name: Name("nexus-29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 3])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
19442024-11-25T19:31:35.653ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19452024-11-25T19:31:35.653ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19462024-11-25T19:31:35.653ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
19472024-11-25T19:31:35.653ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19482024-11-25T19:31:35.654ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19492024-11-25T19:31:35.654ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19502024-11-25T19:31:35.654ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 233 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39877 req_id = a4bd9ea3-172a-4bcc-8de4-0dfae5dfeae0 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
19512024-11-25T19:31:37.353ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:49777 remote_addr = [fd00:1122:3344:101::d]:58688 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
19522024-11-25T19:31:37.370ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 15963 local_addr = [fd00:1122:3344:101::1]:49777 method = GET remote_addr = [fd00:1122:3344:101::d]:58688 req_id = 274dc15f-3008-4483-a9e6-47f1dd6c3cbe response_code = 200 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b uri = /38711855-ef69-4d79-bb75-aebd85b1280b
19532024-11-25T19:31:42.371ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50469
19542024-11-25T19:31:42.373ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1548 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50469 req_id = 9c623130-ac0d-4c81-a4da-b91fc2b51bf0 response_code = 200 uri = /vpc-routes
19552024-11-25T19:31:42.411ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b values = ExternalIpGatewayMap { mappings: {} }
19562024-11-25T19:31:42.411ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 293 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50469 req_id = e2523d28-b4ae-4859-8eb5-eb79aaab4443 response_code = 204 uri = /eip-gateways
19572024-11-25T19:31:42.500ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3159 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50469 req_id = 7014bfea-9f6e-4c0e-ad9c-2e40ddd41f3b response_code = 204 uri = /vpc-routes
19582024-11-25T19:31:46.425ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44227
19592024-11-25T19:31:46.425ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44227 req_id = e20ee6fe-cd5f-4d39-98c9-60cdf81d93e2 response_code = 200 uri = /vpc-routes
19602024-11-25T19:31:46.455ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58520
19612024-11-25T19:31:46.457ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1441 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58520 req_id = 38655f55-8228-4af3-8dd2-065a0b09a20b response_code = 200 uri = /v2p
19622024-11-25T19:31:46.509ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b values = ExternalIpGatewayMap { mappings: {} }
19632024-11-25T19:31:46.509ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44227 req_id = 97c0ad29-754c-41bd-9f8d-464dc29f7f22 response_code = 204 uri = /eip-gateways
19642024-11-25T19:31:46.519ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 253 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44227 req_id = a5dc3f86-86e5-423a-9f6a-f04242b84b6d response_code = 204 uri = /vpc-routes
19652024-11-25T19:31:46.626ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51383
19662024-11-25T19:31:46.626ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4173
19672024-11-25T19:31:46.712ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4197
19682024-11-25T19:31:46.772ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 145902 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:51383 req_id = 566daa98-653c-4846-8ef1-8a591523e666 response_code = 204 uri = /switch-ports
19692024-11-25T19:31:46.772ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 263 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51383 req_id = c8143653-a50d-4ae4-8c7f-1e8ed0e23a5a response_code = 200 uri = /network-bootstore-config
19702024-11-25T19:31:46.803ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
19712024-11-25T19:31:46.803ZINFOSledAgent (bootstore): Writing ledger to /pool/int/dd272387-9bb6-475e-8ebb-47dcac6d1d2a/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:200 peer_id = pc-buskin-i86pc
19722024-11-25T19:31:46.805ZINFOSledAgent (bootstore): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/dd272387-9bb6-475e-8ebb-47dcac6d1d2a/cluster/bootstore-network-config.json" peer_id = pc-buskin-i86pc
19732024-11-25T19:31:46.805ZINFOSledAgent (bootstore): Writing ledger to /pool/int/a4bf8354-b44e-436c-b4f2-9bd494b77342/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:200 peer_id = pc-buskin-i86pc
19742024-11-25T19:31:46.806ZINFOSledAgent (bootstore): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/a4bf8354-b44e-436c-b4f2-9bd494b77342/cluster/bootstore-network-config.json" peer_id = pc-buskin-i86pc
19752024-11-25T19:31:46.806ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
19762024-11-25T19:31:46.806ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3513 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51383 req_id = 74bed0f7-0732-4619-8fc8-39604dda33c7 response_code = 204 uri = /network-bootstore-config
19772024-11-25T19:31:46.979ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47229
19782024-11-25T19:31:46.980ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47229 req_id = 46852e34-f796-4c62-a486-b50e934ae9ea response_code = 200 uri = /vpc-routes
19792024-11-25T19:31:47.043ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b values = ExternalIpGatewayMap { mappings: {} }
19802024-11-25T19:31:47.044ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47229 req_id = d8e49daa-4384-4ce6-b0d7-f0f7400bea43 response_code = 204 uri = /eip-gateways
19812024-11-25T19:31:47.055ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 236 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47229 req_id = 01a6c43d-9afa-4ab6-843c-3022c61216bc response_code = 204 uri = /vpc-routes
19822024-11-25T19:31:47.163ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33323
19832024-11-25T19:31:47.163ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4173
19842024-11-25T19:31:47.204ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4197
19852024-11-25T19:31:47.261ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97383 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:33323 req_id = 6c19ee02-d304-4692-9d24-03ba7b92bd15 response_code = 204 uri = /switch-ports
19862024-11-25T19:31:47.261ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52263
19872024-11-25T19:31:47.261ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43703
19882024-11-25T19:31:47.261ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 238 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33323 req_id = 92713dbf-0da1-4593-acc2-c69ed1f10872 response_code = 200 uri = /network-bootstore-config
19892024-11-25T19:31:47.261ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 217 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43703 req_id = 282bf87a-8b01-4ad3-988d-b2c025eb0376 response_code = 200 uri = /v2p
19902024-11-25T19:31:47.261ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52263 req_id = f4ad4d43-72e1-422d-95b0-dffd7d0c0d05 response_code = 200 uri = /vpc-routes
19912024-11-25T19:31:47.328ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b values = ExternalIpGatewayMap { mappings: {} }
19922024-11-25T19:31:47.328ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52263 req_id = cd31e59f-20c7-4bea-8355-8bb35c079aec response_code = 204 uri = /eip-gateways
19932024-11-25T19:31:47.341ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 186 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52263 req_id = ecb0cdc1-e674-45eb-9cb7-f5840d651b79 response_code = 204 uri = /vpc-routes
19942024-11-25T19:31:47.385ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63148
19952024-11-25T19:31:47.385ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63148 req_id = 8933ba66-6dc6-47e0-b881-563f4a4d0872 response_code = 200 uri = /v2p
19962024-11-25T19:31:47.437ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59926
19972024-11-25T19:31:47.438ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4173
19982024-11-25T19:31:47.471ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4197
19992024-11-25T19:31:47.523ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85043 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:59926 req_id = ebaa11e7-89a8-4cc2-930e-55cf80e6f6a9 response_code = 204 uri = /switch-ports
20002024-11-25T19:31:47.525ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59926 req_id = 86b97c05-6d25-4c85-8a81-01c3735c874a response_code = 200 uri = /network-bootstore-config
20012024-11-25T19:31:50.940ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:34160
20022024-11-25T19:31:50.940ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:34160 req_id = 17ec717c-04ae-48e1-916e-28e129467e34 response_code = 200 uri = /baseboard
20032024-11-25T19:32:07.322ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7771 local_addr = [fd00:1122:3344:101::1]:49777 method = GET remote_addr = [fd00:1122:3344:101::d]:58688 req_id = 9fa77c42-08d9-486e-a612-d1a7b5d48360 response_code = 200 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b uri = /38711855-ef69-4d79-bb75-aebd85b1280b
20042024-11-25T19:32:16.565ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60240
20052024-11-25T19:32:16.565ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60240 req_id = 14766f28-1a57-45b0-8844-eca01d6fbfe4 response_code = 200 uri = /vpc-routes
20062024-11-25T19:32:16.584ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b values = ExternalIpGatewayMap { mappings: {} }
20072024-11-25T19:32:16.585ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60240 req_id = 07d77930-da52-4b53-87aa-2541dbced677 response_code = 204 uri = /eip-gateways
20082024-11-25T19:32:16.778ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42767
20092024-11-25T19:32:16.778ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42767 req_id = 0f6990bb-0136-4bbc-a629-6158c0db5c6c response_code = 200 uri = /v2p
20102024-11-25T19:32:16.788ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60240 req_id = 0ad5a0b0-a65c-42ad-a0f6-1ba1c2d609c8 response_code = 204 uri = /vpc-routes
20112024-11-25T19:32:16.860ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46910
20122024-11-25T19:32:16.860ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4173
20132024-11-25T19:32:16.913ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4197
20142024-11-25T19:32:16.998ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 137978 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:46910 req_id = b473ba05-d436-46a4-b155-53708d5f7925 response_code = 204 uri = /switch-ports
20152024-11-25T19:32:16.999ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 267 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46910 req_id = e77c49e6-502b-4dd4-bc67-d167f55dae2f response_code = 200 uri = /network-bootstore-config
20162024-11-25T19:32:17.186ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41939
20172024-11-25T19:32:17.186ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 167 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41939 req_id = 752076cc-1801-4d10-868c-91b065dae4a2 response_code = 200 uri = /v2p
20182024-11-25T19:32:17.187ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39588
20192024-11-25T19:32:17.187ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39588 req_id = bc46c4de-9121-4df8-8663-e3a7309fb0a1 response_code = 200 uri = /vpc-routes
20202024-11-25T19:32:17.203ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b values = ExternalIpGatewayMap { mappings: {} }
20212024-11-25T19:32:17.203ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39588 req_id = 905ba153-b226-4e19-a122-8b8746756c14 response_code = 204 uri = /eip-gateways
20222024-11-25T19:32:17.214ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 229 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39588 req_id = 4be56290-7f02-49f0-844a-1cfcf46845b1 response_code = 204 uri = /vpc-routes
20232024-11-25T19:32:17.333ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60505
20242024-11-25T19:32:17.333ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4173
20252024-11-25T19:32:17.372ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4197
20262024-11-25T19:32:17.427ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93750 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:60505 req_id = 7f2bf0a7-f6a9-4f00-8e9d-2113ca30c24d response_code = 204 uri = /switch-ports
20272024-11-25T19:32:17.427ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60505 req_id = 1050bea7-71b1-494a-b7e9-f75e6b5b9054 response_code = 200 uri = /network-bootstore-config
20282024-11-25T19:32:17.540ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44380
20292024-11-25T19:32:17.540ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44380 req_id = 622c66e6-b8ae-41f1-a6a6-63bd6ebf55d9 response_code = 200 uri = /vpc-routes
20302024-11-25T19:32:17.588ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b values = ExternalIpGatewayMap { mappings: {} }
20312024-11-25T19:32:17.588ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44380 req_id = a1e84934-3f4f-4f8a-aae1-3924f7f5f62d response_code = 204 uri = /eip-gateways
20322024-11-25T19:32:17.606ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 340 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44380 req_id = 531800e9-9c11-430a-88b3-b9a2c8c1178b response_code = 204 uri = /vpc-routes
20332024-11-25T19:32:17.656ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62824
20342024-11-25T19:32:17.657ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62824 req_id = a9060770-f291-40fd-8c9b-f33fdea22466 response_code = 200 uri = /v2p
20352024-11-25T19:32:17.695ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38115
20362024-11-25T19:32:17.696ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4173
20372024-11-25T19:32:17.731ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4197
20382024-11-25T19:32:17.788ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92332 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:38115 req_id = db818dea-f7ac-4ee2-b2e2-8aac5fb043d4 response_code = 204 uri = /switch-ports
20392024-11-25T19:32:17.788ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38115 req_id = 4bc56244-b894-4f00-965f-8b2ac8f2b4f6 response_code = 200 uri = /network-bootstore-config
20402024-11-25T19:32:20.974ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:62545
20412024-11-25T19:32:20.974ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:62545 req_id = 5899acd8-78c0-4733-a197-0278409319f9 response_code = 200 uri = /baseboard
20422024-11-25T19:32:37.295ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6398 local_addr = [fd00:1122:3344:101::1]:49777 method = GET remote_addr = [fd00:1122:3344:101::d]:58688 req_id = d0d77729-027d-47d4-a30b-46634c933f57 response_code = 200 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b uri = /38711855-ef69-4d79-bb75-aebd85b1280b
20432024-11-25T19:32:46.436ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45338
20442024-11-25T19:32:46.436ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45338 req_id = 994d2bef-6f18-4c56-b83b-5b108e08c221 response_code = 200 uri = /vpc-routes
20452024-11-25T19:32:46.482ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b values = ExternalIpGatewayMap { mappings: {} }
20462024-11-25T19:32:46.482ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45338 req_id = f94901bf-b090-4b96-b839-56f75ca8aedd response_code = 204 uri = /eip-gateways
20472024-11-25T19:32:46.495ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45338 req_id = d3d23658-c18c-48de-b62d-b631a39e8a92 response_code = 204 uri = /vpc-routes
20482024-11-25T19:32:46.540ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53629
20492024-11-25T19:32:46.540ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53629 req_id = 1d7fbd80-9c71-42c1-a2d8-62d2d9e02fe3 response_code = 200 uri = /v2p
20502024-11-25T19:32:46.585ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36087
20512024-11-25T19:32:46.585ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4173
20522024-11-25T19:32:46.621ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4197
20532024-11-25T19:32:46.674ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89434 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:36087 req_id = 4efb2786-3856-415e-a694-a4c1b79dceef response_code = 204 uri = /switch-ports
20542024-11-25T19:32:46.675ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 212 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36087 req_id = 47481984-646c-4b13-b032-38aa5ee9c688 response_code = 200 uri = /network-bootstore-config
20552024-11-25T19:32:47.090ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33910
20562024-11-25T19:32:47.091ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33910 req_id = 6a29b5eb-008b-4ddd-8d07-790633d85670 response_code = 200 uri = /vpc-routes
20572024-11-25T19:32:47.149ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b values = ExternalIpGatewayMap { mappings: {} }
20582024-11-25T19:32:47.149ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33910 req_id = 6450737b-f582-439e-aee1-f189951331e5 response_code = 204 uri = /eip-gateways
20592024-11-25T19:32:47.160ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33910 req_id = 046a512a-3953-4c6a-85aa-b33f10ba8f7f response_code = 204 uri = /vpc-routes
20602024-11-25T19:32:47.177ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57895
20612024-11-25T19:32:47.177ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57895 req_id = 5a430207-9583-4dc2-a9e4-7df04d1d27d2 response_code = 200 uri = /v2p
20622024-11-25T19:32:47.208ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56765
20632024-11-25T19:32:47.208ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4173
20642024-11-25T19:32:47.244ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4197
20652024-11-25T19:32:47.298ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90853 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:56765 req_id = dcea440f-09ff-4c43-81e3-8822bee5246d response_code = 204 uri = /switch-ports
20662024-11-25T19:32:47.299ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47392
20672024-11-25T19:32:47.299ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47392 req_id = dc7cfef8-8280-49ea-876d-9421220da1ba response_code = 200 uri = /vpc-routes
20682024-11-25T19:32:47.299ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 204 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56765 req_id = c58a4278-4fc5-49e7-97ac-ec74c8de97d8 response_code = 200 uri = /network-bootstore-config
20692024-11-25T19:32:47.342ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b values = ExternalIpGatewayMap { mappings: {} }
20702024-11-25T19:32:47.342ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47392 req_id = f3c82055-cdef-41d5-ae5a-fd75341ba21d response_code = 204 uri = /eip-gateways
20712024-11-25T19:32:47.351ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47392 req_id = 6c65551a-a9c5-48da-9211-45f541c8367a response_code = 204 uri = /vpc-routes
20722024-11-25T19:32:47.380ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58814
20732024-11-25T19:32:47.380ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58814 req_id = 200180a0-2002-4558-832b-86da15475814 response_code = 200 uri = /v2p
20742024-11-25T19:32:47.400ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41874
20752024-11-25T19:32:47.400ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4173
20762024-11-25T19:32:47.436ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4197
20772024-11-25T19:32:47.492ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92487 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:41874 req_id = 2ce088d1-9fa2-473a-b5b2-b0bfbd11c3be response_code = 204 uri = /switch-ports
20782024-11-25T19:32:47.493ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41874 req_id = 14d86b25-2417-4b5b-9eec-414621f2b2aa response_code = 200 uri = /network-bootstore-config
20792024-11-25T19:32:51.008ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:56995
20802024-11-25T19:32:51.008ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:56995 req_id = 76e85491-5d44-452b-92b5-f439cafd6dac response_code = 200 uri = /baseboard
20812024-11-25T19:33:00.671ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
20822024-11-25T19:33:07.295ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6906 local_addr = [fd00:1122:3344:101::1]:49777 method = GET remote_addr = [fd00:1122:3344:101::d]:58688 req_id = 21954cea-0d8a-40fe-b75b-b59c89acfd33 response_code = 200 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b uri = /38711855-ef69-4d79-bb75-aebd85b1280b
20832024-11-25T19:33:16.553ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60471
20842024-11-25T19:33:16.553ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60471 req_id = 5e2671a1-edaa-4e64-9c0d-c655109024c8 response_code = 200 uri = /v2p
20852024-11-25T19:33:16.560ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62346
20862024-11-25T19:33:16.560ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62346 req_id = 0c0be93d-8f19-4e0b-a2e5-42ba1226e8f4 response_code = 200 uri = /vpc-routes
20872024-11-25T19:33:16.574ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b values = ExternalIpGatewayMap { mappings: {} }
20882024-11-25T19:33:16.574ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62346 req_id = 25cdbe2b-9dbe-40c5-9787-df714b41510f response_code = 204 uri = /eip-gateways
20892024-11-25T19:33:16.581ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 205 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62346 req_id = 168ea6ce-c5a4-44c5-a77b-c8ce43380be0 response_code = 204 uri = /vpc-routes
20902024-11-25T19:33:16.744ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43423
20912024-11-25T19:33:16.744ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4173
20922024-11-25T19:33:16.778ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4197
20932024-11-25T19:33:16.836ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92804 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:43423 req_id = a85964bc-da11-4ef4-8620-c4c4780c4d23 response_code = 204 uri = /switch-ports
20942024-11-25T19:33:16.837ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 194 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43423 req_id = 2a6a9f5d-99b0-4722-b32f-bcbb9968c8ae response_code = 200 uri = /network-bootstore-config
20952024-11-25T19:33:17.159ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51326
20962024-11-25T19:33:17.160ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51326 req_id = 9e99da79-58da-4d9d-97b3-026338a709ea response_code = 200 uri = /vpc-routes
20972024-11-25T19:33:17.186ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38828
20982024-11-25T19:33:17.186ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38828 req_id = e80b6f3d-0b72-496c-90e1-666ba725e543 response_code = 200 uri = /v2p
20992024-11-25T19:33:17.216ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b values = ExternalIpGatewayMap { mappings: {} }
21002024-11-25T19:33:17.216ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51326 req_id = 205dca77-03b1-401c-89a1-cd9f3c6e2000 response_code = 204 uri = /eip-gateways
21012024-11-25T19:33:17.227ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 277 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51326 req_id = ce25545b-cd25-43be-ac03-6b5b246f9844 response_code = 204 uri = /vpc-routes
21022024-11-25T19:33:17.344ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65437
21032024-11-25T19:33:17.344ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65437 req_id = 801e0f42-815b-4155-99b2-36e587120195 response_code = 200 uri = /vpc-routes
21042024-11-25T19:33:17.391ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b values = ExternalIpGatewayMap { mappings: {} }
21052024-11-25T19:33:17.391ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:65437 req_id = 637e83d6-48c2-40f4-bf22-8c4b6fede2fc response_code = 204 uri = /eip-gateways
21062024-11-25T19:33:17.406ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 292 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:65437 req_id = afbfacd7-4148-4569-a0af-7bac1da12af3 response_code = 204 uri = /vpc-routes
21072024-11-25T19:33:17.510ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60939
21082024-11-25T19:33:17.511ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60939 req_id = d406700c-deb9-45f7-81a8-540ff02a5380 response_code = 200 uri = /v2p
21092024-11-25T19:33:17.523ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63080
21102024-11-25T19:33:17.523ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4173
21112024-11-25T19:33:17.561ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4197
21122024-11-25T19:33:17.614ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91240 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:63080 req_id = cca28b4d-4935-4a02-8c94-34ce5bfd6355 response_code = 204 uri = /switch-ports
21132024-11-25T19:33:17.615ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34472
21142024-11-25T19:33:17.615ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63080 req_id = c4d5ae65-f246-4ead-a7f6-161d2cec9ae5 response_code = 200 uri = /network-bootstore-config
21152024-11-25T19:33:17.615ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4173
21162024-11-25T19:33:17.651ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4197
21172024-11-25T19:33:17.699ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83772 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:34472 req_id = 676cbddd-9742-476b-90c6-771129cd300f response_code = 204 uri = /switch-ports
21182024-11-25T19:33:17.699ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34472 req_id = db0e8729-f0b9-4b48-b812-1e131b5bbfc8 response_code = 200 uri = /network-bootstore-config
21192024-11-25T19:33:21.041ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53314
21202024-11-25T19:33:21.041ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53314 req_id = 8ff1fe00-eb2f-400c-8b5a-8063560dd7de response_code = 200 uri = /baseboard
21212024-11-25T19:33:37.294ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5601 local_addr = [fd00:1122:3344:101::1]:49777 method = GET remote_addr = [fd00:1122:3344:101::d]:58688 req_id = 26f33a47-94dd-4230-88af-79f3c34f2e7e response_code = 200 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b uri = /38711855-ef69-4d79-bb75-aebd85b1280b
21222024-11-25T19:33:46.413ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63230
21232024-11-25T19:33:46.413ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63230 req_id = 640b2a8d-df70-4a88-8b13-9a2c8a066ceb response_code = 200 uri = /vpc-routes
21242024-11-25T19:33:46.430ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b values = ExternalIpGatewayMap { mappings: {} }
21252024-11-25T19:33:46.430ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63230 req_id = 9c0028c9-99bc-4e0d-b2f7-b666ca4ed698 response_code = 204 uri = /eip-gateways
21262024-11-25T19:33:46.437ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56580
21272024-11-25T19:33:46.437ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56580 req_id = 2c00f9a2-b094-4bb4-ad88-b7d52a72dda6 response_code = 200 uri = /v2p
21282024-11-25T19:33:46.443ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 222 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63230 req_id = 84f99b1f-caf6-4fda-b5ff-8f38bf6d8d94 response_code = 204 uri = /vpc-routes
21292024-11-25T19:33:46.501ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49164
21302024-11-25T19:33:46.501ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4173
21312024-11-25T19:33:46.535ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4197
21322024-11-25T19:33:46.586ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84454 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:49164 req_id = 8fdc1ce7-d3b1-48cd-bfd3-5fd7d073eaa5 response_code = 204 uri = /switch-ports
21332024-11-25T19:33:46.586ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49164 req_id = 2fe5de87-c6cd-483a-88ae-0796a5707c9e response_code = 200 uri = /network-bootstore-config
21342024-11-25T19:33:47.061ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40531
21352024-11-25T19:33:47.062ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40531 req_id = bcce406d-92e9-4679-937c-3e3610662fc4 response_code = 200 uri = /vpc-routes
21362024-11-25T19:33:47.129ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b values = ExternalIpGatewayMap { mappings: {} }
21372024-11-25T19:33:47.129ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40531 req_id = 137bcb22-2f86-441e-b0ad-8b928bd908dd response_code = 204 uri = /eip-gateways
21382024-11-25T19:33:47.139ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 170 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40531 req_id = 73ec3ac6-2239-4fda-91de-61dd6bd10f78 response_code = 204 uri = /vpc-routes
21392024-11-25T19:33:47.220ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34217
21402024-11-25T19:33:47.220ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4173
21412024-11-25T19:33:47.259ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4197
21422024-11-25T19:33:47.324ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104037 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:34217 req_id = 81d72a32-8ce4-46c7-a29e-b0ec82b01597 response_code = 204 uri = /switch-ports
21432024-11-25T19:33:47.324ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49972
21442024-11-25T19:33:47.325ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50210
21452024-11-25T19:33:47.325ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 306 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34217 req_id = 88f4b480-4000-4d7e-80d7-6b17fb30ac71 response_code = 200 uri = /network-bootstore-config
21462024-11-25T19:33:47.325ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50210 req_id = 7d915d23-48bd-4928-ae53-d55a02f0aabd response_code = 200 uri = /vpc-routes
21472024-11-25T19:33:47.325ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 218 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49972 req_id = ad5c75ff-a25c-4bde-9a16-2a0b907dc875 response_code = 200 uri = /v2p
21482024-11-25T19:33:47.374ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b values = ExternalIpGatewayMap { mappings: {} }
21492024-11-25T19:33:47.374ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50210 req_id = d55ffa5b-6956-49c5-86e8-0607b99e4554 response_code = 204 uri = /eip-gateways
21502024-11-25T19:33:47.384ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 224 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50210 req_id = ce5bb9e2-2f95-466f-8d0d-4f13d2342f5d response_code = 204 uri = /vpc-routes
21512024-11-25T19:33:47.393ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36902
21522024-11-25T19:33:47.393ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4173
21532024-11-25T19:33:47.431ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4197
21542024-11-25T19:33:47.490ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97386 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:36902 req_id = 9e194f36-a13e-4fac-bf65-5708514ae21e response_code = 204 uri = /switch-ports
21552024-11-25T19:33:47.490ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46268
21562024-11-25T19:33:47.491ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46268 req_id = daa1dcd0-39d0-460b-947a-864877f4836f response_code = 200 uri = /v2p
21572024-11-25T19:33:47.491ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36902 req_id = 1de0fd37-bca6-4cee-97d5-11b05694bc5d response_code = 200 uri = /network-bootstore-config
21582024-11-25T19:33:51.077ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:62555
21592024-11-25T19:33:51.077ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 30 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:62555 req_id = 9037189b-2801-4502-b1a9-62e8088300d5 response_code = 200 uri = /baseboard
21602024-11-25T19:34:07.295ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6322 local_addr = [fd00:1122:3344:101::1]:49777 method = GET remote_addr = [fd00:1122:3344:101::d]:58688 req_id = 602a64e3-53bc-4530-bd22-a34fd54f4bfb response_code = 200 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b uri = /38711855-ef69-4d79-bb75-aebd85b1280b
21612024-11-25T19:34:16.504ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63105
21622024-11-25T19:34:16.504ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63105 req_id = 77ecf445-77ea-44f7-a006-bb2142fec692 response_code = 200 uri = /vpc-routes
21632024-11-25T19:34:16.574ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b values = ExternalIpGatewayMap { mappings: {} }
21642024-11-25T19:34:16.574ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63105 req_id = e5a545cb-567a-440e-a340-0ab021984f49 response_code = 204 uri = /eip-gateways
21652024-11-25T19:34:16.588ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 299 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63105 req_id = c22f3454-ceb8-469b-b2e8-823a6a7bc2b3 response_code = 204 uri = /vpc-routes
21662024-11-25T19:34:16.689ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62836
21672024-11-25T19:34:16.690ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62836 req_id = a7e94e6e-b674-4719-b03d-60b26dbed7ca response_code = 200 uri = /v2p
21682024-11-25T19:34:16.743ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41482
21692024-11-25T19:34:16.743ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4173
21702024-11-25T19:34:16.780ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4197
21712024-11-25T19:34:16.834ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91306 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:41482 req_id = 2f5244b5-8579-452b-b4a1-8bd4149385ff response_code = 204 uri = /switch-ports
21722024-11-25T19:34:16.835ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41482 req_id = 3b98c2e0-e64b-4758-af22-8ba09ce01449 response_code = 200 uri = /network-bootstore-config
21732024-11-25T19:34:17.234ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34240
21742024-11-25T19:34:17.235ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34240 req_id = dd8c7599-ff7c-4c49-a8a8-2069127ee50e response_code = 200 uri = /vpc-routes
21752024-11-25T19:34:17.302ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b values = ExternalIpGatewayMap { mappings: {} }
21762024-11-25T19:34:17.302ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34240 req_id = 0ba029d3-9c5d-4976-8f19-2ef1fa69efcf response_code = 204 uri = /eip-gateways
21772024-11-25T19:34:17.312ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 376 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34240 req_id = 848cd80b-fb08-4328-9c66-b61ac8f2f408 response_code = 204 uri = /vpc-routes
21782024-11-25T19:34:17.361ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35221
21792024-11-25T19:34:17.361ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35221 req_id = 4cbd7f9e-9bee-439f-bbd8-91a108fab450 response_code = 200 uri = /vpc-routes
21802024-11-25T19:34:17.409ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b values = ExternalIpGatewayMap { mappings: {} }
21812024-11-25T19:34:17.409ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35221 req_id = bfa113ec-40c9-461d-94c1-a00734426eb0 response_code = 204 uri = /eip-gateways
21822024-11-25T19:34:17.461ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41992
21832024-11-25T19:34:17.461ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41992 req_id = 9573f3ab-fc2f-4b14-a52c-65ff8049df9d response_code = 200 uri = /v2p
21842024-11-25T19:34:17.467ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 245 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35221 req_id = 8f67971d-19f9-438c-9518-c3890f923fe6 response_code = 204 uri = /vpc-routes
21852024-11-25T19:34:17.508ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58956
21862024-11-25T19:34:17.509ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4173
21872024-11-25T19:34:17.547ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4197
21882024-11-25T19:34:17.603ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94126 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:58956 req_id = 2cfd6d48-cc64-4485-ac92-87f402f14133 response_code = 204 uri = /switch-ports
21892024-11-25T19:34:17.603ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36997
21902024-11-25T19:34:17.603ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46631
21912024-11-25T19:34:17.603ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 287 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58956 req_id = 622f9886-87d3-4f29-87e5-37eeb51f48f0 response_code = 200 uri = /network-bootstore-config
21922024-11-25T19:34:17.603ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4173
21932024-11-25T19:34:17.603ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 237 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46631 req_id = d01c8263-7b0b-4e9e-b80a-282715178424 response_code = 200 uri = /v2p
21942024-11-25T19:34:17.641ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4197
21952024-11-25T19:34:17.693ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89321 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:36997 req_id = ce4d14e9-50b9-496f-a80f-a8678503d3b7 response_code = 204 uri = /switch-ports
21962024-11-25T19:34:17.693ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36997 req_id = a91602e4-ffb9-4085-8c2e-0cd5cd36e86a response_code = 200 uri = /network-bootstore-config
21972024-11-25T19:34:21.111ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:43295
21982024-11-25T19:34:21.111ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 28 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:43295 req_id = fe965d4d-4cc1-46a6-88be-d9b0c937cc8a response_code = 200 uri = /baseboard
21992024-11-25T19:34:37.296ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6939 local_addr = [fd00:1122:3344:101::1]:49777 method = GET remote_addr = [fd00:1122:3344:101::d]:58688 req_id = 6afef49c-26e9-41ae-a2f9-175c6c57081d response_code = 200 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b uri = /38711855-ef69-4d79-bb75-aebd85b1280b
22002024-11-25T19:34:46.418ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35258
22012024-11-25T19:34:46.418ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35258 req_id = d2c6017c-0807-461a-81c9-ba485570cde3 response_code = 200 uri = /v2p
22022024-11-25T19:34:46.448ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52337
22032024-11-25T19:34:46.448ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52337 req_id = 1ec41eac-7c3b-498b-ab77-2ed06d600273 response_code = 200 uri = /vpc-routes
22042024-11-25T19:34:46.487ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b values = ExternalIpGatewayMap { mappings: {} }
22052024-11-25T19:34:46.487ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52337 req_id = 63f0d644-25e7-421e-a652-147e8962054f response_code = 204 uri = /eip-gateways
22062024-11-25T19:34:46.497ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 192 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52337 req_id = af1d60ae-7a45-4c35-9db3-2d01869b0263 response_code = 204 uri = /vpc-routes
22072024-11-25T19:34:46.555ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51129
22082024-11-25T19:34:46.555ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4173
22092024-11-25T19:34:46.592ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4197
22102024-11-25T19:34:46.647ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91561 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:51129 req_id = ed7a77f7-f44f-412e-873b-80d56e4e1b04 response_code = 204 uri = /switch-ports
22112024-11-25T19:34:46.647ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51129 req_id = 0ed92e78-5593-416e-b786-829628356f14 response_code = 200 uri = /network-bootstore-config
22122024-11-25T19:34:46.986ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57219
22132024-11-25T19:34:46.986ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57219 req_id = 09fe97b4-44ac-429d-b30b-c1df2a23ab92 response_code = 200 uri = /vpc-routes
22142024-11-25T19:34:47.006ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b values = ExternalIpGatewayMap { mappings: {} }
22152024-11-25T19:34:47.006ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57219 req_id = d79e74bc-75c2-4e6c-b012-57e0299d5604 response_code = 204 uri = /eip-gateways
22162024-11-25T19:34:47.025ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 281 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57219 req_id = 0c5f6c7e-4c02-4fff-a7b7-5f070d2a4ea3 response_code = 204 uri = /vpc-routes
22172024-11-25T19:34:47.166ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45365
22182024-11-25T19:34:47.166ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4173
22192024-11-25T19:34:47.207ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4197
22202024-11-25T19:34:47.265ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98297 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:45365 req_id = f004ba83-cf5c-42fc-b2c9-6001e4129b39 response_code = 204 uri = /switch-ports
22212024-11-25T19:34:47.265ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33144
22222024-11-25T19:34:47.265ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45050
22232024-11-25T19:34:47.265ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33144 req_id = 1756c808-dcaa-4951-a5e0-7e376f11771e response_code = 200 uri = /vpc-routes
22242024-11-25T19:34:47.265ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 312 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45365 req_id = 22f3bb73-a838-478a-8026-b6c98f0fd038 response_code = 200 uri = /network-bootstore-config
22252024-11-25T19:34:47.265ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 242 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45050 req_id = 5a2c3051-786e-4bb2-99fb-6cddfc9276c1 response_code = 200 uri = /v2p
22262024-11-25T19:34:47.274ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57410
22272024-11-25T19:34:47.275ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57410 req_id = 5cc1404d-70ff-4333-823d-50c853c00be5 response_code = 200 uri = /v2p
22282024-11-25T19:34:47.280ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b values = ExternalIpGatewayMap { mappings: {} }
22292024-11-25T19:34:47.280ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33144 req_id = 6005d88d-f7ec-4dbc-bceb-a1ad530e46dd response_code = 204 uri = /eip-gateways
22302024-11-25T19:34:47.289ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33144 req_id = 80509b53-8966-4fd5-afbb-062da0a12476 response_code = 204 uri = /vpc-routes
22312024-11-25T19:34:47.298ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65348
22322024-11-25T19:34:47.298ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4173
22332024-11-25T19:34:47.334ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4197
22342024-11-25T19:34:47.393ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94410 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:65348 req_id = 315a47d6-e4c9-4986-a9a4-4d28324640ee response_code = 204 uri = /switch-ports
22352024-11-25T19:34:47.397ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65348 req_id = 6b24ea37-0eab-4db6-a075-f255ae47bcd9 response_code = 200 uri = /network-bootstore-config
22362024-11-25T19:34:51.144ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:60517
22372024-11-25T19:34:51.144ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:60517 req_id = 75893f12-598a-42cd-bd08-efff6f2e1268 response_code = 200 uri = /baseboard
22382024-11-25T19:35:07.296ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5751 local_addr = [fd00:1122:3344:101::1]:49777 method = GET remote_addr = [fd00:1122:3344:101::d]:58688 req_id = 618ff7ce-3a66-49ff-a993-3d1c736ea41b response_code = 200 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b uri = /38711855-ef69-4d79-bb75-aebd85b1280b
22392024-11-25T19:35:16.536ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38065
22402024-11-25T19:35:16.536ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38065 req_id = 421dd764-d638-4f0c-b5cb-5b50baa89245 response_code = 200 uri = /v2p
22412024-11-25T19:35:16.540ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65147
22422024-11-25T19:35:16.540ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 26 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65147 req_id = 384a66fa-858c-4863-a129-3a19b05eab4a response_code = 200 uri = /vpc-routes
22432024-11-25T19:35:16.579ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b values = ExternalIpGatewayMap { mappings: {} }
22442024-11-25T19:35:16.579ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:65147 req_id = f110d755-bd6e-409e-ae64-84172cf184cb response_code = 204 uri = /eip-gateways
22452024-11-25T19:35:16.588ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 193 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:65147 req_id = 126c5ea1-4265-4333-acac-00f0207ae73c response_code = 204 uri = /vpc-routes
22462024-11-25T19:35:16.863ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55891
22472024-11-25T19:35:16.864ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4173
22482024-11-25T19:35:16.921ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4197
22492024-11-25T19:35:17.006ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 142480 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:55891 req_id = 40ba972d-b1a5-4fdb-8244-e753edb9a9c5 response_code = 204 uri = /switch-ports
22502024-11-25T19:35:17.007ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 236 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55891 req_id = d7c791dd-4860-4a21-937c-e7b22e221ce6 response_code = 200 uri = /network-bootstore-config
22512024-11-25T19:35:17.234ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47341
22522024-11-25T19:35:17.234ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47341 req_id = dd5e153e-430a-4d67-9323-ff0beabc03a0 response_code = 200 uri = /vpc-routes
22532024-11-25T19:35:17.292ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b values = ExternalIpGatewayMap { mappings: {} }
22542024-11-25T19:35:17.292ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47341 req_id = 812e5dd7-8049-4e7c-882f-8e9613fe97de response_code = 204 uri = /eip-gateways
22552024-11-25T19:35:17.302ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 277 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47341 req_id = d418b910-1849-46b8-b97f-ab487e4978ac response_code = 204 uri = /vpc-routes
22562024-11-25T19:35:17.331ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64402
22572024-11-25T19:35:17.331ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64402 req_id = aff13412-0314-419e-b687-b069e0fb5988 response_code = 200 uri = /vpc-routes
22582024-11-25T19:35:17.348ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56634
22592024-11-25T19:35:17.348ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4173
22602024-11-25T19:35:17.387ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4197
22612024-11-25T19:35:17.440ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92368 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:56634 req_id = 848111c2-7ecd-4471-a0d5-fa88365f972c response_code = 204 uri = /switch-ports
22622024-11-25T19:35:17.441ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b values = ExternalIpGatewayMap { mappings: {} }
22632024-11-25T19:35:17.441ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 250 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64402 req_id = f66f01f1-2803-46b6-8e09-cb6de0d16df1 response_code = 204 uri = /eip-gateways
22642024-11-25T19:35:17.441ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 281 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56634 req_id = 3bffbc51-67f5-40a0-8618-0da687159a3b response_code = 200 uri = /network-bootstore-config
22652024-11-25T19:35:17.450ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 314 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64402 req_id = 1a534cf5-f515-42e9-9e33-1897865a89c2 response_code = 204 uri = /vpc-routes
22662024-11-25T19:35:17.463ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42154
22672024-11-25T19:35:17.463ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42154 req_id = eab0f3ef-6443-4384-bd63-6f639a83e863 response_code = 200 uri = /v2p
22682024-11-25T19:35:17.587ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64333
22692024-11-25T19:35:17.587ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64333 req_id = d3401e3b-7666-4954-a337-3975dc91e3c9 response_code = 200 uri = /v2p
22702024-11-25T19:35:17.682ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60461
22712024-11-25T19:35:17.682ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4173
22722024-11-25T19:35:17.715ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4197
22732024-11-25T19:35:17.765ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82881 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:60461 req_id = 0a3363ea-66fd-4a71-bc26-d3f53d200500 response_code = 204 uri = /switch-ports
22742024-11-25T19:35:17.765ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60461 req_id = e05047ab-f231-4673-931f-bfb1f1b3d60e response_code = 200 uri = /network-bootstore-config
22752024-11-25T19:35:21.180ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36181
22762024-11-25T19:35:21.180ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 30 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36181 req_id = 8d5f3f0b-4bad-48d9-b72f-6d3743cd6188 response_code = 200 uri = /baseboard
22772024-11-25T19:35:37.297ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6181 local_addr = [fd00:1122:3344:101::1]:49777 method = GET remote_addr = [fd00:1122:3344:101::d]:58688 req_id = 04be7dc5-d4f3-40c0-933d-65fd375d2985 response_code = 200 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b uri = /38711855-ef69-4d79-bb75-aebd85b1280b
22782024-11-25T19:35:46.521ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59755
22792024-11-25T19:35:46.521ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59755 req_id = 8aeee948-859e-4798-89cb-13f1fbb0b8fd response_code = 200 uri = /v2p
22802024-11-25T19:35:46.656ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50421
22812024-11-25T19:35:46.656ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50421 req_id = 47666196-f894-4ae4-b7ba-b8805a82dd4b response_code = 200 uri = /vpc-routes
22822024-11-25T19:35:46.669ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b values = ExternalIpGatewayMap { mappings: {} }
22832024-11-25T19:35:46.669ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50421 req_id = 7d34cdc8-385d-4b79-9bb6-17d3b3f83684 response_code = 204 uri = /eip-gateways
22842024-11-25T19:35:46.677ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 202 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50421 req_id = 98832850-1b3f-4f90-9d12-38b09ff0a2eb response_code = 204 uri = /vpc-routes
22852024-11-25T19:35:46.711ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63205
22862024-11-25T19:35:46.711ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4173
22872024-11-25T19:35:46.748ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4197
22882024-11-25T19:35:46.799ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88770 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:63205 req_id = 4d76ef12-b937-407d-8ec9-c91f88d2a01e response_code = 204 uri = /switch-ports
22892024-11-25T19:35:46.800ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 203 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63205 req_id = 4ce92bb7-6dfc-4cab-9bfd-48662eb292ef response_code = 200 uri = /network-bootstore-config
22902024-11-25T19:35:47.123ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48759
22912024-11-25T19:35:47.124ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48759 req_id = 885f0937-d44e-4eb2-8ea0-83930f658595 response_code = 200 uri = /v2p
22922024-11-25T19:35:47.154ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51215
22932024-11-25T19:35:47.154ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51215 req_id = 0b1979c3-65bb-4a24-8cd6-89cd2d5b94c1 response_code = 200 uri = /vpc-routes
22942024-11-25T19:35:47.204ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b values = ExternalIpGatewayMap { mappings: {} }
22952024-11-25T19:35:47.204ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51215 req_id = 91d1b04a-b4dc-4761-b970-f4b1db957b12 response_code = 204 uri = /eip-gateways
22962024-11-25T19:35:47.214ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 185 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51215 req_id = 59616655-4b98-4233-b548-61b8559e4c95 response_code = 204 uri = /vpc-routes
22972024-11-25T19:35:47.236ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42978
22982024-11-25T19:35:47.237ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4173
22992024-11-25T19:35:47.272ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4197
23002024-11-25T19:35:47.329ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92605 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:42978 req_id = 525a788b-9562-4ebf-a6b8-284f5bf3ab2e response_code = 204 uri = /switch-ports
23012024-11-25T19:35:47.329ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64256
23022024-11-25T19:35:47.329ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42663
23032024-11-25T19:35:47.330ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64256 req_id = a8278258-f386-4fd0-af74-65bec40e11ca response_code = 200 uri = /vpc-routes
23042024-11-25T19:35:47.330ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 310 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42978 req_id = 75c135b3-4b6a-4d8f-a96d-0a2a241cb693 response_code = 200 uri = /network-bootstore-config
23052024-11-25T19:35:47.330ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 273 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42663 req_id = 309773a2-8c26-4173-8af3-4ff6a56717be response_code = 200 uri = /v2p
23062024-11-25T19:35:47.371ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b values = ExternalIpGatewayMap { mappings: {} }
23072024-11-25T19:35:47.371ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64256 req_id = b0d5c426-59ae-44bb-9614-1a762a1d3e52 response_code = 204 uri = /eip-gateways
23082024-11-25T19:35:47.379ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 318 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64256 req_id = 374f56d0-1e06-4a95-a1f4-05c6988414d9 response_code = 204 uri = /vpc-routes
23092024-11-25T19:35:47.415ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64883
23102024-11-25T19:35:47.415ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4173
23112024-11-25T19:35:47.458ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4197
23122024-11-25T19:35:47.515ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99886 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:64883 req_id = 763046ed-d8f7-41f1-890f-3b2a3ea9550a response_code = 204 uri = /switch-ports
23132024-11-25T19:35:47.515ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 224 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64883 req_id = de9a5677-7f36-4394-af19-27f328d280d1 response_code = 200 uri = /network-bootstore-config
23142024-11-25T19:35:51.211ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:52687
23152024-11-25T19:35:51.212ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:52687 req_id = 8630ca78-9ef4-49bc-9394-a948e9308ecd response_code = 200 uri = /baseboard
23162024-11-25T19:36:07.295ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6298 local_addr = [fd00:1122:3344:101::1]:49777 method = GET remote_addr = [fd00:1122:3344:101::d]:58688 req_id = 408d2dfa-fcce-444d-ab69-e9ed29910e51 response_code = 200 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b uri = /38711855-ef69-4d79-bb75-aebd85b1280b
23172024-11-25T19:36:16.690ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39368
23182024-11-25T19:36:16.690ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39368 req_id = a318f77e-f5ee-492a-90c7-4dbb15ff42a6 response_code = 200 uri = /vpc-routes
23192024-11-25T19:36:16.705ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b values = ExternalIpGatewayMap { mappings: {} }
23202024-11-25T19:36:16.705ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39368 req_id = fcaef3c1-f30f-4339-9b69-252dde3e69e2 response_code = 204 uri = /eip-gateways
23212024-11-25T19:36:16.713ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 202 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39368 req_id = d0ba796e-0870-416c-a56b-15297d119d05 response_code = 204 uri = /vpc-routes
23222024-11-25T19:36:16.800ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60619
23232024-11-25T19:36:16.800ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60619 req_id = a63a80d7-1f06-4c0f-a30e-3c5893078ac1 response_code = 200 uri = /v2p
23242024-11-25T19:36:16.928ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65048
23252024-11-25T19:36:16.929ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4173
23262024-11-25T19:36:16.973ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4197
23272024-11-25T19:36:17.040ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111276 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:65048 req_id = 9a55045a-7c11-4138-a234-d173e0bfd52d response_code = 204 uri = /switch-ports
23282024-11-25T19:36:17.040ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60314
23292024-11-25T19:36:17.040ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 297 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65048 req_id = 670bf487-5ec7-4542-b53b-a4c6f415f6d3 response_code = 200 uri = /network-bootstore-config
23302024-11-25T19:36:17.041ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: d231a61b-6b3d-4ea9-b8ff-35ab162113d2, kind: Service { id: 5e357e48-2959-4886-8b9d-557b95c45fb7 }, name: Name("external-dns-5e357e48-2959-4886-8b9d-557b95c45fb7"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 225, 146])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f04f2a94-1775-401c-8f4b-f933311d21a8, kind: Service { id: 6b3cbeea-c72e-481d-a7a1-e27c601ccb03 }, name: Name("external-dns-6b3cbeea-c72e-481d-a7a1-e27c601ccb03"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 175, 189])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5304be8f-eb23-4485-b885-5b368db0b5b6, kind: Service { id: 1d808376-6b5a-46f0-b373-d7ba578556eb }, name: Name("nexus-1d808376-6b5a-46f0-b373-d7ba578556eb"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 88])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7c489787-90c9-4b93-99c1-8a1f226c1096, kind: Service { id: a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67 }, name: Name("nexus-a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 161, 21])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d755e6b0-59ef-4a09-9894-b39bfb858111, kind: Service { id: 29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037 }, name: Name("nexus-29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 3])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
23312024-11-25T19:36:17.041ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23322024-11-25T19:36:17.041ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23332024-11-25T19:36:17.041ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
23342024-11-25T19:36:17.041ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23352024-11-25T19:36:17.041ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23362024-11-25T19:36:17.041ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23372024-11-25T19:36:17.041ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 635 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60314 req_id = 01205666-f081-4a05-8964-d7fa0eee4e34 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
23382024-11-25T19:36:17.144ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63933
23392024-11-25T19:36:17.144ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63933 req_id = 978e2fb2-b8bd-4980-9406-6efd28b16437 response_code = 200 uri = /v2p
23402024-11-25T19:36:17.203ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53635
23412024-11-25T19:36:17.203ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53635 req_id = 5d920439-722a-439a-912e-f7d2834d63ac response_code = 200 uri = /vpc-routes
23422024-11-25T19:36:17.254ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b values = ExternalIpGatewayMap { mappings: {} }
23432024-11-25T19:36:17.254ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53635 req_id = 40f5bd7a-3b71-49ee-bd12-8239c494919e response_code = 204 uri = /eip-gateways
23442024-11-25T19:36:17.262ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 294 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53635 req_id = aee1b77f-8b90-4b50-85ad-790b3991996f response_code = 204 uri = /vpc-routes
23452024-11-25T19:36:17.344ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33637
23462024-11-25T19:36:17.344ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: d231a61b-6b3d-4ea9-b8ff-35ab162113d2, kind: Service { id: 5e357e48-2959-4886-8b9d-557b95c45fb7 }, name: Name("external-dns-5e357e48-2959-4886-8b9d-557b95c45fb7"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 225, 146])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f04f2a94-1775-401c-8f4b-f933311d21a8, kind: Service { id: 6b3cbeea-c72e-481d-a7a1-e27c601ccb03 }, name: Name("external-dns-6b3cbeea-c72e-481d-a7a1-e27c601ccb03"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 175, 189])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5304be8f-eb23-4485-b885-5b368db0b5b6, kind: Service { id: 1d808376-6b5a-46f0-b373-d7ba578556eb }, name: Name("nexus-1d808376-6b5a-46f0-b373-d7ba578556eb"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 88])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7c489787-90c9-4b93-99c1-8a1f226c1096, kind: Service { id: a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67 }, name: Name("nexus-a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 161, 21])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d755e6b0-59ef-4a09-9894-b39bfb858111, kind: Service { id: 29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037 }, name: Name("nexus-29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 3])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
23472024-11-25T19:36:17.344ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23482024-11-25T19:36:17.344ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23492024-11-25T19:36:17.344ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
23502024-11-25T19:36:17.344ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23512024-11-25T19:36:17.344ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23522024-11-25T19:36:17.344ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23532024-11-25T19:36:17.344ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 323 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33637 req_id = be323f89-497a-4c1d-a07e-7ff21979168e response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
23542024-11-25T19:36:17.369ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59673
23552024-11-25T19:36:17.369ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4173
23562024-11-25T19:36:17.404ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4197
23572024-11-25T19:36:17.460ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91210 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:59673 req_id = fb1f536e-2065-44d5-8e00-d0ab3a5e353f response_code = 204 uri = /switch-ports
23582024-11-25T19:36:17.460ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34290
23592024-11-25T19:36:17.460ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36166
23602024-11-25T19:36:17.460ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 229 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36166 req_id = 4d67660c-2fe7-4816-9505-6701d4d1c204 response_code = 200 uri = /v2p
23612024-11-25T19:36:17.460ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34290 req_id = b8de603d-09ff-4e18-9f4d-0133c153eff8 response_code = 200 uri = /vpc-routes
23622024-11-25T19:36:17.460ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 292 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59673 req_id = 2b792a67-0e2a-4876-bf84-f2f7e7528277 response_code = 200 uri = /network-bootstore-config
23632024-11-25T19:36:17.502ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b values = ExternalIpGatewayMap { mappings: {} }
23642024-11-25T19:36:17.502ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34290 req_id = cb2df993-7134-4ead-8846-8825629ad1ab response_code = 204 uri = /eip-gateways
23652024-11-25T19:36:17.514ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 229 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34290 req_id = 0c26a4f7-47d6-416f-b813-93f3dd504a50 response_code = 204 uri = /vpc-routes
23662024-11-25T19:36:17.694ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61448
23672024-11-25T19:36:17.694ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4173
23682024-11-25T19:36:17.732ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4197
23692024-11-25T19:36:17.788ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93991 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:61448 req_id = f2ef9e23-9ff4-40a3-997c-85b037550df0 response_code = 204 uri = /switch-ports
23702024-11-25T19:36:17.788ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61430
23712024-11-25T19:36:17.788ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: d231a61b-6b3d-4ea9-b8ff-35ab162113d2, kind: Service { id: 5e357e48-2959-4886-8b9d-557b95c45fb7 }, name: Name("external-dns-5e357e48-2959-4886-8b9d-557b95c45fb7"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 225, 146])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f04f2a94-1775-401c-8f4b-f933311d21a8, kind: Service { id: 6b3cbeea-c72e-481d-a7a1-e27c601ccb03 }, name: Name("external-dns-6b3cbeea-c72e-481d-a7a1-e27c601ccb03"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 175, 189])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5304be8f-eb23-4485-b885-5b368db0b5b6, kind: Service { id: 1d808376-6b5a-46f0-b373-d7ba578556eb }, name: Name("nexus-1d808376-6b5a-46f0-b373-d7ba578556eb"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 88])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7c489787-90c9-4b93-99c1-8a1f226c1096, kind: Service { id: a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67 }, name: Name("nexus-a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 161, 21])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d755e6b0-59ef-4a09-9894-b39bfb858111, kind: Service { id: 29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037 }, name: Name("nexus-29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 3])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
23722024-11-25T19:36:17.788ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 257 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61448 req_id = b9565e82-4bb9-4fcb-ac98-7ed48509b35a response_code = 200 uri = /network-bootstore-config
23732024-11-25T19:36:17.788ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23742024-11-25T19:36:17.789ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23752024-11-25T19:36:17.789ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
23762024-11-25T19:36:17.789ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23772024-11-25T19:36:17.789ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23782024-11-25T19:36:17.789ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23792024-11-25T19:36:17.789ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 452 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61430 req_id = 5563df22-03af-48ba-ac18-7cc3aede3e72 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
23802024-11-25T19:36:21.244ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:62196
23812024-11-25T19:36:21.244ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 25 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:62196 req_id = de8e0827-2216-4052-84e0-b81533fd3b98 response_code = 200 uri = /baseboard
23822024-11-25T19:36:37.297ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7712 local_addr = [fd00:1122:3344:101::1]:49777 method = GET remote_addr = [fd00:1122:3344:101::d]:58688 req_id = 5df344a5-5a24-4460-8e13-faa3e1cfab35 response_code = 200 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b uri = /38711855-ef69-4d79-bb75-aebd85b1280b
23832024-11-25T19:36:46.443ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63239
23842024-11-25T19:36:46.443ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63239 req_id = 6a38cce2-f45b-48d9-9b89-e4860d0c831a response_code = 200 uri = /vpc-routes
23852024-11-25T19:36:46.484ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b values = ExternalIpGatewayMap { mappings: {} }
23862024-11-25T19:36:46.484ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63239 req_id = 1ab52dcd-7b9b-4407-8e82-a4aab7065a84 response_code = 204 uri = /eip-gateways
23872024-11-25T19:36:46.493ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 225 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63239 req_id = bd0d0032-6532-4b40-b73d-16725fe8dc37 response_code = 204 uri = /vpc-routes
23882024-11-25T19:36:46.567ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57060
23892024-11-25T19:36:46.567ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4173
23902024-11-25T19:36:46.605ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4197
23912024-11-25T19:36:46.664ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96934 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:57060 req_id = 811b5f83-06fe-4289-bc57-9a5cea278ed7 response_code = 204 uri = /switch-ports
23922024-11-25T19:36:46.665ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53877
23932024-11-25T19:36:46.665ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57060 req_id = 17abc587-3118-4077-a3b0-c0ac61b0d69f response_code = 200 uri = /network-bootstore-config
23942024-11-25T19:36:46.665ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 176 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53877 req_id = b1b9b659-e0d1-493e-b5dc-c8638f0c912e response_code = 200 uri = /v2p
23952024-11-25T19:36:47.133ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47728
23962024-11-25T19:36:47.133ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47728 req_id = 01d778a2-6ac9-4741-9b1b-ba47f7aa1020 response_code = 200 uri = /vpc-routes
23972024-11-25T19:36:47.149ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b values = ExternalIpGatewayMap { mappings: {} }
23982024-11-25T19:36:47.149ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47728 req_id = 9ffe2d77-7c10-4fd7-a9ab-689550acb77b response_code = 204 uri = /eip-gateways
23992024-11-25T19:36:47.165ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 479 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47728 req_id = 59543f4a-41f2-4e63-9eab-a455e8508ab5 response_code = 204 uri = /vpc-routes
24002024-11-25T19:36:47.200ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52891
24012024-11-25T19:36:47.201ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52891 req_id = 75611950-4ee0-4c36-a302-d625211bab36 response_code = 200 uri = /v2p
24022024-11-25T19:36:47.215ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44411
24032024-11-25T19:36:47.215ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4173
24042024-11-25T19:36:47.256ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4197
24052024-11-25T19:36:47.310ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94904 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:44411 req_id = f5d2c8fe-7910-4dea-b247-48a41c5cc8db response_code = 204 uri = /switch-ports
24062024-11-25T19:36:47.310ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41264
24072024-11-25T19:36:47.311ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41264 req_id = bbe012d7-c6ae-4d6d-9664-06cf983dd25e response_code = 200 uri = /vpc-routes
24082024-11-25T19:36:47.311ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44411 req_id = 3e28fb93-8baa-49cf-9ccf-e403a62624b7 response_code = 200 uri = /network-bootstore-config
24092024-11-25T19:36:47.354ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64181
24102024-11-25T19:36:47.354ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64181 req_id = 8dc6d7bc-b053-4728-86f7-e88384421a54 response_code = 200 uri = /v2p
24112024-11-25T19:36:47.358ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b values = ExternalIpGatewayMap { mappings: {} }
24122024-11-25T19:36:47.358ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41264 req_id = f3928586-4225-4abe-9b23-5f4981ec147d response_code = 204 uri = /eip-gateways
24132024-11-25T19:36:47.366ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61586
24142024-11-25T19:36:47.367ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4173
24152024-11-25T19:36:47.406ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4197
24162024-11-25T19:36:47.461ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94914 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:61586 req_id = e0e6f12d-0b5e-453b-8eb3-249e89d2f362 response_code = 204 uri = /switch-ports
24172024-11-25T19:36:47.462ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 239 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61586 req_id = 202ccb36-6026-46ef-9db0-ac90a2475795 response_code = 200 uri = /network-bootstore-config
24182024-11-25T19:36:47.462ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 311 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41264 req_id = 29723980-7d59-4d00-b69c-accfed9e808e response_code = 204 uri = /vpc-routes
24192024-11-25T19:36:51.276ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:55600
24202024-11-25T19:36:51.276ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:55600 req_id = e675a908-1405-44b8-bf8f-4342a6d920bd response_code = 200 uri = /baseboard
24212024-11-25T19:37:07.296ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6197 local_addr = [fd00:1122:3344:101::1]:49777 method = GET remote_addr = [fd00:1122:3344:101::d]:58688 req_id = daf34f0d-4cbb-4c98-8119-6045497b2db5 response_code = 200 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b uri = /38711855-ef69-4d79-bb75-aebd85b1280b
24222024-11-25T19:37:16.638ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51758
24232024-11-25T19:37:16.638ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51758 req_id = 938600af-64c9-426e-a517-f9f0ae325aa3 response_code = 200 uri = /vpc-routes
24242024-11-25T19:37:16.677ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b values = ExternalIpGatewayMap { mappings: {} }
24252024-11-25T19:37:16.677ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51758 req_id = 08d64cf0-c21d-4364-aa5c-525efded2e7c response_code = 204 uri = /eip-gateways
24262024-11-25T19:37:16.686ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 170 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51758 req_id = dedea9bc-49e1-4bf3-8ddb-40878580a076 response_code = 204 uri = /vpc-routes
24272024-11-25T19:37:16.826ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42057
24282024-11-25T19:37:16.826ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42057 req_id = 6b79ebbc-e19e-488d-80c6-0a0b7feaca08 response_code = 200 uri = /v2p
24292024-11-25T19:37:16.841ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60430
24302024-11-25T19:37:16.841ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4173
24312024-11-25T19:37:16.886ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4197
24322024-11-25T19:37:16.974ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 132379 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:60430 req_id = 349aab20-d1a2-416a-ac1d-3a5f766d846d response_code = 204 uri = /switch-ports
24332024-11-25T19:37:16.974ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60430 req_id = a2405b8c-a694-4301-92f6-167287e9de77 response_code = 200 uri = /network-bootstore-config
24342024-11-25T19:37:17.226ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35061
24352024-11-25T19:37:17.226ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35061 req_id = 85c33a06-a00d-4c05-80e7-74cbfbdd5867 response_code = 200 uri = /vpc-routes
24362024-11-25T19:37:17.239ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57674
24372024-11-25T19:37:17.240ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57674 req_id = a639bb4e-addd-4b29-b858-73465ddb7dce response_code = 200 uri = /v2p
24382024-11-25T19:37:17.242ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b values = ExternalIpGatewayMap { mappings: {} }
24392024-11-25T19:37:17.242ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35061 req_id = 486777d9-095f-4abb-8a06-21e3ee49ddfd response_code = 204 uri = /eip-gateways
24402024-11-25T19:37:17.252ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 172 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35061 req_id = 36e22470-733d-4d5d-bd91-43a92ab3b315 response_code = 204 uri = /vpc-routes
24412024-11-25T19:37:17.439ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51144
24422024-11-25T19:37:17.439ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4173
24432024-11-25T19:37:17.477ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4197
24442024-11-25T19:37:17.534ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94870 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:51144 req_id = 2527e4ca-d3b7-48fd-868d-a97e94feda51 response_code = 204 uri = /switch-ports
24452024-11-25T19:37:17.534ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54026
24462024-11-25T19:37:17.534ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54126
24472024-11-25T19:37:17.534ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54026 req_id = 631f81ed-0d97-49af-9835-eb3a8ffc5d0f response_code = 200 uri = /vpc-routes
24482024-11-25T19:37:17.534ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 296 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51144 req_id = 26c8ec03-419e-4a5d-a90f-8bdc3cb14055 response_code = 200 uri = /network-bootstore-config
24492024-11-25T19:37:17.534ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 210 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54126 req_id = c0a18049-7b3c-40d6-ab0a-0cdf34be2cc6 response_code = 200 uri = /v2p
24502024-11-25T19:37:17.539ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45016
24512024-11-25T19:37:17.539ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4173
24522024-11-25T19:37:17.577ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4197
24532024-11-25T19:37:17.631ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92438 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:45016 req_id = f25f70aa-f934-491e-9153-31d429577571 response_code = 204 uri = /switch-ports
24542024-11-25T19:37:17.632ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b values = ExternalIpGatewayMap { mappings: {} }
24552024-11-25T19:37:17.632ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 202 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54026 req_id = d10d19d5-9f34-493d-a57f-7245c7fb4a0d response_code = 204 uri = /eip-gateways
24562024-11-25T19:37:17.632ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 258 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45016 req_id = 2aff62ce-b1b0-436a-bb37-3c288eaac28d response_code = 200 uri = /network-bootstore-config
24572024-11-25T19:37:17.641ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 231 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54026 req_id = 9b0a92bb-75ba-4065-a18a-96a2f6967d10 response_code = 204 uri = /vpc-routes
24582024-11-25T19:37:21.309ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:63396
24592024-11-25T19:37:21.309ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:63396 req_id = 8ac420ae-8810-4774-b72a-6bb466198c85 response_code = 200 uri = /baseboard
24602024-11-25T19:37:37.296ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6320 local_addr = [fd00:1122:3344:101::1]:49777 method = GET remote_addr = [fd00:1122:3344:101::d]:58688 req_id = 82829c47-cbcc-44b3-ae8a-ce40321769ed response_code = 200 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b uri = /38711855-ef69-4d79-bb75-aebd85b1280b
24612024-11-25T19:37:45.679ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:197
24622024-11-25T19:37:45.679ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
24632024-11-25T19:37:45.707ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 2091, tv_nsec: 252399718 } time_to_next_cleanup = 599.99999721s
24642024-11-25T19:37:46.371ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35543
24652024-11-25T19:37:46.371ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35543 req_id = 014f937f-7146-47b4-bea9-0bf7700cf3d5 response_code = 200 uri = /v2p
24662024-11-25T19:37:46.440ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56802
24672024-11-25T19:37:46.440ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56802 req_id = 49d354fc-5b85-4420-a5ac-5a5fc7cdb7ed response_code = 200 uri = /vpc-routes
24682024-11-25T19:37:46.454ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b values = ExternalIpGatewayMap { mappings: {} }
24692024-11-25T19:37:46.454ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56802 req_id = a1ecb4bb-6e69-4735-a83b-3dc170eb54df response_code = 204 uri = /eip-gateways
24702024-11-25T19:37:46.463ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 237 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56802 req_id = bf02fc5b-bf4a-4888-a04d-6c21f4bfa01c response_code = 204 uri = /vpc-routes
24712024-11-25T19:37:46.531ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57901
24722024-11-25T19:37:46.531ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4173
24732024-11-25T19:37:46.567ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4197
24742024-11-25T19:37:46.616ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85360 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:57901 req_id = 5b7ff7ce-9803-4a6c-a0bc-9ac7383d98bc response_code = 204 uri = /switch-ports
24752024-11-25T19:37:46.616ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57901 req_id = c3fb74a1-4370-469d-a005-a56ec839b139 response_code = 200 uri = /network-bootstore-config
24762024-11-25T19:37:46.989ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37466
24772024-11-25T19:37:46.989ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37466 req_id = fe77862a-b2d0-4158-9452-7e6159ca2f25 response_code = 200 uri = /vpc-routes
24782024-11-25T19:37:47.040ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b values = ExternalIpGatewayMap { mappings: {} }
24792024-11-25T19:37:47.040ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37466 req_id = 11ab8e38-b8b9-4578-b860-8853d3e1a0ee response_code = 204 uri = /eip-gateways
24802024-11-25T19:37:47.050ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 237 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37466 req_id = af3276bf-eace-44d9-b84b-78be9f8c7967 response_code = 204 uri = /vpc-routes
24812024-11-25T19:37:47.217ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59099
24822024-11-25T19:37:47.217ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4173
24832024-11-25T19:37:47.249ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4197
24842024-11-25T19:37:47.304ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86950 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:59099 req_id = ac74eaea-c8d9-43f3-a5ce-6a4419f00f50 response_code = 204 uri = /switch-ports
24852024-11-25T19:37:47.304ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54394
24862024-11-25T19:37:47.304ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43357
24872024-11-25T19:37:47.304ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43357 req_id = 42a24913-998e-4e14-a921-99513cb4dfaf response_code = 200 uri = /vpc-routes
24882024-11-25T19:37:47.305ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 302 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59099 req_id = f0c915ac-a9c0-44c5-ad74-03cd6e01f910 response_code = 200 uri = /network-bootstore-config
24892024-11-25T19:37:47.305ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 258 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54394 req_id = 7fe33dee-18a6-4587-95ea-a2fc3c40fea3 response_code = 200 uri = /v2p
24902024-11-25T19:37:47.320ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b values = ExternalIpGatewayMap { mappings: {} }
24912024-11-25T19:37:47.320ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43357 req_id = 3bb38c80-b476-4b7b-9b83-114df1c1b59d response_code = 204 uri = /eip-gateways
24922024-11-25T19:37:47.326ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52586
24932024-11-25T19:37:47.327ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52586 req_id = 2117606c-cc91-4167-85aa-a78214f57f2d response_code = 200 uri = /v2p
24942024-11-25T19:37:47.333ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 226 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43357 req_id = bdb5e972-3352-4391-bbfd-5b8ce8325f00 response_code = 204 uri = /vpc-routes
24952024-11-25T19:37:47.372ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57998
24962024-11-25T19:37:47.372ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4173
24972024-11-25T19:37:47.407ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4197
24982024-11-25T19:37:47.456ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83674 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:57998 req_id = 0a66f2ab-8ae6-4fc8-bb09-ab80a78bbe82 response_code = 204 uri = /switch-ports
24992024-11-25T19:37:47.456ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57998 req_id = 4bcf9ea8-e774-485b-9424-35ca20a31100 response_code = 200 uri = /network-bootstore-config
25002024-11-25T19:37:51.342ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:46223
25012024-11-25T19:37:51.342ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:46223 req_id = 36f6db76-76df-4723-800c-00f851e22734 response_code = 200 uri = /baseboard
25022024-11-25T19:38:00.674ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
25032024-11-25T19:38:07.296ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6037 local_addr = [fd00:1122:3344:101::1]:49777 method = GET remote_addr = [fd00:1122:3344:101::d]:58688 req_id = 7b7252c3-ce25-44cc-9b30-c5d65ca153cd response_code = 200 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b uri = /38711855-ef69-4d79-bb75-aebd85b1280b
25042024-11-25T19:38:16.452ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40656
25052024-11-25T19:38:16.453ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40656 req_id = 0c39c626-6805-476e-97bc-7b57063c3795 response_code = 200 uri = /vpc-routes
25062024-11-25T19:38:16.496ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b values = ExternalIpGatewayMap { mappings: {} }
25072024-11-25T19:38:16.496ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40656 req_id = 7493ea8a-311c-4f36-a29f-3d2a6226d85e response_code = 204 uri = /eip-gateways
25082024-11-25T19:38:16.505ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 237 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40656 req_id = 6d457d55-c479-4ab5-a405-9a0b01f565cd response_code = 204 uri = /vpc-routes
25092024-11-25T19:38:16.774ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54492
25102024-11-25T19:38:16.774ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54492 req_id = bff2dcf8-f99b-4ed6-8ac4-0d5e214ff500 response_code = 200 uri = /v2p
25112024-11-25T19:38:16.824ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52717
25122024-11-25T19:38:16.824ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4173
25132024-11-25T19:38:16.863ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4197
25142024-11-25T19:38:16.956ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 131943 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:52717 req_id = 0ee52470-77fa-4775-b603-5f4406c9ad38 response_code = 204 uri = /switch-ports
25152024-11-25T19:38:16.956ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 251 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52717 req_id = eb238c6a-6374-40ad-b2bb-07fa902a627a response_code = 200 uri = /network-bootstore-config
25162024-11-25T19:38:17.350ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62932
25172024-11-25T19:38:17.350ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62932 req_id = 1db7907d-8a97-46a8-92d5-108b44e7ec46 response_code = 200 uri = /vpc-routes
25182024-11-25T19:38:17.381ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51975
25192024-11-25T19:38:17.382ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51975 req_id = 52df9371-f110-4904-bdf8-23a9c4c8c2ff response_code = 200 uri = /vpc-routes
25202024-11-25T19:38:17.397ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b values = ExternalIpGatewayMap { mappings: {} }
25212024-11-25T19:38:17.397ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62932 req_id = a8b6d2f1-236b-46a3-ba67-9a6cad04d727 response_code = 204 uri = /eip-gateways
25222024-11-25T19:38:17.427ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b values = ExternalIpGatewayMap { mappings: {} }
25232024-11-25T19:38:17.427ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 27 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51975 req_id = 909d9e33-cdec-4877-9304-52869e3df63a response_code = 204 uri = /eip-gateways
25242024-11-25T19:38:17.436ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51975 req_id = 90ff624a-2d0c-4023-ac9c-3384639e15aa response_code = 204 uri = /vpc-routes
25252024-11-25T19:38:17.455ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53472
25262024-11-25T19:38:17.455ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53472 req_id = b0dfdcf6-b31e-4bbd-a1c2-e055ca9df275 response_code = 200 uri = /v2p
25272024-11-25T19:38:17.496ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62730
25282024-11-25T19:38:17.496ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4173
25292024-11-25T19:38:17.533ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4197
25302024-11-25T19:38:17.590ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94267 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:62730 req_id = 95a55094-48a1-44b0-a5df-e74d04afa07f response_code = 204 uri = /switch-ports
25312024-11-25T19:38:17.590ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59382
25322024-11-25T19:38:17.591ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 351 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62932 req_id = e980b17e-5906-4eb5-88e9-0beefcae4c73 response_code = 204 uri = /vpc-routes
25332024-11-25T19:38:17.591ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 229 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59382 req_id = ee6e9f28-73dc-4339-ab37-db9c9b58e0e4 response_code = 200 uri = /v2p
25342024-11-25T19:38:17.591ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 308 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62730 req_id = 4c59877e-0b2a-4eeb-80e9-90bbc0aef50c response_code = 200 uri = /network-bootstore-config
25352024-11-25T19:38:17.618ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35991
25362024-11-25T19:38:17.618ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4173
25372024-11-25T19:38:17.653ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4197
25382024-11-25T19:38:17.706ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87640 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:35991 req_id = cd868dd3-df99-4375-84ac-4b557559930a response_code = 204 uri = /switch-ports
25392024-11-25T19:38:17.706ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35991 req_id = 6a6247ef-30fc-413e-a5dd-d0480cf857b9 response_code = 200 uri = /network-bootstore-config
25402024-11-25T19:38:21.374ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:52171
25412024-11-25T19:38:21.374ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:52171 req_id = 5a942c1b-c080-47a6-a61b-ac6623f19857 response_code = 200 uri = /baseboard
25422024-11-25T19:38:37.297ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7144 local_addr = [fd00:1122:3344:101::1]:49777 method = GET remote_addr = [fd00:1122:3344:101::d]:58688 req_id = 3001be50-5023-469d-ba95-5ceb37561ab2 response_code = 200 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b uri = /38711855-ef69-4d79-bb75-aebd85b1280b
25432024-11-25T19:38:46.415ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48615
25442024-11-25T19:38:46.415ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48615 req_id = 854c9e34-6be0-4cfd-8a70-70237b4b83d6 response_code = 200 uri = /vpc-routes
25452024-11-25T19:38:46.461ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b values = ExternalIpGatewayMap { mappings: {} }
25462024-11-25T19:38:46.461ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48615 req_id = f2c5a23e-d660-493c-8bd4-5ef311b34a4e response_code = 204 uri = /eip-gateways
25472024-11-25T19:38:46.463ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55417
25482024-11-25T19:38:46.463ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55417 req_id = cb18a2ac-0375-4655-b320-e8500f83b719 response_code = 200 uri = /v2p
25492024-11-25T19:38:46.470ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48615 req_id = 0a77655b-b175-4cbc-a233-4a9f957615ac response_code = 204 uri = /vpc-routes
25502024-11-25T19:38:46.497ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41780
25512024-11-25T19:38:46.497ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4173
25522024-11-25T19:38:46.534ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4197
25532024-11-25T19:38:46.590ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92667 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:41780 req_id = 9f30ade8-bf14-432b-916c-34ae22951444 response_code = 204 uri = /switch-ports
25542024-11-25T19:38:46.593ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41780 req_id = c643d747-56bd-466d-8615-250563dc16d6 response_code = 200 uri = /network-bootstore-config
25552024-11-25T19:38:47.011ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63062
25562024-11-25T19:38:47.011ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63062 req_id = c6412e56-00ce-43c9-90b8-93ee5c4f1593 response_code = 200 uri = /vpc-routes
25572024-11-25T19:38:47.029ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b values = ExternalIpGatewayMap { mappings: {} }
25582024-11-25T19:38:47.029ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 241 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63062 req_id = 374fb775-8cfb-4a02-b5a9-4aeb65dcd007 response_code = 204 uri = /eip-gateways
25592024-11-25T19:38:47.039ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 209 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63062 req_id = cf048a28-1daa-4485-a6e0-8db76cb6e21f response_code = 204 uri = /vpc-routes
25602024-11-25T19:38:47.099ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62192
25612024-11-25T19:38:47.099ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4173
25622024-11-25T19:38:47.146ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4197
25632024-11-25T19:38:47.209ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110728 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:62192 req_id = ff7cf100-98ca-4f51-9cd8-ff88a69dacf4 response_code = 204 uri = /switch-ports
25642024-11-25T19:38:47.210ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60577
25652024-11-25T19:38:47.210ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 170 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62192 req_id = 6e91dc8b-32e3-4981-a104-4e40320ea7c5 response_code = 200 uri = /network-bootstore-config
25662024-11-25T19:38:47.210ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 237 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60577 req_id = f7cc658c-47f8-47ff-8e83-ea0e8ded8ae4 response_code = 200 uri = /v2p
25672024-11-25T19:38:47.286ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60792
25682024-11-25T19:38:47.287ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60792 req_id = f3d2da02-f319-4931-a5ef-03771e527e5d response_code = 200 uri = /vpc-routes
25692024-11-25T19:38:47.301ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b values = ExternalIpGatewayMap { mappings: {} }
25702024-11-25T19:38:47.301ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60792 req_id = 31ec9673-b9cc-4c13-8726-4205f47afc57 response_code = 204 uri = /eip-gateways
25712024-11-25T19:38:47.310ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 245 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60792 req_id = 923c28d3-7602-4e8b-948f-f094f6d7b2e7 response_code = 204 uri = /vpc-routes
25722024-11-25T19:38:47.393ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35431
25732024-11-25T19:38:47.393ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35431 req_id = afb7863e-ae7b-4415-aeb5-35efb14aa43d response_code = 200 uri = /v2p
25742024-11-25T19:38:47.406ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49073
25752024-11-25T19:38:47.406ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4173
25762024-11-25T19:38:47.442ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4197
25772024-11-25T19:38:47.495ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89229 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:49073 req_id = d6e13e3e-0c9f-40fa-9b9e-382cfb85ca6a response_code = 204 uri = /switch-ports
25782024-11-25T19:38:47.495ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49073 req_id = d1849b81-90d1-429c-97e6-c0ce5c99620e response_code = 200 uri = /network-bootstore-config
25792024-11-25T19:38:51.408ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45855
25802024-11-25T19:38:51.408ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45855 req_id = 7bbc37a5-2a4d-4c32-b65b-ea7dfc1f5033 response_code = 200 uri = /baseboard
25812024-11-25T19:39:07.296ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5336 local_addr = [fd00:1122:3344:101::1]:49777 method = GET remote_addr = [fd00:1122:3344:101::d]:58688 req_id = 8a6a3c68-034d-471f-ad0d-88019dd10fac response_code = 200 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b uri = /38711855-ef69-4d79-bb75-aebd85b1280b
25822024-11-25T19:39:16.479ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46470
25832024-11-25T19:39:16.479ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46470 req_id = 012a7008-09ba-4fe4-8a40-cf2f1fd06883 response_code = 200 uri = /vpc-routes
25842024-11-25T19:39:16.554ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62948
25852024-11-25T19:39:16.554ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62948 req_id = be840e90-85cf-425a-b33e-2f64bbf11b5c response_code = 200 uri = /v2p
25862024-11-25T19:39:16.599ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b values = ExternalIpGatewayMap { mappings: {} }
25872024-11-25T19:39:16.599ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46470 req_id = 593e8b24-f0fe-4138-98c2-3c43bef982d0 response_code = 204 uri = /eip-gateways
25882024-11-25T19:39:16.607ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46470 req_id = 54aaad3d-568a-447d-9003-c130e5a7a465 response_code = 204 uri = /vpc-routes
25892024-11-25T19:39:16.686ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52853
25902024-11-25T19:39:16.686ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4173
25912024-11-25T19:39:16.719ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4197
25922024-11-25T19:39:16.773ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86847 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:52853 req_id = 3ceda023-c1c5-4f91-aa99-c59780024d5a response_code = 204 uri = /switch-ports
25932024-11-25T19:39:16.773ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52853 req_id = a1a97b51-6b5e-4e85-84a9-429316824bce response_code = 200 uri = /network-bootstore-config
25942024-11-25T19:39:17.172ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35403
25952024-11-25T19:39:17.172ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35403 req_id = 3af38a9d-bf05-4bfa-b227-81011f44755c response_code = 200 uri = /vpc-routes
25962024-11-25T19:39:17.229ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b values = ExternalIpGatewayMap { mappings: {} }
25972024-11-25T19:39:17.229ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35403 req_id = dcc6013e-e9cc-4ba9-afb5-81f65d89bb73 response_code = 204 uri = /eip-gateways
25982024-11-25T19:39:17.240ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 253 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35403 req_id = 9e6e563e-6738-4537-888b-ab31a0c50ef0 response_code = 204 uri = /vpc-routes
25992024-11-25T19:39:17.331ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51116
26002024-11-25T19:39:17.331ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51116 req_id = cc82fa6f-969e-44d0-8759-659424768ae8 response_code = 200 uri = /v2p
26012024-11-25T19:39:17.348ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48799
26022024-11-25T19:39:17.348ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48799 req_id = 6b67ec23-4c14-4787-ae5a-b8726d5e122e response_code = 200 uri = /vpc-routes
26032024-11-25T19:39:17.400ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b values = ExternalIpGatewayMap { mappings: {} }
26042024-11-25T19:39:17.400ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48799 req_id = a869788f-5562-497d-8eca-5fb8b6f2e7f8 response_code = 204 uri = /eip-gateways
26052024-11-25T19:39:17.410ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 280 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48799 req_id = b12e1dd6-784d-4e2f-85a7-80338ec5fc8d response_code = 204 uri = /vpc-routes
26062024-11-25T19:39:17.422ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38456
26072024-11-25T19:39:17.422ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4173
26082024-11-25T19:39:17.460ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4197
26092024-11-25T19:39:17.512ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89290 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:38456 req_id = 39f8d68a-f055-4c98-b7af-24a46f6bb388 response_code = 204 uri = /switch-ports
26102024-11-25T19:39:17.512ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38456 req_id = 8a8a1141-c6bc-44b2-97d4-994869ee6eb5 response_code = 200 uri = /network-bootstore-config
26112024-11-25T19:39:17.518ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55976
26122024-11-25T19:39:17.518ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55976 req_id = 705dd173-3534-4031-9646-0f6b354155d9 response_code = 200 uri = /v2p
26132024-11-25T19:39:17.556ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62649
26142024-11-25T19:39:17.556ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4173
26152024-11-25T19:39:17.589ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4197
26162024-11-25T19:39:17.639ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83298 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:62649 req_id = d57f3bde-ce31-477a-a24a-021211766257 response_code = 204 uri = /switch-ports
26172024-11-25T19:39:17.639ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62649 req_id = cdf3aea3-c07f-4c34-91f9-fb59fe683e35 response_code = 200 uri = /network-bootstore-config
26182024-11-25T19:39:21.441ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:51766
26192024-11-25T19:39:21.441ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 29 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:51766 req_id = aff26fc4-6f67-42b9-a2d3-29296839cc91 response_code = 200 uri = /baseboard
26202024-11-25T19:39:37.296ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5706 local_addr = [fd00:1122:3344:101::1]:49777 method = GET remote_addr = [fd00:1122:3344:101::d]:58688 req_id = 7f7edb5d-716a-4e3a-8219-00f50ab813ad response_code = 200 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b uri = /38711855-ef69-4d79-bb75-aebd85b1280b
26212024-11-25T19:39:46.356ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35844
26222024-11-25T19:39:46.356ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35844 req_id = cbeb8d21-c533-48c5-9983-9a57024b2ad7 response_code = 200 uri = /vpc-routes
26232024-11-25T19:39:46.410ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b values = ExternalIpGatewayMap { mappings: {} }
26242024-11-25T19:39:46.410ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35844 req_id = 38963e06-15df-467b-9ac5-4183ea2cdf4a response_code = 204 uri = /eip-gateways
26252024-11-25T19:39:46.423ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 250 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35844 req_id = 9a5a4858-230a-4e9f-983c-336acd3ef64a response_code = 204 uri = /vpc-routes
26262024-11-25T19:39:46.598ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64671
26272024-11-25T19:39:46.598ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64671 req_id = 377f467c-b9a2-488f-8b78-2f02f70ba929 response_code = 200 uri = /v2p
26282024-11-25T19:39:46.605ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33658
26292024-11-25T19:39:46.605ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4173
26302024-11-25T19:39:46.640ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4197
26312024-11-25T19:39:46.691ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86736 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:33658 req_id = 171acb2a-a1f8-460b-bb30-b64057df3fd3 response_code = 204 uri = /switch-ports
26322024-11-25T19:39:46.692ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33658 req_id = 7af3ca6c-a8c2-4443-8374-8434a2c1cea5 response_code = 200 uri = /network-bootstore-config
26332024-11-25T19:39:47.035ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33715
26342024-11-25T19:39:47.036ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33715 req_id = a1b696f2-a8b9-462b-84ae-e4e18c474350 response_code = 200 uri = /vpc-routes
26352024-11-25T19:39:47.051ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b values = ExternalIpGatewayMap { mappings: {} }
26362024-11-25T19:39:47.051ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33715 req_id = 2180261b-5083-4892-8e2f-eead07f87d2d response_code = 204 uri = /eip-gateways
26372024-11-25T19:39:47.063ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 299 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33715 req_id = f480b0c8-05d0-447b-8234-1c6e92391612 response_code = 204 uri = /vpc-routes
26382024-11-25T19:39:47.115ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56622
26392024-11-25T19:39:47.115ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56622 req_id = 079c753a-4534-4995-a67d-b8e0c2d72772 response_code = 200 uri = /v2p
26402024-11-25T19:39:47.166ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51457
26412024-11-25T19:39:47.166ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4173
26422024-11-25T19:39:47.204ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4197
26432024-11-25T19:39:47.258ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91484 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:51457 req_id = 6c1fd526-82aa-4340-a537-838451dddfc3 response_code = 204 uri = /switch-ports
26442024-11-25T19:39:47.258ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51457 req_id = c5104821-d9ee-430d-8b4f-e59a944a7674 response_code = 200 uri = /network-bootstore-config
26452024-11-25T19:39:47.268ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56703
26462024-11-25T19:39:47.268ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56703 req_id = 6b6c56ae-71d2-49ef-93b1-21da6386555f response_code = 200 uri = /vpc-routes
26472024-11-25T19:39:47.288ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b values = ExternalIpGatewayMap { mappings: {} }
26482024-11-25T19:39:47.288ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56703 req_id = 8f84f6ef-a134-4651-a21d-8020007fdff7 response_code = 204 uri = /eip-gateways
26492024-11-25T19:39:47.370ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50150
26502024-11-25T19:39:47.370ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50150 req_id = 86449e5e-0b57-4ede-986e-d84935d54ebc response_code = 200 uri = /v2p
26512024-11-25T19:39:47.378ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 222 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56703 req_id = 06df7b87-1d60-4c30-a480-2fda326b4552 response_code = 204 uri = /vpc-routes
26522024-11-25T19:39:47.442ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57394
26532024-11-25T19:39:47.442ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4173
26542024-11-25T19:39:47.478ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4197
26552024-11-25T19:39:47.531ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89347 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:57394 req_id = 2e174015-ff79-45bc-91a9-187442d6fbe2 response_code = 204 uri = /switch-ports
26562024-11-25T19:39:47.531ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57394 req_id = 0500c9d2-cf9e-4127-8269-1608d9b426d2 response_code = 200 uri = /network-bootstore-config
26572024-11-25T19:39:51.475ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:59717
26582024-11-25T19:39:51.475ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:59717 req_id = d82256fd-9b30-4821-bee7-478f7a0266ff response_code = 200 uri = /baseboard
26592024-11-25T19:40:07.297ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6221 local_addr = [fd00:1122:3344:101::1]:49777 method = GET remote_addr = [fd00:1122:3344:101::d]:58688 req_id = 136d1799-24bf-4a1c-8e28-8dbdfcc189c7 response_code = 200 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b uri = /38711855-ef69-4d79-bb75-aebd85b1280b
26602024-11-25T19:40:16.440ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47445
26612024-11-25T19:40:16.440ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47445 req_id = e7616ec3-c3c3-45fe-a830-a53df523d84c response_code = 200 uri = /vpc-routes
26622024-11-25T19:40:16.527ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b values = ExternalIpGatewayMap { mappings: {} }
26632024-11-25T19:40:16.527ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47445 req_id = 7ab41160-3d30-4e39-a729-c3dacec21182 response_code = 204 uri = /eip-gateways
26642024-11-25T19:40:16.538ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 280 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47445 req_id = d6c3e293-7a3e-445b-b062-3453b520a6f6 response_code = 204 uri = /vpc-routes
26652024-11-25T19:40:16.731ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49912
26662024-11-25T19:40:16.731ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49912 req_id = 4ff79957-3289-4987-97e6-9d883c2a0fd8 response_code = 200 uri = /v2p
26672024-11-25T19:40:16.783ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56545
26682024-11-25T19:40:16.783ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4173
26692024-11-25T19:40:16.819ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4197
26702024-11-25T19:40:16.875ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92851 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:56545 req_id = 6a219151-32d5-4da9-9492-e97f8f0ea39a response_code = 204 uri = /switch-ports
26712024-11-25T19:40:16.876ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56545 req_id = 8c74c656-bffb-46e3-9bd0-75f0e2a129de response_code = 200 uri = /network-bootstore-config
26722024-11-25T19:40:17.062ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60934
26732024-11-25T19:40:17.062ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60934 req_id = 5e7e7977-e4ae-49fc-b155-b12dbb16cd84 response_code = 200 uri = /vpc-routes
26742024-11-25T19:40:17.129ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b values = ExternalIpGatewayMap { mappings: {} }
26752024-11-25T19:40:17.129ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60934 req_id = 9b85f1c2-0b70-4e28-ac8e-5ae11ef18cc6 response_code = 204 uri = /eip-gateways
26762024-11-25T19:40:17.295ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45319
26772024-11-25T19:40:17.295ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45319 req_id = e96ce9fe-70ea-4880-9cb6-2ea2053a7f16 response_code = 200 uri = /vpc-routes
26782024-11-25T19:40:17.334ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34791
26792024-11-25T19:40:17.334ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34791 req_id = 5deb541d-68d0-4e64-b7ac-a059803701b9 response_code = 200 uri = /v2p
26802024-11-25T19:40:17.337ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 272 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60934 req_id = bc6baf5c-3588-4d26-8308-23fdcc0c9d7b response_code = 204 uri = /vpc-routes
26812024-11-25T19:40:17.361ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b values = ExternalIpGatewayMap { mappings: {} }
26822024-11-25T19:40:17.361ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45319 req_id = e27370b2-f907-4ebd-a27e-9d8b597cba6a response_code = 204 uri = /eip-gateways
26832024-11-25T19:40:17.371ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 245 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45319 req_id = 7f4339d4-7c91-4e9a-96b5-db870c0954c3 response_code = 204 uri = /vpc-routes
26842024-11-25T19:40:17.486ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58228
26852024-11-25T19:40:17.486ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4173
26862024-11-25T19:40:17.525ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4197
26872024-11-25T19:40:17.583ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96489 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:58228 req_id = bb05ecf6-fdd9-43d2-8411-ed9c28cd9cad response_code = 204 uri = /switch-ports
26882024-11-25T19:40:17.583ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37949
26892024-11-25T19:40:17.583ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58228 req_id = b6ae8e27-19be-4e7c-a581-460034c04575 response_code = 200 uri = /network-bootstore-config
26902024-11-25T19:40:17.583ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37949 req_id = c782edc7-87a6-4e36-ab4f-f2e4a33fb21c response_code = 200 uri = /v2p
26912024-11-25T19:40:17.639ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57721
26922024-11-25T19:40:17.639ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4173
26932024-11-25T19:40:17.678ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4197
26942024-11-25T19:40:17.735ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95753 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:57721 req_id = 615fd437-c3e8-4e6d-a39f-5db920b0bd1f response_code = 204 uri = /switch-ports
26952024-11-25T19:40:17.735ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57721 req_id = b1b56932-bdc3-4cb5-bd74-9caf7a28e509 response_code = 200 uri = /network-bootstore-config
26962024-11-25T19:40:21.508ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:34294
26972024-11-25T19:40:21.509ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:34294 req_id = cda79ab7-765a-4a6e-9d4b-6bf61ae9b4e7 response_code = 200 uri = /baseboard
26982024-11-25T19:40:37.297ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5660 local_addr = [fd00:1122:3344:101::1]:49777 method = GET remote_addr = [fd00:1122:3344:101::d]:58688 req_id = c5962cb9-5dcd-4c38-9ab9-aa71cc903ce6 response_code = 200 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b uri = /38711855-ef69-4d79-bb75-aebd85b1280b
26992024-11-25T19:40:46.399ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43267
27002024-11-25T19:40:46.399ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43267 req_id = 04e1f87f-d997-4112-be78-89f9d76e2243 response_code = 200 uri = /vpc-routes
27012024-11-25T19:40:46.443ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b values = ExternalIpGatewayMap { mappings: {} }
27022024-11-25T19:40:46.443ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43267 req_id = b6b2f055-67fd-45eb-86a6-98e531a24ce9 response_code = 204 uri = /eip-gateways
27032024-11-25T19:40:46.452ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 215 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43267 req_id = 3edef302-0ac4-4c1f-9033-5a9f3f8080eb response_code = 204 uri = /vpc-routes
27042024-11-25T19:40:46.476ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61233
27052024-11-25T19:40:46.476ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4173
27062024-11-25T19:40:46.513ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4197
27072024-11-25T19:40:46.566ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89770 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:61233 req_id = 2f8297e2-5673-416b-a594-3004e07741b4 response_code = 204 uri = /switch-ports
27082024-11-25T19:40:46.566ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50195
27092024-11-25T19:40:46.566ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 222 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50195 req_id = 0bed9d40-6dd5-4dd7-a118-ab928ea61d9a response_code = 200 uri = /v2p
27102024-11-25T19:40:46.566ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 263 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61233 req_id = 90bfcfa8-86c1-42d9-8845-ab5b611e9242 response_code = 200 uri = /network-bootstore-config
27112024-11-25T19:40:47.064ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53976
27122024-11-25T19:40:47.064ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53976 req_id = 9a478888-3d32-4f65-99e1-16f558371ace response_code = 200 uri = /vpc-routes
27132024-11-25T19:40:47.090ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33073
27142024-11-25T19:40:47.090ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33073 req_id = caa3cd0b-e9af-4880-bf20-5017a02ec0cc response_code = 200 uri = /v2p
27152024-11-25T19:40:47.128ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b values = ExternalIpGatewayMap { mappings: {} }
27162024-11-25T19:40:47.128ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53976 req_id = 2ee5e924-2a4e-467a-8ec8-98c6598835b0 response_code = 204 uri = /eip-gateways
27172024-11-25T19:40:47.138ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 178 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53976 req_id = 38a1e057-a238-4491-a68f-90a18a7c0bbe response_code = 204 uri = /vpc-routes
27182024-11-25T19:40:47.177ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58390
27192024-11-25T19:40:47.177ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4173
27202024-11-25T19:40:47.216ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4197
27212024-11-25T19:40:47.271ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93873 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:58390 req_id = f784b0da-b341-4112-890f-c03148775728 response_code = 204 uri = /switch-ports
27222024-11-25T19:40:47.271ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58973
27232024-11-25T19:40:47.272ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58973 req_id = e850f2bf-02c0-4b31-9f57-6ed1edc5ce71 response_code = 200 uri = /vpc-routes
27242024-11-25T19:40:47.272ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58390 req_id = df202f2e-5be9-4d89-a699-d53679d4aba5 response_code = 200 uri = /network-bootstore-config
27252024-11-25T19:40:47.298ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b values = ExternalIpGatewayMap { mappings: {} }
27262024-11-25T19:40:47.298ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58973 req_id = 3fb262f1-f5a1-4c4c-addc-40f256556db7 response_code = 204 uri = /eip-gateways
27272024-11-25T19:40:47.308ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 359 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58973 req_id = 210b515d-22eb-45ab-b925-5ec7b5cbb915 response_code = 204 uri = /vpc-routes
27282024-11-25T19:40:47.326ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40124
27292024-11-25T19:40:47.326ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4173
27302024-11-25T19:40:47.367ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4197
27312024-11-25T19:40:47.418ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91672 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:40124 req_id = 682eeea7-90e6-41fc-9b58-361bcccf22be response_code = 204 uri = /switch-ports
27322024-11-25T19:40:47.418ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63926
27332024-11-25T19:40:47.418ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40124 req_id = fa4904d6-1095-41c3-90b5-17f933933cee response_code = 200 uri = /network-bootstore-config
27342024-11-25T19:40:47.419ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63926 req_id = f6ced53c-da9e-4f92-9ed7-1709fd2464a6 response_code = 200 uri = /v2p
27352024-11-25T19:40:51.542ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:63783
27362024-11-25T19:40:51.542ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:63783 req_id = 4eb62570-74f5-4a84-b492-41066589c015 response_code = 200 uri = /baseboard
27372024-11-25T19:41:07.298ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6703 local_addr = [fd00:1122:3344:101::1]:49777 method = GET remote_addr = [fd00:1122:3344:101::d]:58688 req_id = 4f884fa6-4b92-43b8-b913-52bf70106fcd response_code = 200 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b uri = /38711855-ef69-4d79-bb75-aebd85b1280b
27382024-11-25T19:41:16.600ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54302
27392024-11-25T19:41:16.600ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54302 req_id = 12895691-f68f-4c6b-a076-f4476f552f67 response_code = 200 uri = /vpc-routes
27402024-11-25T19:41:16.648ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b values = ExternalIpGatewayMap { mappings: {} }
27412024-11-25T19:41:16.648ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54302 req_id = 17a0cf4d-981e-4294-bca6-9b340d948567 response_code = 204 uri = /eip-gateways
27422024-11-25T19:41:16.656ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54302 req_id = 88a44f3b-923d-42aa-a7a3-930898a82427 response_code = 204 uri = /vpc-routes
27432024-11-25T19:41:16.832ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36334
27442024-11-25T19:41:16.832ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36334 req_id = 7c71eb36-0198-40cc-b4a9-998fa5e66858 response_code = 200 uri = /v2p
27452024-11-25T19:41:16.859ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39729
27462024-11-25T19:41:16.859ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: d231a61b-6b3d-4ea9-b8ff-35ab162113d2, kind: Service { id: 5e357e48-2959-4886-8b9d-557b95c45fb7 }, name: Name("external-dns-5e357e48-2959-4886-8b9d-557b95c45fb7"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 225, 146])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f04f2a94-1775-401c-8f4b-f933311d21a8, kind: Service { id: 6b3cbeea-c72e-481d-a7a1-e27c601ccb03 }, name: Name("external-dns-6b3cbeea-c72e-481d-a7a1-e27c601ccb03"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 175, 189])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5304be8f-eb23-4485-b885-5b368db0b5b6, kind: Service { id: 1d808376-6b5a-46f0-b373-d7ba578556eb }, name: Name("nexus-1d808376-6b5a-46f0-b373-d7ba578556eb"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 88])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7c489787-90c9-4b93-99c1-8a1f226c1096, kind: Service { id: a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67 }, name: Name("nexus-a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 161, 21])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d755e6b0-59ef-4a09-9894-b39bfb858111, kind: Service { id: 29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037 }, name: Name("nexus-29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 3])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
27472024-11-25T19:41:16.859ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27482024-11-25T19:41:16.859ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27492024-11-25T19:41:16.859ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
27502024-11-25T19:41:16.859ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27512024-11-25T19:41:16.859ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27522024-11-25T19:41:16.859ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27532024-11-25T19:41:16.859ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 283 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39729 req_id = 33bf596c-695c-4add-971f-33b729d50aff response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
27542024-11-25T19:41:16.951ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53895
27552024-11-25T19:41:16.951ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
27562024-11-25T19:41:16.951ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
27572024-11-25T19:41:16.951ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/dd272387-9bb6-475e-8ebb-47dcac6d1d2a/config/omicron-zones.json file = common/src/ledger.rs:178
27582024-11-25T19:41:16.951ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/a4bf8354-b44e-436c-b4f2-9bd494b77342/config/omicron-zones.json file = common/src/ledger.rs:178
27592024-11-25T19:41:16.965ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 71fa9360-75cf-491a-b7ef-fd270ae2f32c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27602024-11-25T19:41:16.965ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_71fa9360-75cf-491a-b7ef-fd270ae2f32c
27612024-11-25T19:41:16.971ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54849
27622024-11-25T19:41:16.971ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4173
27632024-11-25T19:41:17.002ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: cc26c009-a951-4771-a26a-f2513b9e63e2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27642024-11-25T19:41:17.002ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_cc26c009-a951-4771-a26a-f2513b9e63e2
27652024-11-25T19:41:17.027ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4197
27662024-11-25T19:41:17.036ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 56aea45f-c451-4174-9b8f-66145c2696e8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27672024-11-25T19:41:17.036ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_56aea45f-c451-4174-9b8f-66145c2696e8
27682024-11-25T19:41:17.064ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d7af1128-7206-4198-91cb-ef632ea8556e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27692024-11-25T19:41:17.064ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_d7af1128-7206-4198-91cb-ef632ea8556e
27702024-11-25T19:41:17.103ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: fe712103-328f-4ff5-a621-99ae42de7f00 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27712024-11-25T19:41:17.103ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_fe712103-328f-4ff5-a621-99ae42de7f00
27722024-11-25T19:41:17.114ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 143359 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:54849 req_id = 8b388c6d-feef-4fa7-acbb-a43a40bf6061 response_code = 204 uri = /switch-ports
27732024-11-25T19:41:17.115ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 222 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54849 req_id = 0d04553c-e857-4a1b-9e71-87c8847af2ea response_code = 200 uri = /network-bootstore-config
27742024-11-25T19:41:17.152ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ca727341-d003-494b-b98d-9fa5b5aeeec8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27752024-11-25T19:41:17.152ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_ca727341-d003-494b-b98d-9fa5b5aeeec8
27762024-11-25T19:41:17.185ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1b4c5120-bb11-444d-9c86-edb04be1264c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27772024-11-25T19:41:17.185ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_1b4c5120-bb11-444d-9c86-edb04be1264c
27782024-11-25T19:41:17.201ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51628
27792024-11-25T19:41:17.202ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51628 req_id = c54a159e-4804-4590-a9af-4f28f4a912d3 response_code = 200 uri = /vpc-routes
27802024-11-25T19:41:17.217ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: df57d550-ef00-4438-9a9e-b1b08bdaa525 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27812024-11-25T19:41:17.217ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_df57d550-ef00-4438-9a9e-b1b08bdaa525
27822024-11-25T19:41:17.248ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2517e8b2-3022-4575-a6ad-4786cce7adb4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27832024-11-25T19:41:17.248ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_2517e8b2-3022-4575-a6ad-4786cce7adb4
27842024-11-25T19:41:17.265ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b values = ExternalIpGatewayMap { mappings: {} }
27852024-11-25T19:41:17.265ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51628 req_id = b2536e7b-09c7-45d5-9d66-f2975c5374a6 response_code = 204 uri = /eip-gateways
27862024-11-25T19:41:17.268ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 317516 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53895 req_id = b2942ff7-db19-4b4c-ae18-188eb50ab3fe response_code = 200 uri = /inventory
27872024-11-25T19:41:17.275ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 348 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51628 req_id = a3daaa29-74a2-4ee5-83ec-9d03bfaa7190 response_code = 204 uri = /vpc-routes
27882024-11-25T19:41:17.435ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47953
27892024-11-25T19:41:17.435ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47953 req_id = 7db07e7b-fefa-422f-a73d-6ec982f6707b response_code = 200 uri = /v2p
27902024-11-25T19:41:17.437ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33704
27912024-11-25T19:41:17.438ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
27922024-11-25T19:41:17.438ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
27932024-11-25T19:41:17.438ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/dd272387-9bb6-475e-8ebb-47dcac6d1d2a/config/omicron-zones.json file = common/src/ledger.rs:178
27942024-11-25T19:41:17.438ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/a4bf8354-b44e-436c-b4f2-9bd494b77342/config/omicron-zones.json file = common/src/ledger.rs:178
27952024-11-25T19:41:17.447ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40611
27962024-11-25T19:41:17.447ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40611 req_id = c427516f-effc-4648-a758-8f817d26a5af response_code = 200 uri = /vpc-routes
27972024-11-25T19:41:17.450ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 71fa9360-75cf-491a-b7ef-fd270ae2f32c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27982024-11-25T19:41:17.450ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_71fa9360-75cf-491a-b7ef-fd270ae2f32c
27992024-11-25T19:41:17.485ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: cc26c009-a951-4771-a26a-f2513b9e63e2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28002024-11-25T19:41:17.485ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_cc26c009-a951-4771-a26a-f2513b9e63e2
28012024-11-25T19:41:17.505ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b values = ExternalIpGatewayMap { mappings: {} }
28022024-11-25T19:41:17.506ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 191 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40611 req_id = 5fb90599-a2f8-4470-a6d2-cc061183df16 response_code = 204 uri = /eip-gateways
28032024-11-25T19:41:17.511ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43547
28042024-11-25T19:41:17.512ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4173
28052024-11-25T19:41:17.524ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 56aea45f-c451-4174-9b8f-66145c2696e8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28062024-11-25T19:41:17.524ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_56aea45f-c451-4174-9b8f-66145c2696e8
28072024-11-25T19:41:17.551ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d7af1128-7206-4198-91cb-ef632ea8556e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28082024-11-25T19:41:17.551ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_d7af1128-7206-4198-91cb-ef632ea8556e
28092024-11-25T19:41:17.557ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4197
28102024-11-25T19:41:17.577ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5087 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40611 req_id = d0cb0419-af7a-4962-9fb0-6d2860e53d63 response_code = 204 uri = /vpc-routes
28112024-11-25T19:41:17.579ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: fe712103-328f-4ff5-a621-99ae42de7f00 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28122024-11-25T19:41:17.579ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_fe712103-328f-4ff5-a621-99ae42de7f00
28132024-11-25T19:41:17.601ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47087
28142024-11-25T19:41:17.601ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
28152024-11-25T19:41:17.601ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
28162024-11-25T19:41:17.601ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/dd272387-9bb6-475e-8ebb-47dcac6d1d2a/config/omicron-zones.json file = common/src/ledger.rs:178
28172024-11-25T19:41:17.601ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/a4bf8354-b44e-436c-b4f2-9bd494b77342/config/omicron-zones.json file = common/src/ledger.rs:178
28182024-11-25T19:41:17.602ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ca727341-d003-494b-b98d-9fa5b5aeeec8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28192024-11-25T19:41:17.605ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_ca727341-d003-494b-b98d-9fa5b5aeeec8
28202024-11-25T19:41:17.617ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52592
28212024-11-25T19:41:17.617ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52592 req_id = a00e15cb-f8c7-4f65-8a3a-9d68baffb342 response_code = 200 uri = /v2p
28222024-11-25T19:41:17.619ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40585
28232024-11-25T19:41:17.620ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 71fa9360-75cf-491a-b7ef-fd270ae2f32c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28242024-11-25T19:41:17.620ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_71fa9360-75cf-491a-b7ef-fd270ae2f32c
28252024-11-25T19:41:17.623ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4173
28262024-11-25T19:41:17.624ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111998 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:43547 req_id = 18aa15e2-11b6-4b60-a3ca-afe93b7efb25 response_code = 204 uri = /switch-ports
28272024-11-25T19:41:17.631ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3981 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43547 req_id = be93b4af-9354-4eb0-89af-fb4d87a704b3 response_code = 200 uri = /network-bootstore-config
28282024-11-25T19:41:17.639ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1b4c5120-bb11-444d-9c86-edb04be1264c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28292024-11-25T19:41:17.639ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_1b4c5120-bb11-444d-9c86-edb04be1264c
28302024-11-25T19:41:17.654ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: cc26c009-a951-4771-a26a-f2513b9e63e2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28312024-11-25T19:41:17.654ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_cc26c009-a951-4771-a26a-f2513b9e63e2
28322024-11-25T19:41:17.672ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4197
28332024-11-25T19:41:17.679ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 56aea45f-c451-4174-9b8f-66145c2696e8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28342024-11-25T19:41:17.679ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_56aea45f-c451-4174-9b8f-66145c2696e8
28352024-11-25T19:41:17.684ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49408
28362024-11-25T19:41:17.685ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: d231a61b-6b3d-4ea9-b8ff-35ab162113d2, kind: Service { id: 5e357e48-2959-4886-8b9d-557b95c45fb7 }, name: Name("external-dns-5e357e48-2959-4886-8b9d-557b95c45fb7"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 225, 146])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f04f2a94-1775-401c-8f4b-f933311d21a8, kind: Service { id: 6b3cbeea-c72e-481d-a7a1-e27c601ccb03 }, name: Name("external-dns-6b3cbeea-c72e-481d-a7a1-e27c601ccb03"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 175, 189])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5304be8f-eb23-4485-b885-5b368db0b5b6, kind: Service { id: 1d808376-6b5a-46f0-b373-d7ba578556eb }, name: Name("nexus-1d808376-6b5a-46f0-b373-d7ba578556eb"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 88])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7c489787-90c9-4b93-99c1-8a1f226c1096, kind: Service { id: a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67 }, name: Name("nexus-a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 161, 21])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d755e6b0-59ef-4a09-9894-b39bfb858111, kind: Service { id: 29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037 }, name: Name("nexus-29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 3])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
28372024-11-25T19:41:17.685ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28382024-11-25T19:41:17.685ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28392024-11-25T19:41:17.685ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
28402024-11-25T19:41:17.685ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28412024-11-25T19:41:17.685ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28422024-11-25T19:41:17.688ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28432024-11-25T19:41:17.688ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4020 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49408 req_id = d0620384-1e59-44fb-b04a-e8aa14cacba4 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
28442024-11-25T19:41:17.693ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: df57d550-ef00-4438-9a9e-b1b08bdaa525 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28452024-11-25T19:41:17.693ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_df57d550-ef00-4438-9a9e-b1b08bdaa525
28462024-11-25T19:41:17.710ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d7af1128-7206-4198-91cb-ef632ea8556e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28472024-11-25T19:41:17.710ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_d7af1128-7206-4198-91cb-ef632ea8556e
28482024-11-25T19:41:17.724ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2517e8b2-3022-4575-a6ad-4786cce7adb4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28492024-11-25T19:41:17.724ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_2517e8b2-3022-4575-a6ad-4786cce7adb4
28502024-11-25T19:41:17.742ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123282 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:40585 req_id = 8bd0ebd6-d1bb-4acc-bfb0-12d8f584b21a response_code = 204 uri = /switch-ports
28512024-11-25T19:41:17.743ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 341 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40585 req_id = 941c8137-ab1f-4cbd-b26e-a7acd466ab76 response_code = 200 uri = /network-bootstore-config
28522024-11-25T19:41:17.743ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 305443 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33704 req_id = 942ce048-ab52-4feb-932b-28cced510aa4 response_code = 200 uri = /inventory
28532024-11-25T19:41:17.750ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: fe712103-328f-4ff5-a621-99ae42de7f00 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28542024-11-25T19:41:17.750ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_fe712103-328f-4ff5-a621-99ae42de7f00
28552024-11-25T19:41:17.774ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ca727341-d003-494b-b98d-9fa5b5aeeec8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28562024-11-25T19:41:17.774ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_ca727341-d003-494b-b98d-9fa5b5aeeec8
28572024-11-25T19:41:17.796ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1b4c5120-bb11-444d-9c86-edb04be1264c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28582024-11-25T19:41:17.796ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_1b4c5120-bb11-444d-9c86-edb04be1264c
28592024-11-25T19:41:17.818ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: df57d550-ef00-4438-9a9e-b1b08bdaa525 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28602024-11-25T19:41:17.818ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_df57d550-ef00-4438-9a9e-b1b08bdaa525
28612024-11-25T19:41:17.841ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2517e8b2-3022-4575-a6ad-4786cce7adb4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28622024-11-25T19:41:17.841ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_2517e8b2-3022-4575-a6ad-4786cce7adb4
28632024-11-25T19:41:17.854ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 252701 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47087 req_id = 40a0ace9-387e-4d2e-b633-502ff702a91b response_code = 200 uri = /inventory
28642024-11-25T19:41:17.883ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35419
28652024-11-25T19:41:17.883ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: d231a61b-6b3d-4ea9-b8ff-35ab162113d2, kind: Service { id: 5e357e48-2959-4886-8b9d-557b95c45fb7 }, name: Name("external-dns-5e357e48-2959-4886-8b9d-557b95c45fb7"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 225, 146])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f04f2a94-1775-401c-8f4b-f933311d21a8, kind: Service { id: 6b3cbeea-c72e-481d-a7a1-e27c601ccb03 }, name: Name("external-dns-6b3cbeea-c72e-481d-a7a1-e27c601ccb03"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 175, 189])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5304be8f-eb23-4485-b885-5b368db0b5b6, kind: Service { id: 1d808376-6b5a-46f0-b373-d7ba578556eb }, name: Name("nexus-1d808376-6b5a-46f0-b373-d7ba578556eb"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 88])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7c489787-90c9-4b93-99c1-8a1f226c1096, kind: Service { id: a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67 }, name: Name("nexus-a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 161, 21])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d755e6b0-59ef-4a09-9894-b39bfb858111, kind: Service { id: 29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037 }, name: Name("nexus-29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 3])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
28662024-11-25T19:41:17.883ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28672024-11-25T19:41:17.883ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28682024-11-25T19:41:17.883ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
28692024-11-25T19:41:17.883ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28702024-11-25T19:41:17.883ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28712024-11-25T19:41:17.883ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28722024-11-25T19:41:17.883ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 229 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35419 req_id = c80275bb-bdc9-4c8d-9f92-f224e443c58e response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
28732024-11-25T19:41:21.576ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:44099
28742024-11-25T19:41:21.577ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:44099 req_id = 9f972faf-24c6-47c3-91f1-e117e84d6347 response_code = 200 uri = /baseboard
28752024-11-25T19:41:37.297ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5736 local_addr = [fd00:1122:3344:101::1]:49777 method = GET remote_addr = [fd00:1122:3344:101::d]:58688 req_id = a20b76d0-4890-4559-895c-e574a34f0f34 response_code = 200 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b uri = /38711855-ef69-4d79-bb75-aebd85b1280b
28762024-11-25T19:41:46.430ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48165
28772024-11-25T19:41:46.430ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48165 req_id = a1b10663-6571-4152-8250-7b49422d0315 response_code = 200 uri = /vpc-routes
28782024-11-25T19:41:46.475ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b values = ExternalIpGatewayMap { mappings: {} }
28792024-11-25T19:41:46.475ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48165 req_id = 3c88606f-c62f-4df5-b2fa-c73e30808b67 response_code = 204 uri = /eip-gateways
28802024-11-25T19:41:46.484ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 237 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48165 req_id = a913c3c3-737b-4916-bf9b-bb04059f5afa response_code = 204 uri = /vpc-routes
28812024-11-25T19:41:46.534ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48668
28822024-11-25T19:41:46.535ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48668 req_id = 40fac408-726d-4250-bce4-506b972d2521 response_code = 200 uri = /v2p
28832024-11-25T19:41:46.536ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59691
28842024-11-25T19:41:46.536ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4173
28852024-11-25T19:41:46.574ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4197
28862024-11-25T19:41:46.626ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89931 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:59691 req_id = 2f402da6-47f9-4717-abcc-3a02918e1bee response_code = 204 uri = /switch-ports
28872024-11-25T19:41:46.626ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59691 req_id = 80ee9407-98a6-4b34-bc0e-2261997d80fe response_code = 200 uri = /network-bootstore-config
28882024-11-25T19:41:47.076ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57583
28892024-11-25T19:41:47.076ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57583 req_id = adb94de2-83b5-4d10-aa9b-1d74bc7293e0 response_code = 200 uri = /vpc-routes
28902024-11-25T19:41:47.094ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b values = ExternalIpGatewayMap { mappings: {} }
28912024-11-25T19:41:47.094ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57583 req_id = a692c206-e89a-40b4-b125-5f655caea273 response_code = 204 uri = /eip-gateways
28922024-11-25T19:41:47.105ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 252 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57583 req_id = e19b3e09-e9c0-431e-9655-47f8d5cac67a response_code = 204 uri = /vpc-routes
28932024-11-25T19:41:47.182ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51138
28942024-11-25T19:41:47.182ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51138 req_id = f36de72c-8abb-4959-a79e-43ae8b97baf6 response_code = 200 uri = /v2p
28952024-11-25T19:41:47.205ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63694
28962024-11-25T19:41:47.205ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4173
28972024-11-25T19:41:47.244ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4197
28982024-11-25T19:41:47.307ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101890 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:63694 req_id = c6547530-ec8e-424a-b935-15fb65b71c76 response_code = 204 uri = /switch-ports
28992024-11-25T19:41:47.307ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38750
29002024-11-25T19:41:47.307ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38750 req_id = e20ad0d1-083e-4e74-9e40-3beb1465af4e response_code = 200 uri = /vpc-routes
29012024-11-25T19:41:47.307ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63694 req_id = 3f109434-6fa5-49e2-a0e7-5487daed4b64 response_code = 200 uri = /network-bootstore-config
29022024-11-25T19:41:47.323ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40737
29032024-11-25T19:41:47.323ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4173
29042024-11-25T19:41:47.361ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4197
29052024-11-25T19:41:47.415ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91554 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:40737 req_id = f6aa30c5-09fb-4e56-8665-e5bd998706b4 response_code = 204 uri = /switch-ports
29062024-11-25T19:41:47.415ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58950
29072024-11-25T19:41:47.416ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b values = ExternalIpGatewayMap { mappings: {} }
29082024-11-25T19:41:47.416ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 227 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38750 req_id = 0dac7e37-0a08-4c60-87d6-d967888ec7fe response_code = 204 uri = /eip-gateways
29092024-11-25T19:41:47.416ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 290 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40737 req_id = 8ce0989a-d0fe-4ce7-b5e9-af80e5c85d36 response_code = 200 uri = /network-bootstore-config
29102024-11-25T19:41:47.416ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 232 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58950 req_id = 2f1461de-2d5c-40e0-b616-627636386984 response_code = 200 uri = /v2p
29112024-11-25T19:41:47.426ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 232 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38750 req_id = 79d1237f-010a-48f8-afb7-0a4e3205e19d response_code = 204 uri = /vpc-routes
29122024-11-25T19:41:51.609ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36794
29132024-11-25T19:41:51.609ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36794 req_id = ca3e7104-3a2d-4bb6-b703-0f3a10f79164 response_code = 200 uri = /baseboard
29142024-11-25T19:42:07.298ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6148 local_addr = [fd00:1122:3344:101::1]:49777 method = GET remote_addr = [fd00:1122:3344:101::d]:58688 req_id = e9728a1c-8a37-4dcd-9db2-7c19b60fc816 response_code = 200 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b uri = /38711855-ef69-4d79-bb75-aebd85b1280b
29152024-11-25T19:42:16.692ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58815
29162024-11-25T19:42:16.692ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58815 req_id = 61c56d95-c6c0-491a-a41e-d9798501b426 response_code = 200 uri = /v2p
29172024-11-25T19:42:16.719ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59532
29182024-11-25T19:42:16.719ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59532 req_id = 2d878f90-eb11-4989-b278-45abf15c8204 response_code = 200 uri = /vpc-routes
29192024-11-25T19:42:16.759ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b values = ExternalIpGatewayMap { mappings: {} }
29202024-11-25T19:42:16.759ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59532 req_id = e8d55c8f-f8fd-421f-b1c6-2a2d4f18da6c response_code = 204 uri = /eip-gateways
29212024-11-25T19:42:16.768ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 261 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59532 req_id = fba31373-2f9d-4251-b6d6-4f1755d720bf response_code = 204 uri = /vpc-routes
29222024-11-25T19:42:16.802ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49598
29232024-11-25T19:42:16.802ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4173
29242024-11-25T19:42:16.834ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4197
29252024-11-25T19:42:16.906ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103601 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:49598 req_id = 8d80c5c0-9c6c-4171-9c22-90b07beb8d58 response_code = 204 uri = /switch-ports
29262024-11-25T19:42:16.906ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49598 req_id = 862a4f47-310b-4338-93c2-f8f5905eac9a response_code = 200 uri = /network-bootstore-config
29272024-11-25T19:42:17.165ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60592
29282024-11-25T19:42:17.165ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60592 req_id = 2ffd876d-d7b1-4ef5-94b7-834da7409c96 response_code = 200 uri = /vpc-routes
29292024-11-25T19:42:17.213ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b values = ExternalIpGatewayMap { mappings: {} }
29302024-11-25T19:42:17.213ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60592 req_id = 19dc4625-1042-4af8-9d51-053e8ee5e437 response_code = 204 uri = /eip-gateways
29312024-11-25T19:42:17.223ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 238 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60592 req_id = 50b4c32c-a332-42b1-9bcc-3ce8969f664a response_code = 204 uri = /vpc-routes
29322024-11-25T19:42:17.276ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56362
29332024-11-25T19:42:17.276ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56362 req_id = d9944a8e-82db-4ec8-b7f2-d7c7c95f5939 response_code = 200 uri = /vpc-routes
29342024-11-25T19:42:17.334ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b values = ExternalIpGatewayMap { mappings: {} }
29352024-11-25T19:42:17.334ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56362 req_id = fc2bf0cf-7f97-4da9-89f9-85209d069cb3 response_code = 204 uri = /eip-gateways
29362024-11-25T19:42:17.349ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 228 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56362 req_id = f9bc7952-a622-4499-91d3-f6db7c4da7c7 response_code = 204 uri = /vpc-routes
29372024-11-25T19:42:17.419ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56166
29382024-11-25T19:42:17.419ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56166 req_id = 2c5bfbe0-cd59-45a0-8d18-3e63ea272c16 response_code = 200 uri = /v2p
29392024-11-25T19:42:17.512ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48303
29402024-11-25T19:42:17.512ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4173
29412024-11-25T19:42:17.548ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4197
29422024-11-25T19:42:17.604ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92376 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:48303 req_id = 8748d411-41da-44b4-a0d9-fc96fceddb50 response_code = 204 uri = /switch-ports
29432024-11-25T19:42:17.604ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37327
29442024-11-25T19:42:17.605ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 303 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48303 req_id = 2e5b2001-9a56-4350-a2c8-c31ca4be7d59 response_code = 200 uri = /network-bootstore-config
29452024-11-25T19:42:17.605ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 297 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37327 req_id = b3ce7dca-272f-4de9-8ee0-03798fff4a14 response_code = 200 uri = /v2p
29462024-11-25T19:42:17.660ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39116
29472024-11-25T19:42:17.660ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4173
29482024-11-25T19:42:17.699ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4197
29492024-11-25T19:42:17.750ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90124 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:39116 req_id = c72da5e7-27dc-4f78-8195-beda8671fac1 response_code = 204 uri = /switch-ports
29502024-11-25T19:42:17.751ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39116 req_id = d05c7485-b52c-4a22-9056-3bf7c2597cff response_code = 200 uri = /network-bootstore-config
29512024-11-25T19:42:21.641ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:51757
29522024-11-25T19:42:21.641ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:51757 req_id = 08864b28-664e-4dd1-8649-1100237dac2d response_code = 200 uri = /baseboard
29532024-11-25T19:42:37.299ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6696 local_addr = [fd00:1122:3344:101::1]:49777 method = GET remote_addr = [fd00:1122:3344:101::d]:58688 req_id = 6cf5a65c-753f-4177-9a2e-13d5cb41ede1 response_code = 200 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b uri = /38711855-ef69-4d79-bb75-aebd85b1280b
29542024-11-25T19:42:39.002ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41081
29552024-11-25T19:42:39.002ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41081 req_id = 414ec796-94c8-40e5-a68c-7d43fd3e11c3 response_code = 200 uri = /v2p
29562024-11-25T19:42:39.003ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:838 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(14052216) }
29572024-11-25T19:42:39.003ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 639 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41081 req_id = 8f7e2ace-57ef-4cdf-816b-66e8b78b2ad1 response_code = 204 uri = /v2p
29582024-11-25T19:42:39.102ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40534
29592024-11-25T19:42:39.112ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:555 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 8d77fd96-7e85-482e-b197-592d80fc5793, kind: Instance { id: b9902981-e922-4cfe-9602-2068a262a7ba }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(14052216), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 8d77fd96-7e85-482e-b197-592d80fc5793, kind: Instance { id: b9902981-e922-4cfe-9602-2068a262a7ba }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(14052216), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 8d77fd96-7e85-482e-b197-592d80fc5793, kind: Instance { id: b9902981-e922-4cfe-9602-2068a262a7ba }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(14052216), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(14052216))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 8d77fd96-7e85-482e-b197-592d80fc5793, kind: Instance { id: b9902981-e922-4cfe-9602-2068a262a7ba }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(14052216), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-e354b30da48", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 9b661100-c859-4484-aad6-f6aa765038a2, read_only_parent: Some(Volume { block_size: 512, id: 53c92f22-7050-4e88-aacc-376be39ea03b, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 2f5f6db8-073b-4756-afea-99decc2db6fb, key: Some("vMNWaRf5ifsj2c4KgVgLjx4krY1SCOHCE+QVSuMZYVw="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::18]:19001", "[fd00:1122:3344:101::19]:19002", "[fd00:1122:3344:101::13]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 9b661100-c859-4484-aad6-f6aa765038a2, key: Some("5s9bzID+Jzc3ZQNPJHFxC5A1k/ANVMoelf4VSqcRTaU="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::12]:19001", "[fd00:1122:3344:101::1a]:19000", "[fd00:1122:3344:101::14]:19000"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-e354b30da48" }] }), cloud_init_bytes: Some(..) } instance_id = b9902981-e922-4cfe-9602-2068a262a7ba metadata = InstanceMetadata { silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, project_id: b0ee39e3-ee2b-42ea-a096-0949e0c7b88f } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = 40644ff1-5ecb-4152-92fd-205456a7f844 vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-11-25T19:42:39.102674249Z }
29602024-11-25T19:42:39.112ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:588 instance_id = b9902981-e922-4cfe-9602-2068a262a7ba migration_id = None propolis_id = 40644ff1-5ecb-4152-92fd-205456a7f844
29612024-11-25T19:42:39.112ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1281 instance_id = b9902981-e922-4cfe-9602-2068a262a7ba migration_id = None propolis_id = 40644ff1-5ecb-4152-92fd-205456a7f844 state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 8d77fd96-7e85-482e-b197-592d80fc5793, kind: Instance { id: b9902981-e922-4cfe-9602-2068a262a7ba }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(14052216), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 8d77fd96-7e85-482e-b197-592d80fc5793, kind: Instance { id: b9902981-e922-4cfe-9602-2068a262a7ba }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(14052216), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 8d77fd96-7e85-482e-b197-592d80fc5793, kind: Instance { id: b9902981-e922-4cfe-9602-2068a262a7ba }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(14052216), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(14052216))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 8d77fd96-7e85-482e-b197-592d80fc5793, kind: Instance { id: b9902981-e922-4cfe-9602-2068a262a7ba }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(14052216), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-e354b30da48", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 9b661100-c859-4484-aad6-f6aa765038a2, read_only_parent: Some(Volume { block_size: 512, id: 53c92f22-7050-4e88-aacc-376be39ea03b, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 2f5f6db8-073b-4756-afea-99decc2db6fb, key: Some("vMNWaRf5ifsj2c4KgVgLjx4krY1SCOHCE+QVSuMZYVw="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::18]:19001", "[fd00:1122:3344:101::19]:19002", "[fd00:1122:3344:101::13]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 9b661100-c859-4484-aad6-f6aa765038a2, key: Some("5s9bzID+Jzc3ZQNPJHFxC5A1k/ANVMoelf4VSqcRTaU="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::12]:19001", "[fd00:1122:3344:101::1a]:19000", "[fd00:1122:3344:101::14]:19000"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-e354b30da48" }] }), cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-11-25T19:42:39.102674249Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
29622024-11-25T19:42:39.113ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10139 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40534 req_id = e88e6001-14ee-47a7-a0c8-38c4435970dc response_code = 200 uri = /vmms/40644ff1-5ecb-4152-92fd-205456a7f844
29632024-11-25T19:42:39.230ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47120
29642024-11-25T19:42:39.233ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2036 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47120 req_id = 43a89ac1-790a-4526-93ff-00145e14c99f response_code = 200 uri = /vmms/40644ff1-5ecb-4152-92fd-205456a7f844/state
29652024-11-25T19:42:39.233ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 14052216 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
29662024-11-25T19:42:39.233ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
29672024-11-25T19:42:39.273ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_40644ff1-5ecb-4152-92fd-205456a7f844 file = illumos-utils/src/zone.rs:325 instance_id = b9902981-e922-4cfe-9602-2068a262a7ba propolis_id = 40644ff1-5ecb-4152-92fd-205456a7f844
29682024-11-25T19:42:39.296ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_40644ff1-5ecb-4152-92fd-205456a7f844 file = illumos-utils/src/zone.rs:363 instance_id = b9902981-e922-4cfe-9602-2068a262a7ba propolis_id = 40644ff1-5ecb-4152-92fd-205456a7f844
29692024-11-25T19:42:39.371ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51404
29702024-11-25T19:42:39.371ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51404 req_id = b84f9555-23dd-4b48-9a46-9791989b63ae response_code = 200 uri = /vpc-routes
29712024-11-25T19:42:39.425ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b values = ExternalIpGatewayMap { mappings: {8d77fd96-7e85-482e-b197-592d80fc5793: {10.151.1.176: {15fc98e0-962c-43e7-8e4b-b9da5489f367}, 10.151.1.175: {15fc98e0-962c-43e7-8e4b-b9da5489f367}}} }
29722024-11-25T19:42:40.822ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_40644ff1-5ecb-4152-92fd-205456a7f844: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = b9902981-e922-4cfe-9602-2068a262a7ba propolis_id = 40644ff1-5ecb-4152-92fd-205456a7f844
29732024-11-25T19:42:40.822ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_40644ff1-5ecb-4152-92fd-205456a7f844 zone file = illumos-utils/src/running_zone.rs:488 instance_id = b9902981-e922-4cfe-9602-2068a262a7ba propolis_id = 40644ff1-5ecb-4152-92fd-205456a7f844 zone = oxz_propolis-server_40644ff1-5ecb-4152-92fd-205456a7f844
29742024-11-25T19:42:41.084ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_40644ff1-5ecb-4152-92fd-205456a7f844") failed: Property not found. retry in 55.309367ms file = illumos-utils/src/svc.rs:36 instance_id = b9902981-e922-4cfe-9602-2068a262a7ba propolis_id = 40644ff1-5ecb-4152-92fd-205456a7f844 zone = oxz_propolis-server_40644ff1-5ecb-4152-92fd-205456a7f844
29752024-11-25T19:42:41.148ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_40644ff1-5ecb-4152-92fd-205456a7f844") failed: Property not found. retry in 145.907059ms file = illumos-utils/src/svc.rs:36 instance_id = b9902981-e922-4cfe-9602-2068a262a7ba propolis_id = 40644ff1-5ecb-4152-92fd-205456a7f844 zone = oxz_propolis-server_40644ff1-5ecb-4152-92fd-205456a7f844
29762024-11-25T19:42:41.315ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_40644ff1-5ecb-4152-92fd-205456a7f844") failed: Property not found. retry in 137.17777ms file = illumos-utils/src/svc.rs:36 instance_id = b9902981-e922-4cfe-9602-2068a262a7ba propolis_id = 40644ff1-5ecb-4152-92fd-205456a7f844 zone = oxz_propolis-server_40644ff1-5ecb-4152-92fd-205456a7f844
29772024-11-25T19:42:41.464ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_40644ff1-5ecb-4152-92fd-205456a7f844") failed: Property not found. retry in 301.447479ms file = illumos-utils/src/svc.rs:36 instance_id = b9902981-e922-4cfe-9602-2068a262a7ba propolis_id = 40644ff1-5ecb-4152-92fd-205456a7f844 zone = oxz_propolis-server_40644ff1-5ecb-4152-92fd-205456a7f844
29782024-11-25T19:42:41.777ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_40644ff1-5ecb-4152-92fd-205456a7f844") failed: Property not found. retry in 1.080135529s file = illumos-utils/src/svc.rs:36 instance_id = b9902981-e922-4cfe-9602-2068a262a7ba propolis_id = 40644ff1-5ecb-4152-92fd-205456a7f844 zone = oxz_propolis-server_40644ff1-5ecb-4152-92fd-205456a7f844
29792024-11-25T19:42:42.868ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_40644ff1-5ecb-4152-92fd-205456a7f844") failed: Property not found. retry in 970.526036ms file = illumos-utils/src/svc.rs:36 instance_id = b9902981-e922-4cfe-9602-2068a262a7ba propolis_id = 40644ff1-5ecb-4152-92fd-205456a7f844 zone = oxz_propolis-server_40644ff1-5ecb-4152-92fd-205456a7f844
29802024-11-25T19:42:43.849ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_40644ff1-5ecb-4152-92fd-205456a7f844") failed: Property not found. retry in 581.572912ms file = illumos-utils/src/svc.rs:36 instance_id = b9902981-e922-4cfe-9602-2068a262a7ba propolis_id = 40644ff1-5ecb-4152-92fd-205456a7f844 zone = oxz_propolis-server_40644ff1-5ecb-4152-92fd-205456a7f844
29812024-11-25T19:42:44.440ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_40644ff1-5ecb-4152-92fd-205456a7f844") failed: Property not found. retry in 560.564767ms file = illumos-utils/src/svc.rs:36 instance_id = b9902981-e922-4cfe-9602-2068a262a7ba propolis_id = 40644ff1-5ecb-4152-92fd-205456a7f844 zone = oxz_propolis-server_40644ff1-5ecb-4152-92fd-205456a7f844
29822024-11-25T19:42:45.012ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_40644ff1-5ecb-4152-92fd-205456a7f844") failed: Property not found. retry in 1.151080277s file = illumos-utils/src/svc.rs:36 instance_id = b9902981-e922-4cfe-9602-2068a262a7ba propolis_id = 40644ff1-5ecb-4152-92fd-205456a7f844 zone = oxz_propolis-server_40644ff1-5ecb-4152-92fd-205456a7f844
29832024-11-25T19:42:46.192ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_40644ff1-5ecb-4152-92fd-205456a7f844 file = sled-agent/src/instance.rs:1787 instance_id = b9902981-e922-4cfe-9602-2068a262a7ba propolis_id = 40644ff1-5ecb-4152-92fd-205456a7f844
29842024-11-25T19:42:46.200ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_40644ff1-5ecb-4152-92fd-205456a7f844") failed: Property not found. retry in 38.217518ms file = illumos-utils/src/svc.rs:36 instance_id = b9902981-e922-4cfe-9602-2068a262a7ba propolis_id = 40644ff1-5ecb-4152-92fd-205456a7f844
29852024-11-25T19:42:46.252ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_40644ff1-5ecb-4152-92fd-205456a7f844") failed: Property not found. retry in 125.967063ms file = illumos-utils/src/svc.rs:36 instance_id = b9902981-e922-4cfe-9602-2068a262a7ba propolis_id = 40644ff1-5ecb-4152-92fd-205456a7f844
29862024-11-25T19:42:46.390ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:1796 instance_id = b9902981-e922-4cfe-9602-2068a262a7ba propolis_id = 40644ff1-5ecb-4152-92fd-205456a7f844
29872024-11-25T19:42:46.425ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:1820 instance_id = b9902981-e922-4cfe-9602-2068a262a7ba propolis_id = 40644ff1-5ecb-4152-92fd-205456a7f844
29882024-11-25T19:42:46.480ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56049
29892024-11-25T19:42:46.518ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41610
29902024-11-25T19:42:46.518ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41610 req_id = 47d3277d-1edb-4f5e-ae40-2a299540150f response_code = 200 uri = /vpc-routes
29912024-11-25T19:42:46.546ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52600
29922024-11-25T19:42:46.546ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52600 req_id = f0d6a3a3-b4c0-449b-9b80-b6ce6c57b0f1 response_code = 200 uri = /v2p
29932024-11-25T19:42:46.567ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b values = ExternalIpGatewayMap { mappings: {8d77fd96-7e85-482e-b197-592d80fc5793: {10.151.1.175: {15fc98e0-962c-43e7-8e4b-b9da5489f367}, 10.151.1.176: {15fc98e0-962c-43e7-8e4b-b9da5489f367}}} }
29942024-11-25T19:42:46.567ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41610 req_id = b191b6da-fe60-49cb-b196-27c5c24e0251 response_code = 204 uri = /eip-gateways
29952024-11-25T19:42:46.580ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:932 instance_id = b9902981-e922-4cfe-9602-2068a262a7ba propolis_id = 40644ff1-5ecb-4152-92fd-205456a7f844
29962024-11-25T19:42:46.581ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100616 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56049 req_id = 7a92714b-d7fe-418f-8059-d5ebab9f8971 response_code = 200 uri = /vmms/40644ff1-5ecb-4152-92fd-205456a7f844/state
29972024-11-25T19:42:46.581ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1212 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
29982024-11-25T19:42:46.581ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7156188 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51404 req_id = 56571e1a-81d0-44ce-8fb7-e60825995def response_code = 204 uri = /eip-gateways
29992024-11-25T19:42:46.582ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2024-11-25T19:42:46.581807079Z } file = sled-agent/src/instance.rs:780 instance_id = b9902981-e922-4cfe-9602-2068a262a7ba propolis_id = 40644ff1-5ecb-4152-92fd-205456a7f844
30002024-11-25T19:42:46.583ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = b9902981-e922-4cfe-9602-2068a262a7ba new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-11-25T19:42:46.581807079Z } propolis_id = 40644ff1-5ecb-4152-92fd-205456a7f844
30012024-11-25T19:42:46.583ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = b9902981-e922-4cfe-9602-2068a262a7ba propolis_id = 40644ff1-5ecb-4152-92fd-205456a7f844 state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-11-25T19:42:46.581807079Z }, migration_in: None, migration_out: None }
30022024-11-25T19:42:46.595ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35553
30032024-11-25T19:42:46.595ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4173
30042024-11-25T19:42:46.648ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4197
30052024-11-25T19:42:46.728ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 132887 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:35553 req_id = 7f36e8cf-cf9a-4539-a735-9630a3152df4 response_code = 204 uri = /switch-ports
30062024-11-25T19:42:46.729ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 343 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35553 req_id = 046f97c8-6d4f-4042-a4ad-95d4246c98f9 response_code = 200 uri = /network-bootstore-config
30072024-11-25T19:42:46.729ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2024-11-25T19:42:46.729511617Z } file = sled-agent/src/instance.rs:780 instance_id = b9902981-e922-4cfe-9602-2068a262a7ba propolis_id = 40644ff1-5ecb-4152-92fd-205456a7f844
30082024-11-25T19:42:46.729ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = b9902981-e922-4cfe-9602-2068a262a7ba new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-25T19:42:46.729511617Z } propolis_id = 40644ff1-5ecb-4152-92fd-205456a7f844
30092024-11-25T19:42:46.729ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = b9902981-e922-4cfe-9602-2068a262a7ba propolis_id = 40644ff1-5ecb-4152-92fd-205456a7f844 state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-25T19:42:46.729511617Z }, migration_in: None, migration_out: None }
30102024-11-25T19:42:46.729ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1075 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51404 req_id = 22550ab5-4c92-4bee-bc8e-89835ee8dfb8 response_code = 204 uri = /vpc-routes
30112024-11-25T19:42:46.744ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:469 new_vers = RouterVersion { router_id: 6b981b8a-dbf4-4924-b9eb-1acdbcd75373, version: 3 } old_vers = RouterVersion { router_id: 6b981b8a-dbf4-4924-b9eb-1acdbcd75373, version: 3 } subnet = RouterId { vni: Vni(14052216), kind: System }
30122024-11-25T19:42:46.745ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 420 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41610 req_id = f3c04220-7711-4acc-8bbf-42b90a604ffc response_code = 204 uri = /vpc-routes
30132024-11-25T19:42:47.078ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34129
30142024-11-25T19:42:47.082ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34129 req_id = ab954ec1-4806-46d3-848b-4297258875db response_code = 200 uri = /vmms/40644ff1-5ecb-4152-92fd-205456a7f844/state
30152024-11-25T19:42:47.083ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46629
30162024-11-25T19:42:47.083ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46629 req_id = eed725a6-3398-43b1-bef5-66accf233311 response_code = 200 uri = /vpc-routes
30172024-11-25T19:42:47.168ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b values = ExternalIpGatewayMap { mappings: {8d77fd96-7e85-482e-b197-592d80fc5793: {10.151.1.175: {15fc98e0-962c-43e7-8e4b-b9da5489f367}, 10.151.1.176: {15fc98e0-962c-43e7-8e4b-b9da5489f367}}} }
30182024-11-25T19:42:47.168ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46629 req_id = 2eaac953-a6c7-4aed-baed-7fee5cdbb5e1 response_code = 204 uri = /eip-gateways
30192024-11-25T19:42:47.192ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 218 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46629 req_id = 40b27034-8333-4aa6-8c7f-2c042219440d response_code = 204 uri = /vpc-routes
30202024-11-25T19:42:47.238ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37081
30212024-11-25T19:42:47.238ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37081 req_id = d7507c80-1d6e-4e5b-b4f4-6475b10bb33a response_code = 200 uri = /v2p
30222024-11-25T19:42:47.262ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59705
30232024-11-25T19:42:47.262ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62070
30242024-11-25T19:42:47.262ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4173
30252024-11-25T19:42:47.262ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 257 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59705 req_id = a89394b4-1d68-408c-ab40-8374fcd3b5c4 response_code = 200 uri = /vmms/40644ff1-5ecb-4152-92fd-205456a7f844/state
30262024-11-25T19:42:47.295ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4197
30272024-11-25T19:42:47.347ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84816 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:62070 req_id = fe3d0953-30ae-4386-9d14-0ce4c7a2cf2e response_code = 204 uri = /switch-ports
30282024-11-25T19:42:47.347ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62070 req_id = 0c74af97-2983-47b3-ac1e-706e673047ff response_code = 200 uri = /network-bootstore-config
30292024-11-25T19:42:47.390ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37134
30302024-11-25T19:42:47.390ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37134 req_id = 042286ef-25d4-4a0c-bef9-bd5d9aa052fd response_code = 200 uri = /vpc-routes
30312024-11-25T19:42:47.433ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b values = ExternalIpGatewayMap { mappings: {8d77fd96-7e85-482e-b197-592d80fc5793: {10.151.1.176: {15fc98e0-962c-43e7-8e4b-b9da5489f367}, 10.151.1.175: {15fc98e0-962c-43e7-8e4b-b9da5489f367}}} }
30322024-11-25T19:42:47.433ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37134 req_id = 4579562a-8ea3-4454-826b-e234b7a4483d response_code = 204 uri = /eip-gateways
30332024-11-25T19:42:47.451ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46320
30342024-11-25T19:42:47.451ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46320 req_id = 217963ac-ceb6-4940-a586-6ad39af3a815 response_code = 200 uri = /v2p
30352024-11-25T19:42:47.468ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 322 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37134 req_id = dc37760f-9cbe-4a71-a293-77d973b2d801 response_code = 204 uri = /vpc-routes
30362024-11-25T19:42:47.480ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43331
30372024-11-25T19:42:47.480ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4173
30382024-11-25T19:42:47.516ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4197
30392024-11-25T19:42:47.568ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87969 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:43331 req_id = cec0e510-83ae-4c91-af02-52220ff4021c response_code = 204 uri = /switch-ports
30402024-11-25T19:42:47.568ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43331 req_id = e99d3a61-71ac-4a7b-9090-63af6e54bdeb response_code = 200 uri = /network-bootstore-config
30412024-11-25T19:42:51.674ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:34025
30422024-11-25T19:42:51.674ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:34025 req_id = 27860083-a33a-4c33-9c23-ae198fe9f69e response_code = 200 uri = /baseboard
30432024-11-25T19:42:56.841ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52404
30442024-11-25T19:42:56.842ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 582 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52404 req_id = d2394efa-699b-4e46-a4f5-3bb9e26563c6 response_code = 200 uri = /vmms/40644ff1-5ecb-4152-92fd-205456a7f844/state
30452024-11-25T19:42:56.842ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2024-11-25T19:42:56.842607984Z } file = sled-agent/src/instance.rs:780 instance_id = b9902981-e922-4cfe-9602-2068a262a7ba propolis_id = 40644ff1-5ecb-4152-92fd-205456a7f844
30462024-11-25T19:42:56.842ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = b9902981-e922-4cfe-9602-2068a262a7ba new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-11-25T19:42:56.842607984Z } propolis_id = 40644ff1-5ecb-4152-92fd-205456a7f844
30472024-11-25T19:42:56.842ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = b9902981-e922-4cfe-9602-2068a262a7ba propolis_id = 40644ff1-5ecb-4152-92fd-205456a7f844 state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-11-25T19:42:56.842607984Z }, migration_in: None, migration_out: None }
30482024-11-25T19:42:56.887ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2024-11-25T19:42:56.887047876Z } file = sled-agent/src/instance.rs:780 instance_id = b9902981-e922-4cfe-9602-2068a262a7ba propolis_id = 40644ff1-5ecb-4152-92fd-205456a7f844
30492024-11-25T19:42:56.887ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = b9902981-e922-4cfe-9602-2068a262a7ba new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-11-25T19:42:56.887047876Z } propolis_id = 40644ff1-5ecb-4152-92fd-205456a7f844
30502024-11-25T19:42:56.887ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:816 instance_id = b9902981-e922-4cfe-9602-2068a262a7ba propolis_id = 40644ff1-5ecb-4152-92fd-205456a7f844
30512024-11-25T19:42:56.887ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
30522024-11-25T19:42:56.887ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 11744129671600771218 n_samples = 6 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
30532024-11-25T19:42:56.887ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
30542024-11-25T19:42:56.887ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/a4bf8354-b44e-436c-b4f2-9bd494b77342/debug/bundle/zone", "/pool/int/dd272387-9bb6-475e-8ebb-47dcac6d1d2a/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/71fa9360-75cf-491a-b7ef-fd270ae2f32c/crypt/debug", "/pool/ext/cc26c009-a951-4771-a26a-f2513b9e63e2/crypt/debug", "/pool/ext/56aea45f-c451-4174-9b8f-66145c2696e8/crypt/debug", "/pool/ext/d7af1128-7206-4198-91cb-ef632ea8556e/crypt/debug", "/pool/ext/fe712103-328f-4ff5-a621-99ae42de7f00/crypt/debug", "/pool/ext/ca727341-d003-494b-b98d-9fa5b5aeeec8/crypt/debug", "/pool/ext/1b4c5120-bb11-444d-9c86-edb04be1264c/crypt/debug", "/pool/ext/df57d550-ef00-4438-9a9e-b1b08bdaa525/crypt/debug", "/pool/ext/2517e8b2-3022-4575-a6ad-4786cce7adb4/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_40644ff1-5ecb-4152-92fd-205456a7f844
30552024-11-25T19:42:56.887ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 3892317117530264077 n_samples = 6 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
30562024-11-25T19:42:57.531ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1142 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_40644ff1-5ecb-4152-92fd-205456a7f844", bundle_id: 59f37174-8564-4e2d-a238-f84d3827420b }, time_created: 2024-11-25T19:42:56.888032305Z, version: 0, cause: TerminatedInstance }
30572024-11-25T19:42:57.532ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_40644ff1-5ecb-4152-92fd-205456a7f844 file = sled-agent/src/instance.rs:1032 instance_id = b9902981-e922-4cfe-9602-2068a262a7ba propolis_id = 40644ff1-5ecb-4152-92fd-205456a7f844
30582024-11-25T19:42:59.298ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:279 instance_id = b9902981-e922-4cfe-9602-2068a262a7ba propolis_id = 40644ff1-5ecb-4152-92fd-205456a7f844
30592024-11-25T19:42:59.315ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:964 id = RouterId { vni: Vni(14052216), kind: System }
30602024-11-25T19:42:59.315ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:964 id = RouterId { vni: Vni(14052216), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
30612024-11-25T19:42:59.316ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = b9902981-e922-4cfe-9602-2068a262a7ba propolis_id = 40644ff1-5ecb-4152-92fd-205456a7f844 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-25T19:42:59.316366659Z }, migration_in: None, migration_out: None }
30622024-11-25T19:42:59.387ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = b9902981-e922-4cfe-9602-2068a262a7ba propolis_id = 40644ff1-5ecb-4152-92fd-205456a7f844 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-25T19:42:59.316366659Z }, migration_in: None, migration_out: None }
30632024-11-25T19:42:59.392ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:969 instance_id = b9902981-e922-4cfe-9602-2068a262a7ba propolis_id = 40644ff1-5ecb-4152-92fd-205456a7f844
30642024-11-25T19:42:59.977ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42491
30652024-11-25T19:42:59.977ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42491 req_id = aae6e374-5041-4fa6-b8e6-84febf3f8f2f response_code = 200 uri = /vpc-routes
30662024-11-25T19:43:00.026ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b values = ExternalIpGatewayMap { mappings: {} }
30672024-11-25T19:43:00.026ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1212 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b
30682024-11-25T19:43:00.026ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 160 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42491 req_id = 6850ef22-7506-4ef9-8365-5d014aa5d062 response_code = 204 uri = /eip-gateways
30692024-11-25T19:43:00.036ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 407 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42491 req_id = cfb8a8d8-97d2-4910-bb30-9240e42b1083 response_code = 204 uri = /vpc-routes
30702024-11-25T19:43:00.105ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36788
30712024-11-25T19:43:00.105ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36788 req_id = c1d890e5-a239-4386-ba29-d9f069371bad response_code = 200 uri = /v2p
30722024-11-25T19:43:00.678ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
30732024-11-25T19:43:01.472ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39911
30742024-11-25T19:43:01.472ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39911 req_id = 1c81e78e-b5a0-4d5e-ad20-6bdeca4cc599 response_code = 200 uri = /v2p
30752024-11-25T19:43:01.556ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55771
30762024-11-25T19:43:01.556ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55771 req_id = 23e7dc6f-ef2a-4ac5-a001-1934d7d489f6 response_code = 200 uri = /vpc-routes
30772024-11-25T19:43:01.597ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b values = ExternalIpGatewayMap { mappings: {} }
30782024-11-25T19:43:01.597ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55771 req_id = b42627ba-5554-47bd-a58b-23ad398d95f8 response_code = 204 uri = /eip-gateways
30792024-11-25T19:43:01.607ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 192 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55771 req_id = b6cb1073-e30f-4d07-bb75-f715193d64cb response_code = 204 uri = /vpc-routes
30802024-11-25T19:43:02.269ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63634
30812024-11-25T19:43:02.269ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63634 req_id = 216eedb9-90e1-434a-9a34-e877c738e145 response_code = 200 uri = /vpc-routes
30822024-11-25T19:43:02.285ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b values = ExternalIpGatewayMap { mappings: {} }
30832024-11-25T19:43:02.285ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63634 req_id = ccbe9e8e-84cf-4eca-bcc2-0cd869d3cc18 response_code = 204 uri = /eip-gateways
30842024-11-25T19:43:02.295ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 232 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63634 req_id = 8235c059-eee9-44f2-a40c-bba088eb3ec2 response_code = 204 uri = /vpc-routes