Max level shown:
1 [ Nov 26 05:19:48 Enabled. ]
2 [ Nov 26 05:19:48 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Nov 26 05:19:48 Method "start" exited with status 0. ]
4 [ Nov 26 05:19:48 Rereading configuration. ]
5 [ Nov 26 05:19:48 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72024-11-26T05:19:48.754ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:113
82024-11-26T05:19:48.754ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92024-11-26T05:19:48.807ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102024-11-26T05:19:48.807ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112024-11-26T05:19:48.922ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122024-11-26T05:19:48.931ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132024-11-26T05:19:48.939ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142024-11-26T05:19:49.541ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:a02a::, width: 64 }
152024-11-26T05:19:49.678ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
162024-11-26T05:19:49.678ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
172024-11-26T05:19:49.678ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
182024-11-26T05:19:49.679ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192024-11-26T05:19:49.679ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:520
202024-11-26T05:19:49.679ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:717
212024-11-26T05:19:49.682ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "sock", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:624
222024-11-26T05:19:49.682ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:766
232024-11-26T05:19:49.682ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
242024-11-26T05:19:49.682ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:825
252024-11-26T05:19:49.682ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
262024-11-26T05:19:49.682ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272024-11-26T05:19:49.682ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
282024-11-26T05:19:49.682ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292024-11-26T05:19:49.682ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302024-11-26T05:19:49.695ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:367
312024-11-26T05:19:49.695ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 8488adc3-a35c-4d33-bd61-39dfc8c64c55 (zpool)
322024-11-26T05:19:49.795ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 8488adc3-a35c-4d33-bd61-39dfc8c64c55 (zpool), kind: Internal }
332024-11-26T05:19:50.258ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:603
342024-11-26T05:19:50.258ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
352024-11-26T05:19:50.258ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362024-11-26T05:19:50.258ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372024-11-26T05:19:50.258ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
382024-11-26T05:19:50.258ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392024-11-26T05:19:50.258ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402024-11-26T05:19:50.266ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:367
412024-11-26T05:19:50.266ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = e4c38366-5212-46e4-b3d0-f797c1f6a6ba (zpool)
422024-11-26T05:19:50.353ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: e4c38366-5212-46e4-b3d0-f797c1f6a6ba (zpool), kind: Internal }
432024-11-26T05:19:50.818ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
442024-11-26T05:19:50.819ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8488adc3-a35c-4d33-bd61-39dfc8c64c55 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e4c38366-5212-46e4-b3d0-f797c1f6a6ba (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
452024-11-26T05:19:50.819ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
462024-11-26T05:19:50.819ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
472024-11-26T05:19:50.819ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
482024-11-26T05:19:50.819ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
492024-11-26T05:19:50.819ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
502024-11-26T05:19:50.819ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8488adc3-a35c-4d33-bd61-39dfc8c64c55 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e4c38366-5212-46e4-b3d0-f797c1f6a6ba (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
512024-11-26T05:19:50.819ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
522024-11-26T05:19:50.819ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
532024-11-26T05:19:50.819ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
542024-11-26T05:19:50.819ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
552024-11-26T05:19:50.819ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
562024-11-26T05:19:50.819ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
572024-11-26T05:19:50.819ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8488adc3-a35c-4d33-bd61-39dfc8c64c55 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e4c38366-5212-46e4-b3d0-f797c1f6a6ba (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
582024-11-26T05:19:50.819ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
592024-11-26T05:19:50.819ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
602024-11-26T05:19:50.819ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
612024-11-26T05:19:50.819ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
622024-11-26T05:19:50.819ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8488adc3-a35c-4d33-bd61-39dfc8c64c55 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e4c38366-5212-46e4-b3d0-f797c1f6a6ba (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
632024-11-26T05:19:50.819ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
642024-11-26T05:19:50.819ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
652024-11-26T05:19:50.819ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
662024-11-26T05:19:50.819ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
672024-11-26T05:19:50.819ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
682024-11-26T05:19:50.819ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8488adc3-a35c-4d33-bd61-39dfc8c64c55 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e4c38366-5212-46e4-b3d0-f797c1f6a6ba (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
692024-11-26T05:19:50.819ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
702024-11-26T05:19:50.819ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
712024-11-26T05:19:50.819ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
722024-11-26T05:19:50.819ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
732024-11-26T05:19:50.819ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
742024-11-26T05:19:50.819ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8488adc3-a35c-4d33-bd61-39dfc8c64c55 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e4c38366-5212-46e4-b3d0-f797c1f6a6ba (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
752024-11-26T05:19:50.819ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
762024-11-26T05:19:50.819ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
772024-11-26T05:19:50.819ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
782024-11-26T05:19:50.819ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
792024-11-26T05:19:50.819ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
802024-11-26T05:19:50.819ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8488adc3-a35c-4d33-bd61-39dfc8c64c55 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e4c38366-5212-46e4-b3d0-f797c1f6a6ba (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
812024-11-26T05:19:50.819ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
822024-11-26T05:19:50.819ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
832024-11-26T05:19:50.819ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
842024-11-26T05:19:50.819ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
852024-11-26T05:19:50.819ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
862024-11-26T05:19:50.819ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
872024-11-26T05:19:50.819ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
882024-11-26T05:19:50.819ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8488adc3-a35c-4d33-bd61-39dfc8c64c55 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e4c38366-5212-46e4-b3d0-f797c1f6a6ba (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
892024-11-26T05:19:50.819ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
902024-11-26T05:19:50.819ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
912024-11-26T05:19:50.819ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
922024-11-26T05:19:50.819ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
932024-11-26T05:19:50.819ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
942024-11-26T05:19:50.819ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
952024-11-26T05:19:50.819ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8488adc3-a35c-4d33-bd61-39dfc8c64c55 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e4c38366-5212-46e4-b3d0-f797c1f6a6ba (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
962024-11-26T05:19:50.819ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
972024-11-26T05:19:50.819ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
982024-11-26T05:19:50.819ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
992024-11-26T05:19:50.819ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1002024-11-26T05:19:50.819ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8488adc3-a35c-4d33-bd61-39dfc8c64c55 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e4c38366-5212-46e4-b3d0-f797c1f6a6ba (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
1012024-11-26T05:19:50.819ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
1022024-11-26T05:19:50.819ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1032024-11-26T05:19:50.819ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1042024-11-26T05:19:50.819ZINFOSledAgent (bootstore): No ledger in /pool/int/8488adc3-a35c-4d33-bd61-39dfc8c64c55/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1052024-11-26T05:19:50.819ZINFOSledAgent (bootstore): No ledger in /pool/int/e4c38366-5212-46e4-b3d0-f797c1f6a6ba/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1062024-11-26T05:19:50.819ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-sock-i86pc
1072024-11-26T05:19:50.819ZINFOSledAgent (bootstore): No ledger in /pool/int/8488adc3-a35c-4d33-bd61-39dfc8c64c55/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1082024-11-26T05:19:50.819ZINFOSledAgent (bootstore): No ledger in /pool/int/e4c38366-5212-46e4-b3d0-f797c1f6a6ba/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1092024-11-26T05:19:50.819ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-sock-i86pc
1102024-11-26T05:19:50.819ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1112024-11-26T05:19:50.819ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1122024-11-26T05:19:50.830ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:736
1132024-11-26T05:19:50.830ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 2957, tv_nsec: 122786581 } time_to_next_cleanup = 599.999938299s
1142024-11-26T05:19:50.830ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3948
1152024-11-26T05:19:50.830ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1162024-11-26T05:19:50.831ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/8488adc3-a35c-4d33-bd61-39dfc8c64c55/config/sled-agent-request.json file = common/src/ledger.rs:188
1172024-11-26T05:19:50.833ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/e4c38366-5212-46e4-b3d0-f797c1f6a6ba/config/sled-agent-request.json file = common/src/ledger.rs:188
1182024-11-26T05:19:50.834ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fdb0:18c0:4d0d:a02a::1]:80
1192024-11-26T05:19:50.836ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:a02a::1]:12346
1202024-11-26T05:19:50.836ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.2.164, last: 10.151.2.173, }, ), ], external_dns_ips: [ 10.151.2.164, 10.151.2.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1200
1212024-11-26T05:19:50.836ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1222024-11-26T05:19:50.836ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1232024-11-26T05:19:50.836ZINFOSledAgent (RSS): No ledger in /pool/int/8488adc3-a35c-4d33-bd61-39dfc8c64c55/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1242024-11-26T05:19:50.836ZINFOSledAgent (RSS): No ledger in /pool/int/e4c38366-5212-46e4-b3d0-f797c1f6a6ba/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1252024-11-26T05:19:50.836ZINFOSledAgent (RSS): RSS configuration has not been fully applied yet file = sled-agent/src/rack_setup/service.rs:1263
1262024-11-26T05:19:50.836ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1272024-11-26T05:19:50.836ZINFOSledAgent (RSS): No ledger in /pool/int/8488adc3-a35c-4d33-bd61-39dfc8c64c55/config/rss-sled-plan.json file = common/src/ledger.rs:188
1282024-11-26T05:19:50.836ZINFOSledAgent (RSS): No ledger in /pool/int/e4c38366-5212-46e4-b3d0-f797c1f6a6ba/config/rss-sled-plan.json file = common/src/ledger.rs:188
1292024-11-26T05:19:50.836ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1305
1302024-11-26T05:19:50.836ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:156
1312024-11-26T05:19:50.836ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:a02a::1 file = sled-agent/src/rack_setup/plan/sled.rs:129
1322024-11-26T05:19:50.836ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1332024-11-26T05:19:50.836ZINFOSledAgent (RSS): Writing ledger to /pool/int/8488adc3-a35c-4d33-bd61-39dfc8c64c55/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:199
1342024-11-26T05:19:50.837ZINFOSledAgent (RSS): Writing ledger to /pool/int/e4c38366-5212-46e4-b3d0-f797c1f6a6ba/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:199
1352024-11-26T05:19:50.837ZINFOSledAgent (RSS): Sled plan written to storage: Plan { rack_id: 265eda97-f99d-4cd1-9b37-bd40395069c1, sleds: { [fdb0:18c0:4d0d:a02a::1]:12346: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8 (sled), rack_id: 265eda97-f99d-4cd1-9b37-bd40395069c1, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64, }, }, }, }, }, config: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.2.164, last: 10.151.2.173, }, ), ], external_dns_ips: [ 10.151.2.164, 10.151.2.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, }, } file = sled-agent/src/rack_setup/plan/sled.rs:176
1362024-11-26T05:19:50.837ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1339
1372024-11-26T05:19:50.837ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
1382024-11-26T05:19:50.837ZINFOSledAgent (bootstore): Writing ledger to /pool/int/8488adc3-a35c-4d33-bd61-39dfc8c64c55/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1392024-11-26T05:19:50.837ZINFOSledAgent (bootstore): Writing ledger to /pool/int/e4c38366-5212-46e4-b3d0-f797c1f6a6ba/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1402024-11-26T05:19:50.837ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
1412024-11-26T05:19:50.837ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8 (sled), rack_id: 265eda97-f99d-4cd1-9b37-bd40395069c1, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
1422024-11-26T05:19:50.838ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4245
1432024-11-26T05:19:50.838ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4645
1442024-11-26T05:19:50.843ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/client.rs:50
1452024-11-26T05:19:50.849ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1462024-11-26T05:19:50.849ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1472024-11-26T05:19:50.854ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1482024-11-26T05:19:50.854ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1492024-11-26T05:19:50.854ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:a02a::1]:52280
1502024-11-26T05:19:50.854ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8 (sled), rack_id: 265eda97-f99d-4cd1-9b37-bd40395069c1, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:362
1512024-11-26T05:19:50.854ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:377
1522024-11-26T05:19:50.854ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1532024-11-26T05:19:50.854ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1542024-11-26T05:19:50.854ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:603
1552024-11-26T05:19:50.854ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:809
1562024-11-26T05:19:50.854ZINFOSledAgent (StorageManager): No ledger in /pool/int/8488adc3-a35c-4d33-bd61-39dfc8c64c55/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1572024-11-26T05:19:50.854ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1582024-11-26T05:19:50.854ZINFOSledAgent (StorageManager): No ledger in /pool/int/e4c38366-5212-46e4-b3d0-f797c1f6a6ba/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1592024-11-26T05:19:50.854ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:798
1602024-11-26T05:19:50.854ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:826
1612024-11-26T05:19:50.854ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:592
1622024-11-26T05:19:50.854ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1632024-11-26T05:19:50.854ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:697 result = DisksManagementResult { status: [] }
1642024-11-26T05:19:50.871ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1652024-11-26T05:19:50.891ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:325
1662024-11-26T05:19:50.908ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:363
1672024-11-26T05:19:50.916ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:408 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
1682024-11-26T05:19:50.916ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1692024-11-26T05:19:50.916ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:420 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
1702024-11-26T05:19:50.916ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1712024-11-26T05:19:50.919ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 58.759352ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "370d31c7-bfa4-4253-97fa-a0e5601b36b9", "content-length": "124", "date": "Tue, 26 Nov 2024 05:19:50 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "370d31c7-bfa4-4253-97fa-a0e5601b36b9" } file = clients/ddm-admin-client/src/lib.rs:177
1722024-11-26T05:19:50.929ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_8488adc3-a35c-4d33-bd61-39dfc8c64c55/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1732024-11-26T05:19:50.951ZINFOSledAgent: successfully created encrypted zvol: name="oxi_8488adc3-a35c-4d33-bd61-39dfc8c64c55/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1742024-11-26T05:19:50.951ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_8488adc3-a35c-4d33-bd61-39dfc8c64c55/swap" file = sled-agent/src/swap_device.rs:96
1752024-11-26T05:19:50.956ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:435 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
1762024-11-26T05:19:50.956ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:128
1772024-11-26T05:19:50.956ZINFOSledAgent (BackingFs): Ensuring dataset oxi_8488adc3-a35c-4d33-bd61-39dfc8c64c55/backing/fmd file = sled-agent/src/backing_fs.rs:138
1782024-11-26T05:19:50.978ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1792024-11-26T05:19:50.979ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 81.787993ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "62aa2007-1c14-4174-bc6a-de6ca86e47b9", "content-length": "124", "date": "Tue, 26 Nov 2024 05:19:50 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "62aa2007-1c14-4174-bc6a-de6ca86e47b9" } file = clients/ddm-admin-client/src/lib.rs:177
1802024-11-26T05:19:51.041ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:173
1812024-11-26T05:19:51.061ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1822024-11-26T05:19:51.062ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 194.293142ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "27dc67a2-6883-41a7-8102-aaeba75be4bf", "content-length": "124", "date": "Tue, 26 Nov 2024 05:19:50 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "27dc67a2-6883-41a7-8102-aaeba75be4bf" } file = clients/ddm-admin-client/src/lib.rs:177
1832024-11-26T05:19:51.257ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1842024-11-26T05:19:51.257ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 149.359166ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "1b043106-cfee-409b-b0d3-9f46c70e93f0", "content-length": "124", "date": "Tue, 26 Nov 2024 05:19:50 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "1b043106-cfee-409b-b0d3-9f46c70e93f0" } file = clients/ddm-admin-client/src/lib.rs:177
1852024-11-26T05:19:51.259ZINFOSledAgent (BackingFs): Mounting oxi_8488adc3-a35c-4d33-bd61-39dfc8c64c55/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:181
1862024-11-26T05:19:51.272ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:189
1872024-11-26T05:19:51.272ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:189
1882024-11-26T05:19:51.272ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:189
1892024-11-26T05:19:51.272ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:195
1902024-11-26T05:19:51.408ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1912024-11-26T05:19:51.409ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 206.192634ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "759d71c6-bb70-4695-96d0-edebe2121c0d", "content-length": "124", "date": "Tue, 26 Nov 2024 05:19:50 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "759d71c6-bb70-4695-96d0-edebe2121c0d" } file = clients/ddm-admin-client/src/lib.rs:177
1922024-11-26T05:19:51.616ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1932024-11-26T05:19:51.616ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 303.634896ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "276a7339-c95a-420d-bf13-8ae64f957818", "content-length": "124", "date": "Tue, 26 Nov 2024 05:19:50 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "276a7339-c95a-420d-bf13-8ae64f957818" } file = clients/ddm-admin-client/src/lib.rs:177
1942024-11-26T05:19:51.920ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1952024-11-26T05:19:51.921ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 258.73093ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "1dfdb32f-6291-4b56-96ee-793ac018bfcd", "content-length": "124", "date": "Tue, 26 Nov 2024 05:19:51 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "1dfdb32f-6291-4b56-96ee-793ac018bfcd" } file = clients/ddm-admin-client/src/lib.rs:177
1962024-11-26T05:19:52.018ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:93 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
1972024-11-26T05:19:52.024ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:55747 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
1982024-11-26T05:19:52.024ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
1992024-11-26T05:19:52.024ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:55747 file = oximeter/producer/src/lib.rs:279 interval = 30s producer_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
2002024-11-26T05:19:52.025ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 298.499393ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
2012024-11-26T05:19:52.026ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
2022024-11-26T05:19:52.026ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
2032024-11-26T05:19:52.026ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:920 underlay_address = fd00:1122:3344:101::1
2042024-11-26T05:19:52.026ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
2052024-11-26T05:19:52.181ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
2062024-11-26T05:19:52.325ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 321.501227ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
2072024-11-26T05:19:52.649ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.366405074s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
2082024-11-26T05:19:54.017ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.705588822s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
2092024-11-26T05:19:54.571ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2669
2102024-11-26T05:19:54.571ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2914
2112024-11-26T05:19:54.571ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2539
2122024-11-26T05:19:54.571ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2586
2132024-11-26T05:19:54.571ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:2995
2142024-11-26T05:19:54.571ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3040
2152024-11-26T05:19:54.573ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2839
2162024-11-26T05:19:54.574ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2580
2172024-11-26T05:19:54.575ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='807d0366-9c8e-43d8-9dfc-3daf6dce0b50'/> <propval type="astring" name="rack_id" value='265eda97-f99d-4cd1-9b37-bd40395069c1'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:a02a::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:fe1e:1000'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:a02a::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"sock","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="rack_id" value='265eda97-f99d-4cd1-9b37-bd40395069c1'/> <propval type="astring" name="sled_id" value='797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='sock'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="host" value='[::1]'/> <propval type="astring" name="port" value='12224'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='sock'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8'/> <propval type="astring" name="rack_uuid" value='265eda97-f99d-4cd1-9b37-bd40395069c1'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8'/> <propval type="astring" name="rack_uuid" value='265eda97-f99d-4cd1-9b37-bd40395069c1'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2182024-11-26T05:19:54.575ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_switch
2192024-11-26T05:19:54.915ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 57.301066ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2202024-11-26T05:19:55.118ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 95.897735ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2212024-11-26T05:19:55.291ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 196.642289ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2222024-11-26T05:19:55.628ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 222.269519ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2232024-11-26T05:19:55.724ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 4.57308698s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
2242024-11-26T05:19:56.095ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 975.121844ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2252024-11-26T05:19:57.252ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 727.414533ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2262024-11-26T05:19:58.112ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 755.266128ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2272024-11-26T05:19:59.006ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.435268887s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2282024-11-26T05:20:00.300ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 8.953623432s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
2292024-11-26T05:20:00.906ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8) file = sled-agent/src/nexus.rs:527 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
2302024-11-26T05:20:00.936ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2312024-11-26T05:20:00.936ZINFOSledAgent (dropshot (Repo Depot)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12348 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
2322024-11-26T05:20:00.938ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12345
2332024-11-26T05:20:00.938ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:432
2342024-11-26T05:20:00.938ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2352024-11-26T05:20:00.938ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/8488adc3-a35c-4d33-bd61-39dfc8c64c55/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2362024-11-26T05:20:00.938ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/e4c38366-5212-46e4-b3d0-f797c1f6a6ba/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2372024-11-26T05:20:00.938ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2382024-11-26T05:20:00.938ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some(None), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None }], bgp: [], bfd: [] })))
2392024-11-26T05:20:00.938ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3948
2402024-11-26T05:20:00.938ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:a02a::1]:52280
2412024-11-26T05:20:01.116ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:a02a::1]:12346
2422024-11-26T05:20:01.116ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
2432024-11-26T05:20:01.116ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2442024-11-26T05:20:01.116ZINFOSledAgent (RSS): No ledger in /pool/int/8488adc3-a35c-4d33-bd61-39dfc8c64c55/config/rss-service-plan-v5.json file = common/src/ledger.rs:188
2452024-11-26T05:20:01.116ZINFOSledAgent (RSS): No ledger in /pool/int/e4c38366-5212-46e4-b3d0-f797c1f6a6ba/config/rss-service-plan-v5.json file = common/src/ledger.rs:188
2462024-11-26T05:20:01.116ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2472024-11-26T05:20:01.117ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2482024-11-26T05:20:01.117ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2492024-11-26T05:20:01.117ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2502024-11-26T05:20:01.121ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4269 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2512024-11-26T05:20:01.121ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:4285
2522024-11-26T05:20:01.121ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:534 zone = oxz_switch
2532024-11-26T05:20:01.370ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58523
2542024-11-26T05:20:01.370ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2552024-11-26T05:20:01.370ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2562024-11-26T05:20:01.370ZINFOSledAgent (ServiceManager): No ledger in /pool/int/8488adc3-a35c-4d33-bd61-39dfc8c64c55/config/omicron-zones.json file = common/src/ledger.rs:188
2572024-11-26T05:20:01.370ZINFOSledAgent (ServiceManager): No ledger in /pool/int/e4c38366-5212-46e4-b3d0-f797c1f6a6ba/config/omicron-zones.json file = common/src/ledger.rs:188
2582024-11-26T05:20:01.370ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 213 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:58523 req_id = a9edf2df-e5b7-4806-ac61-55e025320bc4 response_code = 200 uri = /inventory
2592024-11-26T05:20:01.401ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40202
2602024-11-26T05:20:01.401ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:40202 req_id = 8bd1675e-25c8-4180-b74e-2d78f2288e16 response_code = 200 uri = /sled-role
2612024-11-26T05:20:01.402ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2622024-11-26T05:20:01.402ZINFOSledAgent (RSS): Writing ledger to /pool/int/8488adc3-a35c-4d33-bd61-39dfc8c64c55/config/.rss-service-plan-v5.json.tmp file = common/src/ledger.rs:199
2632024-11-26T05:20:01.402ZINFOSledAgent (RSS): Writing ledger to /pool/int/e4c38366-5212-46e4-b3d0-f797c1f6a6ba/config/.rss-service-plan-v5.json.tmp file = common/src/ledger.rs:199
2642024-11-26T05:20:01.402ZINFOSledAgent (RSS): Service plan written to storage file = sled-agent/src/rack_setup/plan/service.rs:980
2652024-11-26T05:20:01.435ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(1), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: faf61673-487c-47a8-9ee7-1845286b9087, pool_id: 1b72df9a-7b76-458e-9ee3-3ca99732ea65 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: a03354b7-99e2-425d-af6c-0f50a56fecf5, pool_id: 13de655b-3793-4d59-8bc1-22889b3fb01b (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 2b1d5de1-76d7-44d4-a5ce-d487c213d094, pool_id: 06ee1c63-02b8-46d6-96ed-aa8ab7a8d522 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: ad71bec6-a613-4d0e-83d2-d58fa711134b, pool_id: 4fe72516-6144-43ef-96ee-e7fbaeb34f42 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: f55faae6-2c76-4952-a141-7c11dd7712ff, pool_id: 580c5897-a97f-4c76-9a8f-bf80d62b760e (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 18977da0-4bed-4ed1-aa18-da14b29a70f2, pool_id: 62fc8f20-7ce8-489b-a022-013df6640479 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: ca9e10bb-4071-45da-8f17-78fe7e74b2ec, pool_id: af39775d-5158-4242-88aa-5dd2d3c14817 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 0cc54f3b-e8fd-4af4-b158-e028bc6fa762, pool_id: 9bc99efb-91b7-405a-b8dd-0949d11c1f4a (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: d4e1efc6-9e1d-4870-9e18-0e2e1f22212a, pool_id: da133136-28dd-4eff-a3ed-9f84ec495a60 (zpool) }] } file = sled-agent/src/rack_setup/service.rs:382 sled_address = [fd00:1122:3344:101::1]:12345
2662024-11-26T05:20:01.435ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33184
2672024-11-26T05:20:01.435ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:884 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
2682024-11-26T05:20:01.435ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(1), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: faf61673-487c-47a8-9ee7-1845286b9087, pool_id: 1b72df9a-7b76-458e-9ee3-3ca99732ea65 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: a03354b7-99e2-425d-af6c-0f50a56fecf5, pool_id: 13de655b-3793-4d59-8bc1-22889b3fb01b (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 2b1d5de1-76d7-44d4-a5ce-d487c213d094, pool_id: 06ee1c63-02b8-46d6-96ed-aa8ab7a8d522 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: ad71bec6-a613-4d0e-83d2-d58fa711134b, pool_id: 4fe72516-6144-43ef-96ee-e7fbaeb34f42 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: f55faae6-2c76-4952-a141-7c11dd7712ff, pool_id: 580c5897-a97f-4c76-9a8f-bf80d62b760e (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 18977da0-4bed-4ed1-aa18-da14b29a70f2, pool_id: 62fc8f20-7ce8-489b-a022-013df6640479 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: ca9e10bb-4071-45da-8f17-78fe7e74b2ec, pool_id: af39775d-5158-4242-88aa-5dd2d3c14817 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 0cc54f3b-e8fd-4af4-b158-e028bc6fa762, pool_id: 9bc99efb-91b7-405a-b8dd-0949d11c1f4a (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: d4e1efc6-9e1d-4870-9e18-0e2e1f22212a, pool_id: da133136-28dd-4eff-a3ed-9f84ec495a60 (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:603
2692024-11-26T05:20:01.435ZINFOSledAgent (StorageManager): No ledger in /pool/int/8488adc3-a35c-4d33-bd61-39dfc8c64c55/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2702024-11-26T05:20:01.435ZINFOSledAgent (StorageManager): No ledger in /pool/int/e4c38366-5212-46e4-b3d0-f797c1f6a6ba/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2712024-11-26T05:20:01.435ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:1171 request = omicron_physical_disks_ensure
2722024-11-26T05:20:01.435ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2732024-11-26T05:20:01.435ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2742024-11-26T05:20:01.435ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2752024-11-26T05:20:01.435ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2762024-11-26T05:20:01.562ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:367
2772024-11-26T05:20:01.562ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 1b72df9a-7b76-458e-9ee3-3ca99732ea65 (zpool)
2782024-11-26T05:20:01.783ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
2792024-11-26T05:20:01.878ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 1b72df9a-7b76-458e-9ee3-3ca99732ea65 (zpool), kind: External }
2802024-11-26T05:20:01.885ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:240
2812024-11-26T05:20:01.885ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:242
2822024-11-26T05:20:01.885ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:246
2832024-11-26T05:20:01.885ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:248
2842024-11-26T05:20:01.885ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2852024-11-26T05:20:01.885ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2862024-11-26T05:20:01.885ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
2872024-11-26T05:20:01.921ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2882024-11-26T05:20:01.928ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_1b72df9a-7b76-458e-9ee3-3ca99732ea65/crypt/zone file = sled-storage/src/dataset.rs:303
2892024-11-26T05:20:01.939ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8) file = sled-agent/src/probe_manager.rs:231 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
2902024-11-26T05:20:02.028ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17839797364047048537 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
2912024-11-26T05:20:02.028ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6605641154872297595 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
2922024-11-26T05:20:02.100ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_1b72df9a-7b76-458e-9ee3-3ca99732ea65 file = sled-storage/src/dataset.rs:389
2932024-11-26T05:20:02.108ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
2942024-11-26T05:20:02.108ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
2952024-11-26T05:20:02.108ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
2962024-11-26T05:20:02.108ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2972024-11-26T05:20:02.108ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2982024-11-26T05:20:02.117ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:367
2992024-11-26T05:20:02.117ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 13de655b-3793-4d59-8bc1-22889b3fb01b (zpool)
3002024-11-26T05:20:02.210ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 13de655b-3793-4d59-8bc1-22889b3fb01b (zpool), kind: External }
3012024-11-26T05:20:02.217ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:240
3022024-11-26T05:20:02.217ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:242
3032024-11-26T05:20:02.217ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:246
3042024-11-26T05:20:02.217ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:248
3052024-11-26T05:20:02.217ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
3062024-11-26T05:20:02.217ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
3072024-11-26T05:20:02.217ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3082024-11-26T05:20:02.253ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3092024-11-26T05:20:02.261ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_13de655b-3793-4d59-8bc1-22889b3fb01b/crypt/zone file = sled-storage/src/dataset.rs:303
3102024-11-26T05:20:02.434ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_13de655b-3793-4d59-8bc1-22889b3fb01b file = sled-storage/src/dataset.rs:389
3112024-11-26T05:20:02.443ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
3122024-11-26T05:20:02.443ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
3132024-11-26T05:20:02.443ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
3142024-11-26T05:20:02.443ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3152024-11-26T05:20:02.443ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3162024-11-26T05:20:02.453ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:367
3172024-11-26T05:20:02.453ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 06ee1c63-02b8-46d6-96ed-aa8ab7a8d522 (zpool)
3182024-11-26T05:20:02.547ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 06ee1c63-02b8-46d6-96ed-aa8ab7a8d522 (zpool), kind: External }
3192024-11-26T05:20:02.555ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:240
3202024-11-26T05:20:02.555ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:242
3212024-11-26T05:20:02.555ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:246
3222024-11-26T05:20:02.555ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:248
3232024-11-26T05:20:02.555ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3242024-11-26T05:20:02.556ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3252024-11-26T05:20:02.556ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3262024-11-26T05:20:02.592ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3272024-11-26T05:20:02.600ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_06ee1c63-02b8-46d6-96ed-aa8ab7a8d522/crypt/zone file = sled-storage/src/dataset.rs:303
3282024-11-26T05:20:02.771ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_06ee1c63-02b8-46d6-96ed-aa8ab7a8d522 file = sled-storage/src/dataset.rs:389
3292024-11-26T05:20:02.779ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3302024-11-26T05:20:02.779ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3312024-11-26T05:20:02.779ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3322024-11-26T05:20:02.779ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3332024-11-26T05:20:02.779ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3342024-11-26T05:20:02.789ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:367
3352024-11-26T05:20:02.789ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 4fe72516-6144-43ef-96ee-e7fbaeb34f42 (zpool)
3362024-11-26T05:20:02.882ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 4fe72516-6144-43ef-96ee-e7fbaeb34f42 (zpool), kind: External }
3372024-11-26T05:20:02.890ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:240
3382024-11-26T05:20:02.890ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:242
3392024-11-26T05:20:02.890ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:246
3402024-11-26T05:20:02.890ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:248
3412024-11-26T05:20:02.890ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3422024-11-26T05:20:02.890ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3432024-11-26T05:20:02.890ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3442024-11-26T05:20:02.926ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3452024-11-26T05:20:02.934ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_4fe72516-6144-43ef-96ee-e7fbaeb34f42/crypt/zone file = sled-storage/src/dataset.rs:303
3462024-11-26T05:20:02.945ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8) file = sled-agent/src/probe_manager.rs:231 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
3472024-11-26T05:20:03.110ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_4fe72516-6144-43ef-96ee-e7fbaeb34f42 file = sled-storage/src/dataset.rs:389
3482024-11-26T05:20:03.118ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3492024-11-26T05:20:03.118ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3502024-11-26T05:20:03.118ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3512024-11-26T05:20:03.118ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3522024-11-26T05:20:03.118ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3532024-11-26T05:20:03.128ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:367
3542024-11-26T05:20:03.128ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 580c5897-a97f-4c76-9a8f-bf80d62b760e (zpool)
3552024-11-26T05:20:03.218ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 580c5897-a97f-4c76-9a8f-bf80d62b760e (zpool), kind: External }
3562024-11-26T05:20:03.226ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:240
3572024-11-26T05:20:03.226ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:242
3582024-11-26T05:20:03.226ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:246
3592024-11-26T05:20:03.226ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:248
3602024-11-26T05:20:03.226ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3612024-11-26T05:20:03.226ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3622024-11-26T05:20:03.226ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3632024-11-26T05:20:03.260ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3642024-11-26T05:20:03.268ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_580c5897-a97f-4c76-9a8f-bf80d62b760e/crypt/zone file = sled-storage/src/dataset.rs:303
3652024-11-26T05:20:03.445ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_580c5897-a97f-4c76-9a8f-bf80d62b760e file = sled-storage/src/dataset.rs:389
3662024-11-26T05:20:03.453ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3672024-11-26T05:20:03.453ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3682024-11-26T05:20:03.453ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3692024-11-26T05:20:03.453ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3702024-11-26T05:20:03.453ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3712024-11-26T05:20:03.463ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:367
3722024-11-26T05:20:03.463ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 62fc8f20-7ce8-489b-a022-013df6640479 (zpool)
3732024-11-26T05:20:03.562ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 62fc8f20-7ce8-489b-a022-013df6640479 (zpool), kind: External }
3742024-11-26T05:20:03.571ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:240
3752024-11-26T05:20:03.571ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:242
3762024-11-26T05:20:03.571ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:246
3772024-11-26T05:20:03.571ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:248
3782024-11-26T05:20:03.571ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3792024-11-26T05:20:03.571ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3802024-11-26T05:20:03.571ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3812024-11-26T05:20:03.606ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3822024-11-26T05:20:03.614ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_62fc8f20-7ce8-489b-a022-013df6640479/crypt/zone file = sled-storage/src/dataset.rs:303
3832024-11-26T05:20:03.786ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_62fc8f20-7ce8-489b-a022-013df6640479 file = sled-storage/src/dataset.rs:389
3842024-11-26T05:20:03.793ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3852024-11-26T05:20:03.793ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3862024-11-26T05:20:03.793ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3872024-11-26T05:20:03.793ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3882024-11-26T05:20:03.793ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3892024-11-26T05:20:03.803ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:367
3902024-11-26T05:20:03.803ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = af39775d-5158-4242-88aa-5dd2d3c14817 (zpool)
3912024-11-26T05:20:03.900ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: af39775d-5158-4242-88aa-5dd2d3c14817 (zpool), kind: External }
3922024-11-26T05:20:03.908ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:240
3932024-11-26T05:20:03.909ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:242
3942024-11-26T05:20:03.909ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:246
3952024-11-26T05:20:03.909ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:248
3962024-11-26T05:20:03.909ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3972024-11-26T05:20:03.909ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3982024-11-26T05:20:03.909ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3992024-11-26T05:20:03.943ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4002024-11-26T05:20:03.948ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8) file = sled-agent/src/probe_manager.rs:231 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
4012024-11-26T05:20:03.952ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_af39775d-5158-4242-88aa-5dd2d3c14817/crypt/zone file = sled-storage/src/dataset.rs:303
4022024-11-26T05:20:04.125ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_af39775d-5158-4242-88aa-5dd2d3c14817 file = sled-storage/src/dataset.rs:389
4032024-11-26T05:20:04.132ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
4042024-11-26T05:20:04.132ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
4052024-11-26T05:20:04.133ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
4062024-11-26T05:20:04.133ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4072024-11-26T05:20:04.133ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
4082024-11-26T05:20:04.143ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:367
4092024-11-26T05:20:04.143ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 9bc99efb-91b7-405a-b8dd-0949d11c1f4a (zpool)
4102024-11-26T05:20:04.240ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 9bc99efb-91b7-405a-b8dd-0949d11c1f4a (zpool), kind: External }
4112024-11-26T05:20:04.248ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:240
4122024-11-26T05:20:04.248ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:242
4132024-11-26T05:20:04.248ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:246
4142024-11-26T05:20:04.248ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:248
4152024-11-26T05:20:04.248ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4162024-11-26T05:20:04.249ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4172024-11-26T05:20:04.249ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
4182024-11-26T05:20:04.287ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4192024-11-26T05:20:04.295ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_9bc99efb-91b7-405a-b8dd-0949d11c1f4a/crypt/zone file = sled-storage/src/dataset.rs:303
4202024-11-26T05:20:04.473ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_9bc99efb-91b7-405a-b8dd-0949d11c1f4a file = sled-storage/src/dataset.rs:389
4212024-11-26T05:20:04.481ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
4222024-11-26T05:20:04.481ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4232024-11-26T05:20:04.481ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4242024-11-26T05:20:04.481ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4252024-11-26T05:20:04.481ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4262024-11-26T05:20:04.490ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:367
4272024-11-26T05:20:04.490ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = da133136-28dd-4eff-a3ed-9f84ec495a60 (zpool)
4282024-11-26T05:20:04.594ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: da133136-28dd-4eff-a3ed-9f84ec495a60 (zpool), kind: External }
4292024-11-26T05:20:04.602ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:240
4302024-11-26T05:20:04.602ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:242
4312024-11-26T05:20:04.602ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:246
4322024-11-26T05:20:04.602ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:248
4332024-11-26T05:20:04.602ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4342024-11-26T05:20:04.602ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4352024-11-26T05:20:04.602ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
4362024-11-26T05:20:04.638ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4372024-11-26T05:20:04.647ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_da133136-28dd-4eff-a3ed-9f84ec495a60/crypt/zone file = sled-storage/src/dataset.rs:303
4382024-11-26T05:20:04.833ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_da133136-28dd-4eff-a3ed-9f84ec495a60 file = sled-storage/src/dataset.rs:389
4392024-11-26T05:20:04.841ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4402024-11-26T05:20:04.841ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4412024-11-26T05:20:04.841ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/8488adc3-a35c-4d33-bd61-39dfc8c64c55/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4422024-11-26T05:20:04.842ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8488adc3-a35c-4d33-bd61-39dfc8c64c55 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e4c38366-5212-46e4-b3d0-f797c1f6a6ba (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 1b72df9a-7b76-458e-9ee3-3ca99732ea65 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 13de655b-3793-4d59-8bc1-22889b3fb01b (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 06ee1c63-02b8-46d6-96ed-aa8ab7a8d522 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 4fe72516-6144-43ef-96ee-e7fbaeb34f42 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 580c5897-a97f-4c76-9a8f-bf80d62b760e (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 62fc8f20-7ce8-489b-a022-013df6640479 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: af39775d-5158-4242-88aa-5dd2d3c14817 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 9bc99efb-91b7-405a-b8dd-0949d11c1f4a (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: da133136-28dd-4eff-a3ed-9f84ec495a60 (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4432024-11-26T05:20:04.842ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
4442024-11-26T05:20:04.842ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
4452024-11-26T05:20:04.842ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/e4c38366-5212-46e4-b3d0-f797c1f6a6ba/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4462024-11-26T05:20:04.842ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:888 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
4472024-11-26T05:20:04.842ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
4482024-11-26T05:20:04.842ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:914 generation = Generation(1) sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
4492024-11-26T05:20:04.842ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:919 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
4502024-11-26T05:20:04.842ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:924 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
4512024-11-26T05:20:04.842ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:122 gen = Generation(1) sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
4522024-11-26T05:20:04.842ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:930 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
4532024-11-26T05:20:04.842ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(1)
4542024-11-26T05:20:04.842ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:935 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
4552024-11-26T05:20:04.842ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3407295 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:33184 req_id = ef89e5e9-4ba8-4fea-b0b5-5a919eaa47da response_code = 200 uri = /omicron-physical-disks
4562024-11-26T05:20:04.874ZINFOSledAgent (RSS): attempting to set up sled's datasets: DatasetsConfig { generation: Generation(1), datasets: {034fce7e-64b4-436a-bd65-c40b07e7b73b (dataset): DatasetConfig { id: 034fce7e-64b4-436a-bd65-c40b07e7b73b (dataset), name: DatasetName { pool_name: ZpoolName { id: 1b72df9a-7b76-458e-9ee3-3ca99732ea65 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0b101dcc-989b-4b9f-a7d4-065d99d4b582 (dataset): DatasetConfig { id: 0b101dcc-989b-4b9f-a7d4-065d99d4b582 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4fe72516-6144-43ef-96ee-e7fbaeb34f42 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_591416ad-4f91-4b1e-9e61-71515d759ba4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0b50cc42-801e-4e88-8a01-e5cbf07f918f (dataset): DatasetConfig { id: 0b50cc42-801e-4e88-8a01-e5cbf07f918f (dataset), name: DatasetName { pool_name: ZpoolName { id: 13de655b-3793-4d59-8bc1-22889b3fb01b (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_4e9fd39d-4113-4491-beca-e49e9a07f310" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0de3b5d0-43b4-4265-8524-597aa7ee667d (dataset): DatasetConfig { id: 0de3b5d0-43b4-4265-8524-597aa7ee667d (dataset), name: DatasetName { pool_name: ZpoolName { id: 13de655b-3793-4d59-8bc1-22889b3fb01b (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1264696e-978c-4d22-9b16-b22019503775 (dataset): DatasetConfig { id: 1264696e-978c-4d22-9b16-b22019503775 (dataset), name: DatasetName { pool_name: ZpoolName { id: 580c5897-a97f-4c76-9a8f-bf80d62b760e (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_078ab58f-5ac4-4c10-8dfe-84a92fb7bb65" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1546c5c9-5345-4b0f-891d-8cb414d9a22b (dataset): DatasetConfig { id: 1546c5c9-5345-4b0f-891d-8cb414d9a22b (dataset), name: DatasetName { pool_name: ZpoolName { id: 06ee1c63-02b8-46d6-96ed-aa8ab7a8d522 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 15835513-d240-43ef-b068-c7ea9908ab5f (dataset): DatasetConfig { id: 15835513-d240-43ef-b068-c7ea9908ab5f (dataset), name: DatasetName { pool_name: ZpoolName { id: 580c5897-a97f-4c76-9a8f-bf80d62b760e (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_7ea0f6a9-f6ea-4a00-8862-957ae8407d39" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 15f8fb44-d0de-4ff5-b424-de8eee36c515 (dataset): DatasetConfig { id: 15f8fb44-d0de-4ff5-b424-de8eee36c515 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1b72df9a-7b76-458e-9ee3-3ca99732ea65 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_edbba3c6-f82f-4429-a7c3-f55287468ddf" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 183b4fe3-4a37-4544-afed-f9ebdd148f88 (dataset): DatasetConfig { id: 183b4fe3-4a37-4544-afed-f9ebdd148f88 (dataset), name: DatasetName { pool_name: ZpoolName { id: 06ee1c63-02b8-46d6-96ed-aa8ab7a8d522 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 189df748-31e5-4ee1-bc4f-2d89fb439023 (dataset): DatasetConfig { id: 189df748-31e5-4ee1-bc4f-2d89fb439023 (dataset), name: DatasetName { pool_name: ZpoolName { id: 13de655b-3793-4d59-8bc1-22889b3fb01b (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1ae29fcb-b534-44d7-8ca8-2e94976d35cb (dataset): DatasetConfig { id: 1ae29fcb-b534-44d7-8ca8-2e94976d35cb (dataset), name: DatasetName { pool_name: ZpoolName { id: 62fc8f20-7ce8-489b-a022-013df6640479 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1c5dd2af-be38-4588-baca-146c81ab65ed (dataset): DatasetConfig { id: 1c5dd2af-be38-4588-baca-146c81ab65ed (dataset), name: DatasetName { pool_name: ZpoolName { id: 13de655b-3793-4d59-8bc1-22889b3fb01b (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1f824200-b64c-4d84-931a-3301e02a0dd6 (dataset): DatasetConfig { id: 1f824200-b64c-4d84-931a-3301e02a0dd6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4fe72516-6144-43ef-96ee-e7fbaeb34f42 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_fd8c0b95-28ad-4b2a-97d9-6778a8a37605" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 279599de-f911-45c7-96d2-b140d18dfecb (dataset): DatasetConfig { id: 279599de-f911-45c7-96d2-b140d18dfecb (dataset), name: DatasetName { pool_name: ZpoolName { id: 580c5897-a97f-4c76-9a8f-bf80d62b760e (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2b3b2c80-04d1-40d5-bb73-85a4edcb8862 (dataset): DatasetConfig { id: 2b3b2c80-04d1-40d5-bb73-85a4edcb8862 (dataset), name: DatasetName { pool_name: ZpoolName { id: 06ee1c63-02b8-46d6-96ed-aa8ab7a8d522 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_e0bf1273-c01d-45a7-81e1-d34f6eb6d99b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2b4762f7-4774-4345-a1d1-52b3a51e6833 (dataset): DatasetConfig { id: 2b4762f7-4774-4345-a1d1-52b3a51e6833 (dataset), name: DatasetName { pool_name: ZpoolName { id: 06ee1c63-02b8-46d6-96ed-aa8ab7a8d522 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_bbffc850-2c64-4359-b922-de172ab3a4a1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2d6d32a3-6b8b-4cbf-b92d-07233189d677 (dataset): DatasetConfig { id: 2d6d32a3-6b8b-4cbf-b92d-07233189d677 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4fe72516-6144-43ef-96ee-e7fbaeb34f42 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_de715031-fa5a-4cf9-bf82-9cec9db59d81" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3199583b-d526-405d-90fb-21111af81b97 (dataset): DatasetConfig { id: 3199583b-d526-405d-90fb-21111af81b97 (dataset), name: DatasetName { pool_name: ZpoolName { id: 13de655b-3793-4d59-8bc1-22889b3fb01b (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_3e7aa779-fd66-467c-8445-e284949ae776" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 33c05157-e395-4312-9dda-ccd7223c0ad0 (dataset): DatasetConfig { id: 33c05157-e395-4312-9dda-ccd7223c0ad0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9bc99efb-91b7-405a-b8dd-0949d11c1f4a (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 34af5699-e9e1-4c3a-9fda-6dea780abf0c (dataset): DatasetConfig { id: 34af5699-e9e1-4c3a-9fda-6dea780abf0c (dataset), name: DatasetName { pool_name: ZpoolName { id: da133136-28dd-4eff-a3ed-9f84ec495a60 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 37901784-c137-4b05-9161-2983943ba4a5 (dataset): DatasetConfig { id: 37901784-c137-4b05-9161-2983943ba4a5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 13de655b-3793-4d59-8bc1-22889b3fb01b (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3a602687-baa1-44a1-b1a9-248dbe3e3843 (dataset): DatasetConfig { id: 3a602687-baa1-44a1-b1a9-248dbe3e3843 (dataset), name: DatasetName { pool_name: ZpoolName { id: af39775d-5158-4242-88aa-5dd2d3c14817 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 3f163ac2-d62b-46cf-b592-d7ffa6187473 (dataset): DatasetConfig { id: 3f163ac2-d62b-46cf-b592-d7ffa6187473 (dataset), name: DatasetName { pool_name: ZpoolName { id: 580c5897-a97f-4c76-9a8f-bf80d62b760e (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4830e454-c38b-4960-9b8f-877289e7f960 (dataset): DatasetConfig { id: 4830e454-c38b-4960-9b8f-877289e7f960 (dataset), name: DatasetName { pool_name: ZpoolName { id: 06ee1c63-02b8-46d6-96ed-aa8ab7a8d522 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_b663146f-27f0-4d91-99d9-9d880c25a555" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4ac43f49-4599-475f-89b5-621ffb3e51c4 (dataset): DatasetConfig { id: 4ac43f49-4599-475f-89b5-621ffb3e51c4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1b72df9a-7b76-458e-9ee3-3ca99732ea65 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4cec96d6-56ad-4396-9a1a-ebd10fc3c09d (dataset): DatasetConfig { id: 4cec96d6-56ad-4396-9a1a-ebd10fc3c09d (dataset), name: DatasetName { pool_name: ZpoolName { id: 4fe72516-6144-43ef-96ee-e7fbaeb34f42 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4da11590-faca-45aa-a86c-1b6e1aae1470 (dataset): DatasetConfig { id: 4da11590-faca-45aa-a86c-1b6e1aae1470 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1b72df9a-7b76-458e-9ee3-3ca99732ea65 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_afc5473a-4cc3-4263-8522-c328753d2c8d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5117037c-c1b7-403d-b3dd-559022739ed7 (dataset): DatasetConfig { id: 5117037c-c1b7-403d-b3dd-559022739ed7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4fe72516-6144-43ef-96ee-e7fbaeb34f42 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 526be6ed-8a1a-4b4e-bf93-44ef78b1b32a (dataset): DatasetConfig { id: 526be6ed-8a1a-4b4e-bf93-44ef78b1b32a (dataset), name: DatasetName { pool_name: ZpoolName { id: af39775d-5158-4242-88aa-5dd2d3c14817 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_eea1c48b-e597-47f2-a9c9-8bf328dab7cd" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 573f4ae0-da07-4934-aba9-8f330491c3f7 (dataset): DatasetConfig { id: 573f4ae0-da07-4934-aba9-8f330491c3f7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 06ee1c63-02b8-46d6-96ed-aa8ab7a8d522 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5a47af0d-0570-4b95-8148-ea19d906ee4e (dataset): DatasetConfig { id: 5a47af0d-0570-4b95-8148-ea19d906ee4e (dataset), name: DatasetName { pool_name: ZpoolName { id: 1b72df9a-7b76-458e-9ee3-3ca99732ea65 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_6f93cace-fd0a-439d-b070-fb3e7a93d785" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5c953a72-d69a-4b88-b6a0-1aa8724ace4f (dataset): DatasetConfig { id: 5c953a72-d69a-4b88-b6a0-1aa8724ace4f (dataset), name: DatasetName { pool_name: ZpoolName { id: 9bc99efb-91b7-405a-b8dd-0949d11c1f4a (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_183f242b-420b-49ab-a81f-72ef238fcd26" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 687b1afb-f3b2-4e8f-82b1-f65c957974d3 (dataset): DatasetConfig { id: 687b1afb-f3b2-4e8f-82b1-f65c957974d3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 580c5897-a97f-4c76-9a8f-bf80d62b760e (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_0cbd328d-2b71-482b-8212-63117b07c620" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6c90fa5f-cd6a-470b-a8e1-94dd246c8206 (dataset): DatasetConfig { id: 6c90fa5f-cd6a-470b-a8e1-94dd246c8206 (dataset), name: DatasetName { pool_name: ZpoolName { id: 13de655b-3793-4d59-8bc1-22889b3fb01b (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_97bef1ac-058e-4c8a-9591-6029bf7ab0ad" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 763e198f-875f-4701-911c-4e926a599129 (dataset): DatasetConfig { id: 763e198f-875f-4701-911c-4e926a599129 (dataset), name: DatasetName { pool_name: ZpoolName { id: 62fc8f20-7ce8-489b-a022-013df6640479 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_506e6a7b-f08a-43e3-ae23-7818916b2247" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7b229807-072d-4df1-8867-23a4d7ccf90f (dataset): DatasetConfig { id: 7b229807-072d-4df1-8867-23a4d7ccf90f (dataset), name: DatasetName { pool_name: ZpoolName { id: 9bc99efb-91b7-405a-b8dd-0949d11c1f4a (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7c1b8d54-66d8-40c9-a66a-7952f0ca5f08 (dataset): DatasetConfig { id: 7c1b8d54-66d8-40c9-a66a-7952f0ca5f08 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1b72df9a-7b76-458e-9ee3-3ca99732ea65 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_7de56ef8-bdda-46b0-a9a9-fa5e97a778c5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7df33ef5-cd0f-44b8-b088-2ba4907406f4 (dataset): DatasetConfig { id: 7df33ef5-cd0f-44b8-b088-2ba4907406f4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9bc99efb-91b7-405a-b8dd-0949d11c1f4a (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_be1e42ff-fa98-49f3-a5ff-e865a51b0418" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7f7b623d-c282-44a1-a2d8-61efb78c5171 (dataset): DatasetConfig { id: 7f7b623d-c282-44a1-a2d8-61efb78c5171 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1b72df9a-7b76-458e-9ee3-3ca99732ea65 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 814dc5e6-0ffe-4a23-9a90-27739e989cd8 (dataset): DatasetConfig { id: 814dc5e6-0ffe-4a23-9a90-27739e989cd8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 580c5897-a97f-4c76-9a8f-bf80d62b760e (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8318232c-fe6a-43ca-8b13-3622177fad8d (dataset): DatasetConfig { id: 8318232c-fe6a-43ca-8b13-3622177fad8d (dataset), name: DatasetName { pool_name: ZpoolName { id: 9bc99efb-91b7-405a-b8dd-0949d11c1f4a (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 86d8e0ac-e2e5-4bbe-a62b-b9a87eca0bec (dataset): DatasetConfig { id: 86d8e0ac-e2e5-4bbe-a62b-b9a87eca0bec (dataset), name: DatasetName { pool_name: ZpoolName { id: 06ee1c63-02b8-46d6-96ed-aa8ab7a8d522 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_45015942-f0b4-4b68-80a7-c9af4274ff35" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 88496483-3eb1-41ac-a0bf-fb21a6366426 (dataset): DatasetConfig { id: 88496483-3eb1-41ac-a0bf-fb21a6366426 (dataset), name: DatasetName { pool_name: ZpoolName { id: af39775d-5158-4242-88aa-5dd2d3c14817 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8e8f081a-0a6d-4092-bc07-7e6c20f28388 (dataset): DatasetConfig { id: 8e8f081a-0a6d-4092-bc07-7e6c20f28388 (dataset), name: DatasetName { pool_name: ZpoolName { id: 06ee1c63-02b8-46d6-96ed-aa8ab7a8d522 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9ba06d13-6163-4848-8c29-06a45e9076dd (dataset): DatasetConfig { id: 9ba06d13-6163-4848-8c29-06a45e9076dd (dataset), name: DatasetName { pool_name: ZpoolName { id: 13de655b-3793-4d59-8bc1-22889b3fb01b (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a0fa3429-6ea8-48f2-96cb-b6eb1547f7be (dataset): DatasetConfig { id: a0fa3429-6ea8-48f2-96cb-b6eb1547f7be (dataset), name: DatasetName { pool_name: ZpoolName { id: 13de655b-3793-4d59-8bc1-22889b3fb01b (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, a71cf7d6-2465-4d36-acd1-95d4f2fbd86a (dataset): DatasetConfig { id: a71cf7d6-2465-4d36-acd1-95d4f2fbd86a (dataset), name: DatasetName { pool_name: ZpoolName { id: 580c5897-a97f-4c76-9a8f-bf80d62b760e (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, aa1493fa-938e-44ae-9ffa-cd728f13669d (dataset): DatasetConfig { id: aa1493fa-938e-44ae-9ffa-cd728f13669d (dataset), name: DatasetName { pool_name: ZpoolName { id: 06ee1c63-02b8-46d6-96ed-aa8ab7a8d522 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ad837afb-3751-492a-95b0-69097346e8f1 (dataset): DatasetConfig { id: ad837afb-3751-492a-95b0-69097346e8f1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1b72df9a-7b76-458e-9ee3-3ca99732ea65 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b9d0b975-322f-49dc-b70b-02447473b9fa (dataset): DatasetConfig { id: b9d0b975-322f-49dc-b70b-02447473b9fa (dataset), name: DatasetName { pool_name: ZpoolName { id: 1b72df9a-7b76-458e-9ee3-3ca99732ea65 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bc34577b-fead-49a2-878c-a1d04be5ff53 (dataset): DatasetConfig { id: bc34577b-fead-49a2-878c-a1d04be5ff53 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4fe72516-6144-43ef-96ee-e7fbaeb34f42 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c3b20598-41bf-4fc0-896d-bf121476d76f (dataset): DatasetConfig { id: c3b20598-41bf-4fc0-896d-bf121476d76f (dataset), name: DatasetName { pool_name: ZpoolName { id: af39775d-5158-4242-88aa-5dd2d3c14817 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c6b16468-843e-4d3a-9454-5d426991cd0e (dataset): DatasetConfig { id: c6b16468-843e-4d3a-9454-5d426991cd0e (dataset), name: DatasetName { pool_name: ZpoolName { id: 62fc8f20-7ce8-489b-a022-013df6640479 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cc1d4f0e-bb1c-4af9-88bd-bd88bd50ed8e (dataset): DatasetConfig { id: cc1d4f0e-bb1c-4af9-88bd-bd88bd50ed8e (dataset), name: DatasetName { pool_name: ZpoolName { id: da133136-28dd-4eff-a3ed-9f84ec495a60 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cf03ea01-2e3a-45f4-bb37-2b003a8ebeb9 (dataset): DatasetConfig { id: cf03ea01-2e3a-45f4-bb37-2b003a8ebeb9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1b72df9a-7b76-458e-9ee3-3ca99732ea65 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, d52b0ff4-8bbd-41b1-bf31-f483d720fa0d (dataset): DatasetConfig { id: d52b0ff4-8bbd-41b1-bf31-f483d720fa0d (dataset), name: DatasetName { pool_name: ZpoolName { id: 13de655b-3793-4d59-8bc1-22889b3fb01b (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_a4232f21-0674-457e-97a4-41c6f360d0c1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d6fb6331-1b0e-4e20-8d84-84b953ad1764 (dataset): DatasetConfig { id: d6fb6331-1b0e-4e20-8d84-84b953ad1764 (dataset), name: DatasetName { pool_name: ZpoolName { id: 13de655b-3793-4d59-8bc1-22889b3fb01b (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_8b990e0a-1c33-413f-8695-830485958f9e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d7455925-2e44-4bd2-afb1-7349e4ba1b44 (dataset): DatasetConfig { id: d7455925-2e44-4bd2-afb1-7349e4ba1b44 (dataset), name: DatasetName { pool_name: ZpoolName { id: 06ee1c63-02b8-46d6-96ed-aa8ab7a8d522 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_ccf769ca-e6aa-41c6-80d6-7f1cfa2a624a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d983fae8-078d-4ff9-bbdc-1c54f6b7fa81 (dataset): DatasetConfig { id: d983fae8-078d-4ff9-bbdc-1c54f6b7fa81 (dataset), name: DatasetName { pool_name: ZpoolName { id: 62fc8f20-7ce8-489b-a022-013df6640479 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_b0f7327e-9818-4b74-82bf-6f6bf3231db9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e1016e06-bfbe-4cad-9eed-29f30ff588a8 (dataset): DatasetConfig { id: e1016e06-bfbe-4cad-9eed-29f30ff588a8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 62fc8f20-7ce8-489b-a022-013df6640479 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, e380af0e-84bf-4cac-a37a-78644a066e6a (dataset): DatasetConfig { id: e380af0e-84bf-4cac-a37a-78644a066e6a (dataset), name: DatasetName { pool_name: ZpoolName { id: 4fe72516-6144-43ef-96ee-e7fbaeb34f42 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, ef761cf9-2e7d-4070-aed4-878e9e87adb4 (dataset): DatasetConfig { id: ef761cf9-2e7d-4070-aed4-878e9e87adb4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1b72df9a-7b76-458e-9ee3-3ca99732ea65 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f204620c-5d78-4530-a2c0-cc6b60924099 (dataset): DatasetConfig { id: f204620c-5d78-4530-a2c0-cc6b60924099 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1b72df9a-7b76-458e-9ee3-3ca99732ea65 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_c80384a9-167d-483b-9108-3eccbfc759ce" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f472247a-7a1e-4b2b-9466-4f76d83094a6 (dataset): DatasetConfig { id: f472247a-7a1e-4b2b-9466-4f76d83094a6 (dataset), name: DatasetName { pool_name: ZpoolName { id: da133136-28dd-4eff-a3ed-9f84ec495a60 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_50516551-aadd-4094-86ba-7d3c3018bfd8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f6ad2c33-3db5-475b-8df0-17684f14bc4b (dataset): DatasetConfig { id: f6ad2c33-3db5-475b-8df0-17684f14bc4b (dataset), name: DatasetName { pool_name: ZpoolName { id: da133136-28dd-4eff-a3ed-9f84ec495a60 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, fbb8ebf1-0b30-45a0-b723-27737bad86b5 (dataset): DatasetConfig { id: fbb8ebf1-0b30-45a0-b723-27737bad86b5 (dataset), name: DatasetName { pool_name: ZpoolName { id: af39775d-5158-4242-88aa-5dd2d3c14817 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_90a408e9-936a-4920-ae45-8ca2dc33ed86" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} } file = sled-agent/src/rack_setup/service.rs:457 sled_address = [fd00:1122:3344:101::1]:12345
4572024-11-26T05:20:04.874ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55569
4582024-11-26T05:20:04.875ZINFOSledAgent: datasets ensure file = sled-agent/src/sled_agent.rs:850 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
4592024-11-26T05:20:04.875ZINFOSledAgent (StorageManager): Received DatasetsEnsure { config: DatasetsConfig { generation: Generation(1), datasets: {034fce7e-64b4-436a-bd65-c40b07e7b73b (dataset): DatasetConfig { id: 034fce7e-64b4-436a-bd65-c40b07e7b73b (dataset), name: DatasetName { pool_name: ZpoolName { id: 1b72df9a-7b76-458e-9ee3-3ca99732ea65 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0b101dcc-989b-4b9f-a7d4-065d99d4b582 (dataset): DatasetConfig { id: 0b101dcc-989b-4b9f-a7d4-065d99d4b582 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4fe72516-6144-43ef-96ee-e7fbaeb34f42 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_591416ad-4f91-4b1e-9e61-71515d759ba4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0b50cc42-801e-4e88-8a01-e5cbf07f918f (dataset): DatasetConfig { id: 0b50cc42-801e-4e88-8a01-e5cbf07f918f (dataset), name: DatasetName { pool_name: ZpoolName { id: 13de655b-3793-4d59-8bc1-22889b3fb01b (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_4e9fd39d-4113-4491-beca-e49e9a07f310" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0de3b5d0-43b4-4265-8524-597aa7ee667d (dataset): DatasetConfig { id: 0de3b5d0-43b4-4265-8524-597aa7ee667d (dataset), name: DatasetName { pool_name: ZpoolName { id: 13de655b-3793-4d59-8bc1-22889b3fb01b (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1264696e-978c-4d22-9b16-b22019503775 (dataset): DatasetConfig { id: 1264696e-978c-4d22-9b16-b22019503775 (dataset), name: DatasetName { pool_name: ZpoolName { id: 580c5897-a97f-4c76-9a8f-bf80d62b760e (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_078ab58f-5ac4-4c10-8dfe-84a92fb7bb65" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1546c5c9-5345-4b0f-891d-8cb414d9a22b (dataset): DatasetConfig { id: 1546c5c9-5345-4b0f-891d-8cb414d9a22b (dataset), name: DatasetName { pool_name: ZpoolName { id: 06ee1c63-02b8-46d6-96ed-aa8ab7a8d522 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 15835513-d240-43ef-b068-c7ea9908ab5f (dataset): DatasetConfig { id: 15835513-d240-43ef-b068-c7ea9908ab5f (dataset), name: DatasetName { pool_name: ZpoolName { id: 580c5897-a97f-4c76-9a8f-bf80d62b760e (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_7ea0f6a9-f6ea-4a00-8862-957ae8407d39" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 15f8fb44-d0de-4ff5-b424-de8eee36c515 (dataset): DatasetConfig { id: 15f8fb44-d0de-4ff5-b424-de8eee36c515 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1b72df9a-7b76-458e-9ee3-3ca99732ea65 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_edbba3c6-f82f-4429-a7c3-f55287468ddf" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 183b4fe3-4a37-4544-afed-f9ebdd148f88 (dataset): DatasetConfig { id: 183b4fe3-4a37-4544-afed-f9ebdd148f88 (dataset), name: DatasetName { pool_name: ZpoolName { id: 06ee1c63-02b8-46d6-96ed-aa8ab7a8d522 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 189df748-31e5-4ee1-bc4f-2d89fb439023 (dataset): DatasetConfig { id: 189df748-31e5-4ee1-bc4f-2d89fb439023 (dataset), name: DatasetName { pool_name: ZpoolName { id: 13de655b-3793-4d59-8bc1-22889b3fb01b (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1ae29fcb-b534-44d7-8ca8-2e94976d35cb (dataset): DatasetConfig { id: 1ae29fcb-b534-44d7-8ca8-2e94976d35cb (dataset), name: DatasetName { pool_name: ZpoolName { id: 62fc8f20-7ce8-489b-a022-013df6640479 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1c5dd2af-be38-4588-baca-146c81ab65ed (dataset): DatasetConfig { id: 1c5dd2af-be38-4588-baca-146c81ab65ed (dataset), name: DatasetName { pool_name: ZpoolName { id: 13de655b-3793-4d59-8bc1-22889b3fb01b (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1f824200-b64c-4d84-931a-3301e02a0dd6 (dataset): DatasetConfig { id: 1f824200-b64c-4d84-931a-3301e02a0dd6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4fe72516-6144-43ef-96ee-e7fbaeb34f42 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_fd8c0b95-28ad-4b2a-97d9-6778a8a37605" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 279599de-f911-45c7-96d2-b140d18dfecb (dataset): DatasetConfig { id: 279599de-f911-45c7-96d2-b140d18dfecb (dataset), name: DatasetName { pool_name: ZpoolName { id: 580c5897-a97f-4c76-9a8f-bf80d62b760e (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2b3b2c80-04d1-40d5-bb73-85a4edcb8862 (dataset): DatasetConfig { id: 2b3b2c80-04d1-40d5-bb73-85a4edcb8862 (dataset), name: DatasetName { pool_name: ZpoolName { id: 06ee1c63-02b8-46d6-96ed-aa8ab7a8d522 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_e0bf1273-c01d-45a7-81e1-d34f6eb6d99b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2b4762f7-4774-4345-a1d1-52b3a51e6833 (dataset): DatasetConfig { id: 2b4762f7-4774-4345-a1d1-52b3a51e6833 (dataset), name: DatasetName { pool_name: ZpoolName { id: 06ee1c63-02b8-46d6-96ed-aa8ab7a8d522 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_bbffc850-2c64-4359-b922-de172ab3a4a1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2d6d32a3-6b8b-4cbf-b92d-07233189d677 (dataset): DatasetConfig { id: 2d6d32a3-6b8b-4cbf-b92d-07233189d677 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4fe72516-6144-43ef-96ee-e7fbaeb34f42 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_de715031-fa5a-4cf9-bf82-9cec9db59d81" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3199583b-d526-405d-90fb-21111af81b97 (dataset): DatasetConfig { id: 3199583b-d526-405d-90fb-21111af81b97 (dataset), name: DatasetName { pool_name: ZpoolName { id: 13de655b-3793-4d59-8bc1-22889b3fb01b (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_3e7aa779-fd66-467c-8445-e284949ae776" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 33c05157-e395-4312-9dda-ccd7223c0ad0 (dataset): DatasetConfig { id: 33c05157-e395-4312-9dda-ccd7223c0ad0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9bc99efb-91b7-405a-b8dd-0949d11c1f4a (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 34af5699-e9e1-4c3a-9fda-6dea780abf0c (dataset): DatasetConfig { id: 34af5699-e9e1-4c3a-9fda-6dea780abf0c (dataset), name: DatasetName { pool_name: ZpoolName { id: da133136-28dd-4eff-a3ed-9f84ec495a60 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 37901784-c137-4b05-9161-2983943ba4a5 (dataset): DatasetConfig { id: 37901784-c137-4b05-9161-2983943ba4a5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 13de655b-3793-4d59-8bc1-22889b3fb01b (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3a602687-baa1-44a1-b1a9-248dbe3e3843 (dataset): DatasetConfig { id: 3a602687-baa1-44a1-b1a9-248dbe3e3843 (dataset), name: DatasetName { pool_name: ZpoolName { id: af39775d-5158-4242-88aa-5dd2d3c14817 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 3f163ac2-d62b-46cf-b592-d7ffa6187473 (dataset): DatasetConfig { id: 3f163ac2-d62b-46cf-b592-d7ffa6187473 (dataset), name: DatasetName { pool_name: ZpoolName { id: 580c5897-a97f-4c76-9a8f-bf80d62b760e (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4830e454-c38b-4960-9b8f-877289e7f960 (dataset): DatasetConfig { id: 4830e454-c38b-4960-9b8f-877289e7f960 (dataset), name: DatasetName { pool_name: ZpoolName { id: 06ee1c63-02b8-46d6-96ed-aa8ab7a8d522 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_b663146f-27f0-4d91-99d9-9d880c25a555" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4ac43f49-4599-475f-89b5-621ffb3e51c4 (dataset): DatasetConfig { id: 4ac43f49-4599-475f-89b5-621ffb3e51c4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1b72df9a-7b76-458e-9ee3-3ca99732ea65 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4cec96d6-56ad-4396-9a1a-ebd10fc3c09d (dataset): DatasetConfig { id: 4cec96d6-56ad-4396-9a1a-ebd10fc3c09d (dataset), name: DatasetName { pool_name: ZpoolName { id: 4fe72516-6144-43ef-96ee-e7fbaeb34f42 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4da11590-faca-45aa-a86c-1b6e1aae1470 (dataset): DatasetConfig { id: 4da11590-faca-45aa-a86c-1b6e1aae1470 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1b72df9a-7b76-458e-9ee3-3ca99732ea65 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_afc5473a-4cc3-4263-8522-c328753d2c8d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5117037c-c1b7-403d-b3dd-559022739ed7 (dataset): DatasetConfig { id: 5117037c-c1b7-403d-b3dd-559022739ed7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4fe72516-6144-43ef-96ee-e7fbaeb34f42 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 526be6ed-8a1a-4b4e-bf93-44ef78b1b32a (dataset): DatasetConfig { id: 526be6ed-8a1a-4b4e-bf93-44ef78b1b32a (dataset), name: DatasetName { pool_name: ZpoolName { id: af39775d-5158-4242-88aa-5dd2d3c14817 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_eea1c48b-e597-47f2-a9c9-8bf328dab7cd" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 573f4ae0-da07-4934-aba9-8f330491c3f7 (dataset): DatasetConfig { id: 573f4ae0-da07-4934-aba9-8f330491c3f7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 06ee1c63-02b8-46d6-96ed-aa8ab7a8d522 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5a47af0d-0570-4b95-8148-ea19d906ee4e (dataset): DatasetConfig { id: 5a47af0d-0570-4b95-8148-ea19d906ee4e (dataset), name: DatasetName { pool_name: ZpoolName { id: 1b72df9a-7b76-458e-9ee3-3ca99732ea65 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_6f93cace-fd0a-439d-b070-fb3e7a93d785" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5c953a72-d69a-4b88-b6a0-1aa8724ace4f (dataset): DatasetConfig { id: 5c953a72-d69a-4b88-b6a0-1aa8724ace4f (dataset), name: DatasetName { pool_name: ZpoolName { id: 9bc99efb-91b7-405a-b8dd-0949d11c1f4a (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_183f242b-420b-49ab-a81f-72ef238fcd26" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 687b1afb-f3b2-4e8f-82b1-f65c957974d3 (dataset): DatasetConfig { id: 687b1afb-f3b2-4e8f-82b1-f65c957974d3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 580c5897-a97f-4c76-9a8f-bf80d62b760e (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_0cbd328d-2b71-482b-8212-63117b07c620" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6c90fa5f-cd6a-470b-a8e1-94dd246c8206 (dataset): DatasetConfig { id: 6c90fa5f-cd6a-470b-a8e1-94dd246c8206 (dataset), name: DatasetName { pool_name: ZpoolName { id: 13de655b-3793-4d59-8bc1-22889b3fb01b (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_97bef1ac-058e-4c8a-9591-6029bf7ab0ad" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 763e198f-875f-4701-911c-4e926a599129 (dataset): DatasetConfig { id: 763e198f-875f-4701-911c-4e926a599129 (dataset), name: DatasetName { pool_name: ZpoolName { id: 62fc8f20-7ce8-489b-a022-013df6640479 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_506e6a7b-f08a-43e3-ae23-7818916b2247" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7b229807-072d-4df1-8867-23a4d7ccf90f (dataset): DatasetConfig { id: 7b229807-072d-4df1-8867-23a4d7ccf90f (dataset), name: DatasetName { pool_name: ZpoolName { id: 9bc99efb-91b7-405a-b8dd-0949d11c1f4a (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7c1b8d54-66d8-40c9-a66a-7952f0ca5f08 (dataset): DatasetConfig { id: 7c1b8d54-66d8-40c9-a66a-7952f0ca5f08 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1b72df9a-7b76-458e-9ee3-3ca99732ea65 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_7de56ef8-bdda-46b0-a9a9-fa5e97a778c5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7df33ef5-cd0f-44b8-b088-2ba4907406f4 (dataset): DatasetConfig { id: 7df33ef5-cd0f-44b8-b088-2ba4907406f4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9bc99efb-91b7-405a-b8dd-0949d11c1f4a (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_be1e42ff-fa98-49f3-a5ff-e865a51b0418" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7f7b623d-c282-44a1-a2d8-61efb78c5171 (dataset): DatasetConfig { id: 7f7b623d-c282-44a1-a2d8-61efb78c5171 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1b72df9a-7b76-458e-9ee3-3ca99732ea65 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 814dc5e6-0ffe-4a23-9a90-27739e989cd8 (dataset): DatasetConfig { id: 814dc5e6-0ffe-4a23-9a90-27739e989cd8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 580c5897-a97f-4c76-9a8f-bf80d62b760e (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8318232c-fe6a-43ca-8b13-3622177fad8d (dataset): DatasetConfig { id: 8318232c-fe6a-43ca-8b13-3622177fad8d (dataset), name: DatasetName { pool_name: ZpoolName { id: 9bc99efb-91b7-405a-b8dd-0949d11c1f4a (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 86d8e0ac-e2e5-4bbe-a62b-b9a87eca0bec (dataset): DatasetConfig { id: 86d8e0ac-e2e5-4bbe-a62b-b9a87eca0bec (dataset), name: DatasetName { pool_name: ZpoolName { id: 06ee1c63-02b8-46d6-96ed-aa8ab7a8d522 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_45015942-f0b4-4b68-80a7-c9af4274ff35" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 88496483-3eb1-41ac-a0bf-fb21a6366426 (dataset): DatasetConfig { id: 88496483-3eb1-41ac-a0bf-fb21a6366426 (dataset), name: DatasetName { pool_name: ZpoolName { id: af39775d-5158-4242-88aa-5dd2d3c14817 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8e8f081a-0a6d-4092-bc07-7e6c20f28388 (dataset): DatasetConfig { id: 8e8f081a-0a6d-4092-bc07-7e6c20f28388 (dataset), name: DatasetName { pool_name: ZpoolName { id: 06ee1c63-02b8-46d6-96ed-aa8ab7a8d522 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9ba06d13-6163-4848-8c29-06a45e9076dd (dataset): DatasetConfig { id: 9ba06d13-6163-4848-8c29-06a45e9076dd (dataset), name: DatasetName { pool_name: ZpoolName { id: 13de655b-3793-4d59-8bc1-22889b3fb01b (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a0fa3429-6ea8-48f2-96cb-b6eb1547f7be (dataset): DatasetConfig { id: a0fa3429-6ea8-48f2-96cb-b6eb1547f7be (dataset), name: DatasetName { pool_name: ZpoolName { id: 13de655b-3793-4d59-8bc1-22889b3fb01b (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, a71cf7d6-2465-4d36-acd1-95d4f2fbd86a (dataset): DatasetConfig { id: a71cf7d6-2465-4d36-acd1-95d4f2fbd86a (dataset), name: DatasetName { pool_name: ZpoolName { id: 580c5897-a97f-4c76-9a8f-bf80d62b760e (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, aa1493fa-938e-44ae-9ffa-cd728f13669d (dataset): DatasetConfig { id: aa1493fa-938e-44ae-9ffa-cd728f13669d (dataset), name: DatasetName { pool_name: ZpoolName { id: 06ee1c63-02b8-46d6-96ed-aa8ab7a8d522 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ad837afb-3751-492a-95b0-69097346e8f1 (dataset): DatasetConfig { id: ad837afb-3751-492a-95b0-69097346e8f1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1b72df9a-7b76-458e-9ee3-3ca99732ea65 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b9d0b975-322f-49dc-b70b-02447473b9fa (dataset): DatasetConfig { id: b9d0b975-322f-49dc-b70b-02447473b9fa (dataset), name: DatasetName { pool_name: ZpoolName { id: 1b72df9a-7b76-458e-9ee3-3ca99732ea65 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bc34577b-fead-49a2-878c-a1d04be5ff53 (dataset): DatasetConfig { id: bc34577b-fead-49a2-878c-a1d04be5ff53 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4fe72516-6144-43ef-96ee-e7fbaeb34f42 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c3b20598-41bf-4fc0-896d-bf121476d76f (dataset): DatasetConfig { id: c3b20598-41bf-4fc0-896d-bf121476d76f (dataset), name: DatasetName { pool_name: ZpoolName { id: af39775d-5158-4242-88aa-5dd2d3c14817 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c6b16468-843e-4d3a-9454-5d426991cd0e (dataset): DatasetConfig { id: c6b16468-843e-4d3a-9454-5d426991cd0e (dataset), name: DatasetName { pool_name: ZpoolName { id: 62fc8f20-7ce8-489b-a022-013df6640479 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cc1d4f0e-bb1c-4af9-88bd-bd88bd50ed8e (dataset): DatasetConfig { id: cc1d4f0e-bb1c-4af9-88bd-bd88bd50ed8e (dataset), name: DatasetName { pool_name: ZpoolName { id: da133136-28dd-4eff-a3ed-9f84ec495a60 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cf03ea01-2e3a-45f4-bb37-2b003a8ebeb9 (dataset): DatasetConfig { id: cf03ea01-2e3a-45f4-bb37-2b003a8ebeb9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1b72df9a-7b76-458e-9ee3-3ca99732ea65 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, d52b0ff4-8bbd-41b1-bf31-f483d720fa0d (dataset): DatasetConfig { id: d52b0ff4-8bbd-41b1-bf31-f483d720fa0d (dataset), name: DatasetName { pool_name: ZpoolName { id: 13de655b-3793-4d59-8bc1-22889b3fb01b (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_a4232f21-0674-457e-97a4-41c6f360d0c1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d6fb6331-1b0e-4e20-8d84-84b953ad1764 (dataset): DatasetConfig { id: d6fb6331-1b0e-4e20-8d84-84b953ad1764 (dataset), name: DatasetName { pool_name: ZpoolName { id: 13de655b-3793-4d59-8bc1-22889b3fb01b (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_8b990e0a-1c33-413f-8695-830485958f9e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d7455925-2e44-4bd2-afb1-7349e4ba1b44 (dataset): DatasetConfig { id: d7455925-2e44-4bd2-afb1-7349e4ba1b44 (dataset), name: DatasetName { pool_name: ZpoolName { id: 06ee1c63-02b8-46d6-96ed-aa8ab7a8d522 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_ccf769ca-e6aa-41c6-80d6-7f1cfa2a624a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d983fae8-078d-4ff9-bbdc-1c54f6b7fa81 (dataset): DatasetConfig { id: d983fae8-078d-4ff9-bbdc-1c54f6b7fa81 (dataset), name: DatasetName { pool_name: ZpoolName { id: 62fc8f20-7ce8-489b-a022-013df6640479 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_b0f7327e-9818-4b74-82bf-6f6bf3231db9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e1016e06-bfbe-4cad-9eed-29f30ff588a8 (dataset): DatasetConfig { id: e1016e06-bfbe-4cad-9eed-29f30ff588a8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 62fc8f20-7ce8-489b-a022-013df6640479 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, e380af0e-84bf-4cac-a37a-78644a066e6a (dataset): DatasetConfig { id: e380af0e-84bf-4cac-a37a-78644a066e6a (dataset), name: DatasetName { pool_name: ZpoolName { id: 4fe72516-6144-43ef-96ee-e7fbaeb34f42 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, ef761cf9-2e7d-4070-aed4-878e9e87adb4 (dataset): DatasetConfig { id: ef761cf9-2e7d-4070-aed4-878e9e87adb4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1b72df9a-7b76-458e-9ee3-3ca99732ea65 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f204620c-5d78-4530-a2c0-cc6b60924099 (dataset): DatasetConfig { id: f204620c-5d78-4530-a2c0-cc6b60924099 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1b72df9a-7b76-458e-9ee3-3ca99732ea65 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_c80384a9-167d-483b-9108-3eccbfc759ce" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f472247a-7a1e-4b2b-9466-4f76d83094a6 (dataset): DatasetConfig { id: f472247a-7a1e-4b2b-9466-4f76d83094a6 (dataset), name: DatasetName { pool_name: ZpoolName { id: da133136-28dd-4eff-a3ed-9f84ec495a60 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_50516551-aadd-4094-86ba-7d3c3018bfd8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f6ad2c33-3db5-475b-8df0-17684f14bc4b (dataset): DatasetConfig { id: f6ad2c33-3db5-475b-8df0-17684f14bc4b (dataset), name: DatasetName { pool_name: ZpoolName { id: da133136-28dd-4eff-a3ed-9f84ec495a60 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, fbb8ebf1-0b30-45a0-b723-27737bad86b5 (dataset): DatasetConfig { id: fbb8ebf1-0b30-45a0-b723-27737bad86b5 (dataset), name: DatasetName { pool_name: ZpoolName { id: af39775d-5158-4242-88aa-5dd2d3c14817 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_90a408e9-936a-4920-ae45-8ca2dc33ed86" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} }, tx: ... } file = sled-storage/src/manager.rs:603
4602024-11-26T05:20:04.875ZINFOSledAgent (StorageManager): No ledger in /pool/int/8488adc3-a35c-4d33-bd61-39dfc8c64c55/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4612024-11-26T05:20:04.875ZINFOSledAgent (StorageManager): No ledger in /pool/int/e4c38366-5212-46e4-b3d0-f797c1f6a6ba/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4622024-11-26T05:20:04.875ZINFOSledAgent (StorageManager): No previously-stored 'requested datasets', creating new ledger file = sled-storage/src/manager.rs:905 request = datasets_ensure
4632024-11-26T05:20:04.875ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4642024-11-26T05:20:04.875ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_1b72df9a-7b76-458e-9ee3-3ca99732ea65/crypt/clickhouse" } file = sled-storage/src/manager.rs:1331
4652024-11-26T05:20:04.950ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8) file = sled-agent/src/probe_manager.rs:231 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
4662024-11-26T05:20:04.967ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4672024-11-26T05:20:04.967ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4fe72516-6144-43ef-96ee-e7fbaeb34f42/crypt/zone/oxz_cockroachdb_591416ad-4f91-4b1e-9e61-71515d759ba4"), full_name: "oxp_4fe72516-6144-43ef-96ee-e7fbaeb34f42/crypt/zone/oxz_cockroachdb_591416ad-4f91-4b1e-9e61-71515d759ba4" } file = sled-storage/src/manager.rs:1331
4682024-11-26T05:20:05.067ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4692024-11-26T05:20:05.067ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/13de655b-3793-4d59-8bc1-22889b3fb01b/crypt/zone/oxz_external_dns_4e9fd39d-4113-4491-beca-e49e9a07f310"), full_name: "oxp_13de655b-3793-4d59-8bc1-22889b3fb01b/crypt/zone/oxz_external_dns_4e9fd39d-4113-4491-beca-e49e9a07f310" } file = sled-storage/src/manager.rs:1331
4702024-11-26T05:20:05.171ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4712024-11-26T05:20:05.171ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_13de655b-3793-4d59-8bc1-22889b3fb01b/crucible" } file = sled-storage/src/manager.rs:1331
4722024-11-26T05:20:05.260ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4732024-11-26T05:20:05.260ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/580c5897-a97f-4c76-9a8f-bf80d62b760e/crypt/zone/oxz_cockroachdb_078ab58f-5ac4-4c10-8dfe-84a92fb7bb65"), full_name: "oxp_580c5897-a97f-4c76-9a8f-bf80d62b760e/crypt/zone/oxz_cockroachdb_078ab58f-5ac4-4c10-8dfe-84a92fb7bb65" } file = sled-storage/src/manager.rs:1331
4742024-11-26T05:20:05.362ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4752024-11-26T05:20:05.362ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/06ee1c63-02b8-46d6-96ed-aa8ab7a8d522/crypt/debug"), full_name: "oxp_06ee1c63-02b8-46d6-96ed-aa8ab7a8d522/crypt/debug" } file = sled-storage/src/manager.rs:1331
4762024-11-26T05:20:05.433ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4772024-11-26T05:20:05.433ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/580c5897-a97f-4c76-9a8f-bf80d62b760e/crypt/zone/oxz_crucible_pantry_7ea0f6a9-f6ea-4a00-8862-957ae8407d39"), full_name: "oxp_580c5897-a97f-4c76-9a8f-bf80d62b760e/crypt/zone/oxz_crucible_pantry_7ea0f6a9-f6ea-4a00-8862-957ae8407d39" } file = sled-storage/src/manager.rs:1331
4782024-11-26T05:20:05.535ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4792024-11-26T05:20:05.535ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1b72df9a-7b76-458e-9ee3-3ca99732ea65/crypt/zone/oxz_internal_dns_edbba3c6-f82f-4429-a7c3-f55287468ddf"), full_name: "oxp_1b72df9a-7b76-458e-9ee3-3ca99732ea65/crypt/zone/oxz_internal_dns_edbba3c6-f82f-4429-a7c3-f55287468ddf" } file = sled-storage/src/manager.rs:1331
4802024-11-26T05:20:05.634ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4812024-11-26T05:20:05.635ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_06ee1c63-02b8-46d6-96ed-aa8ab7a8d522/crucible" } file = sled-storage/src/manager.rs:1331
4822024-11-26T05:20:05.724ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4832024-11-26T05:20:05.724ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_13de655b-3793-4d59-8bc1-22889b3fb01b/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
4842024-11-26T05:20:05.814ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4852024-11-26T05:20:05.814ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/62fc8f20-7ce8-489b-a022-013df6640479/crypt/zone"), full_name: "oxp_62fc8f20-7ce8-489b-a022-013df6640479/crypt/zone" } file = sled-storage/src/manager.rs:1331
4862024-11-26T05:20:05.884ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4872024-11-26T05:20:05.884ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/13de655b-3793-4d59-8bc1-22889b3fb01b/crypt/zone"), full_name: "oxp_13de655b-3793-4d59-8bc1-22889b3fb01b/crypt/zone" } file = sled-storage/src/manager.rs:1331
4882024-11-26T05:20:05.952ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8) file = sled-agent/src/probe_manager.rs:231 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
4892024-11-26T05:20:05.953ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4902024-11-26T05:20:05.953ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4fe72516-6144-43ef-96ee-e7fbaeb34f42/crypt/zone/oxz_crucible_fd8c0b95-28ad-4b2a-97d9-6778a8a37605"), full_name: "oxp_4fe72516-6144-43ef-96ee-e7fbaeb34f42/crypt/zone/oxz_crucible_fd8c0b95-28ad-4b2a-97d9-6778a8a37605" } file = sled-storage/src/manager.rs:1331
4912024-11-26T05:20:06.054ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4922024-11-26T05:20:06.054ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_580c5897-a97f-4c76-9a8f-bf80d62b760e/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
4932024-11-26T05:20:06.148ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4942024-11-26T05:20:06.148ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/06ee1c63-02b8-46d6-96ed-aa8ab7a8d522/crypt/zone/oxz_crucible_e0bf1273-c01d-45a7-81e1-d34f6eb6d99b"), full_name: "oxp_06ee1c63-02b8-46d6-96ed-aa8ab7a8d522/crypt/zone/oxz_crucible_e0bf1273-c01d-45a7-81e1-d34f6eb6d99b" } file = sled-storage/src/manager.rs:1331
4952024-11-26T05:20:06.247ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4962024-11-26T05:20:06.247ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/06ee1c63-02b8-46d6-96ed-aa8ab7a8d522/crypt/zone/oxz_crucible_pantry_bbffc850-2c64-4359-b922-de172ab3a4a1"), full_name: "oxp_06ee1c63-02b8-46d6-96ed-aa8ab7a8d522/crypt/zone/oxz_crucible_pantry_bbffc850-2c64-4359-b922-de172ab3a4a1" } file = sled-storage/src/manager.rs:1331
4972024-11-26T05:20:06.345ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4982024-11-26T05:20:06.345ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4fe72516-6144-43ef-96ee-e7fbaeb34f42/crypt/zone/oxz_nexus_de715031-fa5a-4cf9-bf82-9cec9db59d81"), full_name: "oxp_4fe72516-6144-43ef-96ee-e7fbaeb34f42/crypt/zone/oxz_nexus_de715031-fa5a-4cf9-bf82-9cec9db59d81" } file = sled-storage/src/manager.rs:1331
4992024-11-26T05:20:06.446ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5002024-11-26T05:20:06.446ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/13de655b-3793-4d59-8bc1-22889b3fb01b/crypt/zone/oxz_internal_dns_3e7aa779-fd66-467c-8445-e284949ae776"), full_name: "oxp_13de655b-3793-4d59-8bc1-22889b3fb01b/crypt/zone/oxz_internal_dns_3e7aa779-fd66-467c-8445-e284949ae776" } file = sled-storage/src/manager.rs:1331
5012024-11-26T05:20:06.545ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5022024-11-26T05:20:06.545ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_9bc99efb-91b7-405a-b8dd-0949d11c1f4a/crucible" } file = sled-storage/src/manager.rs:1331
5032024-11-26T05:20:06.632ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5042024-11-26T05:20:06.632ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_da133136-28dd-4eff-a3ed-9f84ec495a60/crucible" } file = sled-storage/src/manager.rs:1331
5052024-11-26T05:20:06.719ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5062024-11-26T05:20:06.719ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_13de655b-3793-4d59-8bc1-22889b3fb01b/crypt/external_dns" } file = sled-storage/src/manager.rs:1331
5072024-11-26T05:20:06.808ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5082024-11-26T05:20:06.808ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/af39775d-5158-4242-88aa-5dd2d3c14817/crypt/debug"), full_name: "oxp_af39775d-5158-4242-88aa-5dd2d3c14817/crypt/debug" } file = sled-storage/src/manager.rs:1331
5092024-11-26T05:20:06.877ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5102024-11-26T05:20:06.877ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/580c5897-a97f-4c76-9a8f-bf80d62b760e/crypt/zone"), full_name: "oxp_580c5897-a97f-4c76-9a8f-bf80d62b760e/crypt/zone" } file = sled-storage/src/manager.rs:1331
5112024-11-26T05:20:06.944ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5122024-11-26T05:20:06.944ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/06ee1c63-02b8-46d6-96ed-aa8ab7a8d522/crypt/zone/oxz_internal_dns_b663146f-27f0-4d91-99d9-9d880c25a555"), full_name: "oxp_06ee1c63-02b8-46d6-96ed-aa8ab7a8d522/crypt/zone/oxz_internal_dns_b663146f-27f0-4d91-99d9-9d880c25a555" } file = sled-storage/src/manager.rs:1331
5132024-11-26T05:20:06.955ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8) file = sled-agent/src/probe_manager.rs:231 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
5142024-11-26T05:20:07.046ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5152024-11-26T05:20:07.046ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1b72df9a-7b76-458e-9ee3-3ca99732ea65/crypt/zone"), full_name: "oxp_1b72df9a-7b76-458e-9ee3-3ca99732ea65/crypt/zone" } file = sled-storage/src/manager.rs:1331
5162024-11-26T05:20:07.114ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5172024-11-26T05:20:07.114ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_4fe72516-6144-43ef-96ee-e7fbaeb34f42/crucible" } file = sled-storage/src/manager.rs:1331
5182024-11-26T05:20:07.201ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5192024-11-26T05:20:07.201ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1b72df9a-7b76-458e-9ee3-3ca99732ea65/crypt/zone/oxz_cockroachdb_afc5473a-4cc3-4263-8522-c328753d2c8d"), full_name: "oxp_1b72df9a-7b76-458e-9ee3-3ca99732ea65/crypt/zone/oxz_cockroachdb_afc5473a-4cc3-4263-8522-c328753d2c8d" } file = sled-storage/src/manager.rs:1331
5202024-11-26T05:20:07.299ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5212024-11-26T05:20:07.299ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4fe72516-6144-43ef-96ee-e7fbaeb34f42/crypt/zone"), full_name: "oxp_4fe72516-6144-43ef-96ee-e7fbaeb34f42/crypt/zone" } file = sled-storage/src/manager.rs:1331
5222024-11-26T05:20:07.366ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5232024-11-26T05:20:07.366ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/af39775d-5158-4242-88aa-5dd2d3c14817/crypt/zone/oxz_nexus_eea1c48b-e597-47f2-a9c9-8bf328dab7cd"), full_name: "oxp_af39775d-5158-4242-88aa-5dd2d3c14817/crypt/zone/oxz_nexus_eea1c48b-e597-47f2-a9c9-8bf328dab7cd" } file = sled-storage/src/manager.rs:1331
5242024-11-26T05:20:07.463ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5252024-11-26T05:20:07.463ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_06ee1c63-02b8-46d6-96ed-aa8ab7a8d522/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
5262024-11-26T05:20:07.556ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5272024-11-26T05:20:07.556ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1b72df9a-7b76-458e-9ee3-3ca99732ea65/crypt/zone/oxz_crucible_6f93cace-fd0a-439d-b070-fb3e7a93d785"), full_name: "oxp_1b72df9a-7b76-458e-9ee3-3ca99732ea65/crypt/zone/oxz_crucible_6f93cace-fd0a-439d-b070-fb3e7a93d785" } file = sled-storage/src/manager.rs:1331
5282024-11-26T05:20:07.655ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5292024-11-26T05:20:07.655ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9bc99efb-91b7-405a-b8dd-0949d11c1f4a/crypt/zone/oxz_ntp_183f242b-420b-49ab-a81f-72ef238fcd26"), full_name: "oxp_9bc99efb-91b7-405a-b8dd-0949d11c1f4a/crypt/zone/oxz_ntp_183f242b-420b-49ab-a81f-72ef238fcd26" } file = sled-storage/src/manager.rs:1331
5302024-11-26T05:20:07.753ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5312024-11-26T05:20:07.753ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/580c5897-a97f-4c76-9a8f-bf80d62b760e/crypt/zone/oxz_crucible_0cbd328d-2b71-482b-8212-63117b07c620"), full_name: "oxp_580c5897-a97f-4c76-9a8f-bf80d62b760e/crypt/zone/oxz_crucible_0cbd328d-2b71-482b-8212-63117b07c620" } file = sled-storage/src/manager.rs:1331
5322024-11-26T05:20:07.854ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5332024-11-26T05:20:07.854ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/13de655b-3793-4d59-8bc1-22889b3fb01b/crypt/zone/oxz_cockroachdb_97bef1ac-058e-4c8a-9591-6029bf7ab0ad"), full_name: "oxp_13de655b-3793-4d59-8bc1-22889b3fb01b/crypt/zone/oxz_cockroachdb_97bef1ac-058e-4c8a-9591-6029bf7ab0ad" } file = sled-storage/src/manager.rs:1331
5342024-11-26T05:20:07.956ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5352024-11-26T05:20:07.956ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/62fc8f20-7ce8-489b-a022-013df6640479/crypt/zone/oxz_crucible_506e6a7b-f08a-43e3-ae23-7818916b2247"), full_name: "oxp_62fc8f20-7ce8-489b-a022-013df6640479/crypt/zone/oxz_crucible_506e6a7b-f08a-43e3-ae23-7818916b2247" } file = sled-storage/src/manager.rs:1331
5362024-11-26T05:20:07.959ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8) file = sled-agent/src/probe_manager.rs:231 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
5372024-11-26T05:20:08.059ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5382024-11-26T05:20:08.059ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9bc99efb-91b7-405a-b8dd-0949d11c1f4a/crypt/zone"), full_name: "oxp_9bc99efb-91b7-405a-b8dd-0949d11c1f4a/crypt/zone" } file = sled-storage/src/manager.rs:1331
5392024-11-26T05:20:08.129ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5402024-11-26T05:20:08.129ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1b72df9a-7b76-458e-9ee3-3ca99732ea65/crypt/zone/oxz_external_dns_7de56ef8-bdda-46b0-a9a9-fa5e97a778c5"), full_name: "oxp_1b72df9a-7b76-458e-9ee3-3ca99732ea65/crypt/zone/oxz_external_dns_7de56ef8-bdda-46b0-a9a9-fa5e97a778c5" } file = sled-storage/src/manager.rs:1331
5412024-11-26T05:20:08.229ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5422024-11-26T05:20:08.229ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9bc99efb-91b7-405a-b8dd-0949d11c1f4a/crypt/zone/oxz_crucible_be1e42ff-fa98-49f3-a5ff-e865a51b0418"), full_name: "oxp_9bc99efb-91b7-405a-b8dd-0949d11c1f4a/crypt/zone/oxz_crucible_be1e42ff-fa98-49f3-a5ff-e865a51b0418" } file = sled-storage/src/manager.rs:1331
5432024-11-26T05:20:08.328ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5442024-11-26T05:20:08.328ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_1b72df9a-7b76-458e-9ee3-3ca99732ea65/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
5452024-11-26T05:20:08.418ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5462024-11-26T05:20:08.418ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_580c5897-a97f-4c76-9a8f-bf80d62b760e/crucible" } file = sled-storage/src/manager.rs:1331
5472024-11-26T05:20:08.512ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5482024-11-26T05:20:08.512ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9bc99efb-91b7-405a-b8dd-0949d11c1f4a/crypt/debug"), full_name: "oxp_9bc99efb-91b7-405a-b8dd-0949d11c1f4a/crypt/debug" } file = sled-storage/src/manager.rs:1331
5492024-11-26T05:20:08.582ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5502024-11-26T05:20:08.582ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/06ee1c63-02b8-46d6-96ed-aa8ab7a8d522/crypt/zone/oxz_cockroachdb_45015942-f0b4-4b68-80a7-c9af4274ff35"), full_name: "oxp_06ee1c63-02b8-46d6-96ed-aa8ab7a8d522/crypt/zone/oxz_cockroachdb_45015942-f0b4-4b68-80a7-c9af4274ff35" } file = sled-storage/src/manager.rs:1331
5512024-11-26T05:20:08.684ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5522024-11-26T05:20:08.684ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_af39775d-5158-4242-88aa-5dd2d3c14817/crucible" } file = sled-storage/src/manager.rs:1331
5532024-11-26T05:20:08.774ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5542024-11-26T05:20:08.774ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_06ee1c63-02b8-46d6-96ed-aa8ab7a8d522/crypt/internal_dns" } file = sled-storage/src/manager.rs:1331
5552024-11-26T05:20:08.866ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5562024-11-26T05:20:08.866ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_13de655b-3793-4d59-8bc1-22889b3fb01b/crypt/internal_dns" } file = sled-storage/src/manager.rs:1331
5572024-11-26T05:20:08.958ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5582024-11-26T05:20:08.958ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/13de655b-3793-4d59-8bc1-22889b3fb01b/crypt/debug"), full_name: "oxp_13de655b-3793-4d59-8bc1-22889b3fb01b/crypt/debug" } file = sled-storage/src/manager.rs:1331
5592024-11-26T05:20:08.962ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8) file = sled-agent/src/probe_manager.rs:231 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
5602024-11-26T05:20:09.032ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5612024-11-26T05:20:09.032ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/580c5897-a97f-4c76-9a8f-bf80d62b760e/crypt/debug"), full_name: "oxp_580c5897-a97f-4c76-9a8f-bf80d62b760e/crypt/debug" } file = sled-storage/src/manager.rs:1331
5622024-11-26T05:20:09.100ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5632024-11-26T05:20:09.100ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/06ee1c63-02b8-46d6-96ed-aa8ab7a8d522/crypt/zone"), full_name: "oxp_06ee1c63-02b8-46d6-96ed-aa8ab7a8d522/crypt/zone" } file = sled-storage/src/manager.rs:1331
5642024-11-26T05:20:09.170ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5652024-11-26T05:20:09.170ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_1b72df9a-7b76-458e-9ee3-3ca99732ea65/crucible" } file = sled-storage/src/manager.rs:1331
5662024-11-26T05:20:09.255ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 13.595303647s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
5672024-11-26T05:20:09.260ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5682024-11-26T05:20:09.260ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_1b72df9a-7b76-458e-9ee3-3ca99732ea65/crypt/external_dns" } file = sled-storage/src/manager.rs:1331
5692024-11-26T05:20:09.351ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5702024-11-26T05:20:09.351ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_4fe72516-6144-43ef-96ee-e7fbaeb34f42/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
5712024-11-26T05:20:09.443ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5722024-11-26T05:20:09.443ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/af39775d-5158-4242-88aa-5dd2d3c14817/crypt/zone"), full_name: "oxp_af39775d-5158-4242-88aa-5dd2d3c14817/crypt/zone" } file = sled-storage/src/manager.rs:1331
5732024-11-26T05:20:09.512ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5742024-11-26T05:20:09.512ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_62fc8f20-7ce8-489b-a022-013df6640479/crucible" } file = sled-storage/src/manager.rs:1331
5752024-11-26T05:20:09.602ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5762024-11-26T05:20:09.602ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/da133136-28dd-4eff-a3ed-9f84ec495a60/crypt/zone"), full_name: "oxp_da133136-28dd-4eff-a3ed-9f84ec495a60/crypt/zone" } file = sled-storage/src/manager.rs:1331
5772024-11-26T05:20:09.672ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5782024-11-26T05:20:09.672ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1b72df9a-7b76-458e-9ee3-3ca99732ea65/crypt/debug"), full_name: "oxp_1b72df9a-7b76-458e-9ee3-3ca99732ea65/crypt/debug" } file = sled-storage/src/manager.rs:1331
5792024-11-26T05:20:09.763ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5802024-11-26T05:20:09.764ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/13de655b-3793-4d59-8bc1-22889b3fb01b/crypt/zone/oxz_oximeter_a4232f21-0674-457e-97a4-41c6f360d0c1"), full_name: "oxp_13de655b-3793-4d59-8bc1-22889b3fb01b/crypt/zone/oxz_oximeter_a4232f21-0674-457e-97a4-41c6f360d0c1" } file = sled-storage/src/manager.rs:1331
5812024-11-26T05:20:09.872ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5822024-11-26T05:20:09.872ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/13de655b-3793-4d59-8bc1-22889b3fb01b/crypt/zone/oxz_crucible_8b990e0a-1c33-413f-8695-830485958f9e"), full_name: "oxp_13de655b-3793-4d59-8bc1-22889b3fb01b/crypt/zone/oxz_crucible_8b990e0a-1c33-413f-8695-830485958f9e" } file = sled-storage/src/manager.rs:1331
5832024-11-26T05:20:09.965ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8) file = sled-agent/src/probe_manager.rs:231 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
5842024-11-26T05:20:09.975ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5852024-11-26T05:20:09.975ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/06ee1c63-02b8-46d6-96ed-aa8ab7a8d522/crypt/zone/oxz_nexus_ccf769ca-e6aa-41c6-80d6-7f1cfa2a624a"), full_name: "oxp_06ee1c63-02b8-46d6-96ed-aa8ab7a8d522/crypt/zone/oxz_nexus_ccf769ca-e6aa-41c6-80d6-7f1cfa2a624a" } file = sled-storage/src/manager.rs:1331
5862024-11-26T05:20:10.082ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5872024-11-26T05:20:10.082ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/62fc8f20-7ce8-489b-a022-013df6640479/crypt/zone/oxz_crucible_pantry_b0f7327e-9818-4b74-82bf-6f6bf3231db9"), full_name: "oxp_62fc8f20-7ce8-489b-a022-013df6640479/crypt/zone/oxz_crucible_pantry_b0f7327e-9818-4b74-82bf-6f6bf3231db9" } file = sled-storage/src/manager.rs:1331
5882024-11-26T05:20:10.185ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5892024-11-26T05:20:10.185ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/62fc8f20-7ce8-489b-a022-013df6640479/crypt/debug"), full_name: "oxp_62fc8f20-7ce8-489b-a022-013df6640479/crypt/debug" } file = sled-storage/src/manager.rs:1331
5902024-11-26T05:20:10.257ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5912024-11-26T05:20:10.257ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4fe72516-6144-43ef-96ee-e7fbaeb34f42/crypt/debug"), full_name: "oxp_4fe72516-6144-43ef-96ee-e7fbaeb34f42/crypt/debug" } file = sled-storage/src/manager.rs:1331
5922024-11-26T05:20:10.326ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5932024-11-26T05:20:10.326ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_1b72df9a-7b76-458e-9ee3-3ca99732ea65/crypt/internal_dns" } file = sled-storage/src/manager.rs:1331
5942024-11-26T05:20:10.415ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5952024-11-26T05:20:10.416ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1b72df9a-7b76-458e-9ee3-3ca99732ea65/crypt/zone/oxz_clickhouse_c80384a9-167d-483b-9108-3eccbfc759ce"), full_name: "oxp_1b72df9a-7b76-458e-9ee3-3ca99732ea65/crypt/zone/oxz_clickhouse_c80384a9-167d-483b-9108-3eccbfc759ce" } file = sled-storage/src/manager.rs:1331
5962024-11-26T05:20:10.523ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5972024-11-26T05:20:10.523ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/da133136-28dd-4eff-a3ed-9f84ec495a60/crypt/zone/oxz_crucible_50516551-aadd-4094-86ba-7d3c3018bfd8"), full_name: "oxp_da133136-28dd-4eff-a3ed-9f84ec495a60/crypt/zone/oxz_crucible_50516551-aadd-4094-86ba-7d3c3018bfd8" } file = sled-storage/src/manager.rs:1331
5982024-11-26T05:20:10.631ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5992024-11-26T05:20:10.631ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/da133136-28dd-4eff-a3ed-9f84ec495a60/crypt/debug"), full_name: "oxp_da133136-28dd-4eff-a3ed-9f84ec495a60/crypt/debug" } file = sled-storage/src/manager.rs:1331
6002024-11-26T05:20:10.702ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
6012024-11-26T05:20:10.702ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/af39775d-5158-4242-88aa-5dd2d3c14817/crypt/zone/oxz_crucible_90a408e9-936a-4920-ae45-8ca2dc33ed86"), full_name: "oxp_af39775d-5158-4242-88aa-5dd2d3c14817/crypt/zone/oxz_crucible_90a408e9-936a-4920-ae45-8ca2dc33ed86" } file = sled-storage/src/manager.rs:1331
6022024-11-26T05:20:10.805ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/8488adc3-a35c-4d33-bd61-39dfc8c64c55/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6032024-11-26T05:20:10.806ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/e4c38366-5212-46e4-b3d0-f797c1f6a6ba/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6042024-11-26T05:20:10.806ZINFOSledAgent: datasets ensure: Updated storage file = sled-agent/src/sled_agent.rs:852 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
6052024-11-26T05:20:10.806ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5931706 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:55569 req_id = e26ac32f-4f65-4efe-898e-7dab7fb30e17 response_code = 200 uri = /datasets
6062024-11-26T05:20:10.838ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: edbba3c6-f82f-4429-a7c3-f55287468ddf (service), filesystem_pool: Some(ZpoolName { id: 1b72df9a-7b76-458e-9ee3-3ca99732ea65 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1b72df9a-7b76-458e-9ee3-3ca99732ea65 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 3e7aa779-fd66-467c-8445-e284949ae776 (service), filesystem_pool: Some(ZpoolName { id: 13de655b-3793-4d59-8bc1-22889b3fb01b (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 13de655b-3793-4d59-8bc1-22889b3fb01b (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: b663146f-27f0-4d91-99d9-9d880c25a555 (service), filesystem_pool: Some(ZpoolName { id: 06ee1c63-02b8-46d6-96ed-aa8ab7a8d522 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 06ee1c63-02b8-46d6-96ed-aa8ab7a8d522 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:538 sled_address = [fd00:1122:3344:101::1]:12345
6072024-11-26T05:20:10.838ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60554
6082024-11-26T05:20:10.838ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: edbba3c6-f82f-4429-a7c3-f55287468ddf, dataset_name: DatasetName { pool_name: ZpoolName { id: 1b72df9a-7b76-458e-9ee3-3ca99732ea65 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
6092024-11-26T05:20:10.838ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: edbba3c6-f82f-4429-a7c3-f55287468ddf, dataset_name: DatasetName { pool_name: ZpoolName { id: 1b72df9a-7b76-458e-9ee3-3ca99732ea65 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6102024-11-26T05:20:10.871ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 3e7aa779-fd66-467c-8445-e284949ae776, dataset_name: DatasetName { pool_name: ZpoolName { id: 13de655b-3793-4d59-8bc1-22889b3fb01b (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
6112024-11-26T05:20:10.871ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 3e7aa779-fd66-467c-8445-e284949ae776, dataset_name: DatasetName { pool_name: ZpoolName { id: 13de655b-3793-4d59-8bc1-22889b3fb01b (zpool), kind: External }, kind: InternalDns }, responder: ... }
6122024-11-26T05:20:10.901ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: b663146f-27f0-4d91-99d9-9d880c25a555, dataset_name: DatasetName { pool_name: ZpoolName { id: 06ee1c63-02b8-46d6-96ed-aa8ab7a8d522 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
6132024-11-26T05:20:10.901ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: b663146f-27f0-4d91-99d9-9d880c25a555, dataset_name: DatasetName { pool_name: ZpoolName { id: 06ee1c63-02b8-46d6-96ed-aa8ab7a8d522 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6142024-11-26T05:20:10.907ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5087471388282461607 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
6152024-11-26T05:20:10.907ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2142942474541154563 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
6162024-11-26T05:20:10.931ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6172024-11-26T05:20:10.931ZINFOSledAgent (ServiceManager): No ledger in /pool/int/8488adc3-a35c-4d33-bd61-39dfc8c64c55/config/omicron-zones.json file = common/src/ledger.rs:188
6182024-11-26T05:20:10.931ZINFOSledAgent (ServiceManager): No ledger in /pool/int/e4c38366-5212-46e4-b3d0-f797c1f6a6ba/config/omicron-zones.json file = common/src/ledger.rs:188
6192024-11-26T05:20:10.932ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6202024-11-26T05:20:10.967ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:4293
6212024-11-26T05:20:10.968ZINFOSledAgent (ServiceManager): Ensuring there is a default route file = sled-agent/src/services.rs:4303 gateway = fd00:1122:3344:101::1
6222024-11-26T05:20:10.973ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8) file = sled-agent/src/probe_manager.rs:231 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
6232024-11-26T05:20:10.976ZINFOSledAgent (ServiceManager): Default route already exists file = sled-agent/src/services.rs:4317 gateway = fd00:1122:3344:101::1
6242024-11-26T05:20:10.976ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4382
6252024-11-26T05:20:10.986ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6262024-11-26T05:20:10.986ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6272024-11-26T05:20:10.986ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6282024-11-26T05:20:11.050ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_b663146f-27f0-4d91-99d9-9d880c25a555 file = illumos-utils/src/zone.rs:325
6292024-11-26T05:20:11.057ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_3e7aa779-fd66-467c-8445-e284949ae776 file = illumos-utils/src/zone.rs:325
6302024-11-26T05:20:11.062ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_edbba3c6-f82f-4429-a7c3-f55287468ddf file = illumos-utils/src/zone.rs:325
6312024-11-26T05:20:11.071ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_b663146f-27f0-4d91-99d9-9d880c25a555 file = illumos-utils/src/zone.rs:363
6322024-11-26T05:20:11.079ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_3e7aa779-fd66-467c-8445-e284949ae776 file = illumos-utils/src/zone.rs:363
6332024-11-26T05:20:11.085ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_edbba3c6-f82f-4429-a7c3-f55287468ddf file = illumos-utils/src/zone.rs:363
6342024-11-26T05:20:11.141ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4448
6352024-11-26T05:20:11.141ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4475
6362024-11-26T05:20:11.200ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4488
6372024-11-26T05:20:11.200ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4334
6382024-11-26T05:20:11.266ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4376
6392024-11-26T05:20:11.266ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4455 rack_subnet = fd00:1122:3344::
6402024-11-26T05:20:11.294ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4466
6412024-11-26T05:20:11.295ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4508
6422024-11-26T05:20:11.389ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4540
6432024-11-26T05:20:11.389ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4546
6442024-11-26T05:20:11.497ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4587
6452024-11-26T05:20:11.497ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:370
6462024-11-26T05:20:11.531ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:420
6472024-11-26T05:20:11.531ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8) file = sled-agent/src/nexus.rs:527 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
6482024-11-26T05:20:11.563ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:717
6492024-11-26T05:20:11.563ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:762
6502024-11-26T05:20:11.563ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:765 uptime = 1
6512024-11-26T05:20:11.563ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.2.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: Some(\n None,\n ),\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n tx_eq: None,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:444
6522024-11-26T05:20:11.599ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4120
6532024-11-26T05:20:11.649ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:603
6542024-11-26T05:20:11.649ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
6552024-11-26T05:20:11.649ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
6562024-11-26T05:20:11.649ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
6572024-11-26T05:20:11.649ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
6582024-11-26T05:20:11.649ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
6592024-11-26T05:20:11.649ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
6602024-11-26T05:20:11.649ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
6612024-11-26T05:20:11.649ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
6622024-11-26T05:20:11.649ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
6632024-11-26T05:20:11.649ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
6642024-11-26T05:20:11.649ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
6652024-11-26T05:20:11.649ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
6662024-11-26T05:20:11.649ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
6672024-11-26T05:20:11.649ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
6682024-11-26T05:20:11.649ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
6692024-11-26T05:20:11.649ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
6702024-11-26T05:20:11.649ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
6712024-11-26T05:20:11.649ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
6722024-11-26T05:20:11.649ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
6732024-11-26T05:20:11.649ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
6742024-11-26T05:20:11.649ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
6752024-11-26T05:20:11.649ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
6762024-11-26T05:20:11.975ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8) file = sled-agent/src/probe_manager.rs:231 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
6772024-11-26T05:20:12.030ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17839797364047048537 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
6782024-11-26T05:20:12.030ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6605641154872297595 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
6792024-11-26T05:20:12.697ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_edbba3c6-f82f-4429-a7c3-f55287468ddf: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6802024-11-26T05:20:12.698ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
6812024-11-26T05:20:13.176ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_b663146f-27f0-4d91-99d9-9d880c25a555: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6822024-11-26T05:20:13.653ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
6832024-11-26T05:20:13.653ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_3e7aa779-fd66-467c-8445-e284949ae776: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6842024-11-26T05:20:13.653ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_edbba3c6-f82f-4429-a7c3-f55287468ddf zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_edbba3c6-f82f-4429-a7c3-f55287468ddf
6852024-11-26T05:20:13.657ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
6862024-11-26T05:20:13.657ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_b663146f-27f0-4d91-99d9-9d880c25a555 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_b663146f-27f0-4d91-99d9-9d880c25a555
6872024-11-26T05:20:13.662ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_3e7aa779-fd66-467c-8445-e284949ae776 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_3e7aa779-fd66-467c-8445-e284949ae776
6882024-11-26T05:20:13.789ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3e7aa779-fd66-467c-8445-e284949ae776") failed: Property not found. retry in 49.678185ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_3e7aa779-fd66-467c-8445-e284949ae776
6892024-11-26T05:20:13.795ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b663146f-27f0-4d91-99d9-9d880c25a555") failed: Property not found. retry in 42.677719ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_b663146f-27f0-4d91-99d9-9d880c25a555
6902024-11-26T05:20:13.801ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_edbba3c6-f82f-4429-a7c3-f55287468ddf") failed: Property not found. retry in 48.729505ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_edbba3c6-f82f-4429-a7c3-f55287468ddf
6912024-11-26T05:20:13.845ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b663146f-27f0-4d91-99d9-9d880c25a555") failed: Property not found. retry in 132.786ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_b663146f-27f0-4d91-99d9-9d880c25a555
6922024-11-26T05:20:13.851ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3e7aa779-fd66-467c-8445-e284949ae776") failed: Property not found. retry in 87.462036ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_3e7aa779-fd66-467c-8445-e284949ae776
6932024-11-26T05:20:13.865ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_edbba3c6-f82f-4429-a7c3-f55287468ddf") failed: Property not found. retry in 104.25464ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_edbba3c6-f82f-4429-a7c3-f55287468ddf
6942024-11-26T05:20:14.132ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3e7aa779-fd66-467c-8445-e284949ae776") failed: Property not found. retry in 162.472797ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_3e7aa779-fd66-467c-8445-e284949ae776
6952024-11-26T05:20:14.250ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b663146f-27f0-4d91-99d9-9d880c25a555") failed: Property not found. retry in 132.280718ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_b663146f-27f0-4d91-99d9-9d880c25a555
6962024-11-26T05:20:14.300ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_edbba3c6-f82f-4429-a7c3-f55287468ddf") failed: Property not found. retry in 149.040124ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_edbba3c6-f82f-4429-a7c3-f55287468ddf
6972024-11-26T05:20:14.340ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3e7aa779-fd66-467c-8445-e284949ae776") failed: Property not found. retry in 511.85437ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_3e7aa779-fd66-467c-8445-e284949ae776
6982024-11-26T05:20:14.408ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b663146f-27f0-4d91-99d9-9d880c25a555") failed: Property not found. retry in 302.686856ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_b663146f-27f0-4d91-99d9-9d880c25a555
6992024-11-26T05:20:14.482ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_edbba3c6-f82f-4429-a7c3-f55287468ddf") failed: Property not found. retry in 468.907565ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_edbba3c6-f82f-4429-a7c3-f55287468ddf
7002024-11-26T05:20:14.723ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b663146f-27f0-4d91-99d9-9d880c25a555") failed: Property not found. retry in 423.648611ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_b663146f-27f0-4d91-99d9-9d880c25a555
7012024-11-26T05:20:14.861ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3e7aa779-fd66-467c-8445-e284949ae776") failed: Property not found. retry in 519.477931ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_3e7aa779-fd66-467c-8445-e284949ae776
7022024-11-26T05:20:14.961ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_edbba3c6-f82f-4429-a7c3-f55287468ddf") failed: Property not found. retry in 542.443775ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_edbba3c6-f82f-4429-a7c3-f55287468ddf
7032024-11-26T05:20:15.157ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b663146f-27f0-4d91-99d9-9d880c25a555") failed: Property not found. retry in 712.656965ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_b663146f-27f0-4d91-99d9-9d880c25a555
7042024-11-26T05:20:15.393ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3e7aa779-fd66-467c-8445-e284949ae776") failed: Property not found. retry in 1.196794255s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_3e7aa779-fd66-467c-8445-e284949ae776
7052024-11-26T05:20:15.513ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_edbba3c6-f82f-4429-a7c3-f55287468ddf") failed: Property not found. retry in 1.406689195s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_edbba3c6-f82f-4429-a7c3-f55287468ddf
7062024-11-26T05:20:15.880ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b663146f-27f0-4d91-99d9-9d880c25a555") failed: Property not found. retry in 756.337118ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_b663146f-27f0-4d91-99d9-9d880c25a555
7072024-11-26T05:20:16.600ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3e7aa779-fd66-467c-8445-e284949ae776") failed: Property not found. retry in 1.395994963s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_3e7aa779-fd66-467c-8445-e284949ae776
7082024-11-26T05:20:16.645ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b663146f-27f0-4d91-99d9-9d880c25a555") failed: Property not found. retry in 1.313186981s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_b663146f-27f0-4d91-99d9-9d880c25a555
7092024-11-26T05:20:16.928ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_edbba3c6-f82f-4429-a7c3-f55287468ddf") failed: Property not found. retry in 1.25667943s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_edbba3c6-f82f-4429-a7c3-f55287468ddf
7102024-11-26T05:20:17.966ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b663146f-27f0-4d91-99d9-9d880c25a555") failed: Property not found. retry in 657.932083ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_b663146f-27f0-4d91-99d9-9d880c25a555
7112024-11-26T05:20:18.005ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3e7aa779-fd66-467c-8445-e284949ae776") failed: Property not found. retry in 876.079794ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_3e7aa779-fd66-467c-8445-e284949ae776
7122024-11-26T05:20:18.194ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_edbba3c6-f82f-4429-a7c3-f55287468ddf") failed: Property not found. retry in 1.051509942s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_edbba3c6-f82f-4429-a7c3-f55287468ddf
7132024-11-26T05:20:18.635ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b663146f-27f0-4d91-99d9-9d880c25a555") failed: Property not found. retry in 872.303562ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_b663146f-27f0-4d91-99d9-9d880c25a555
7142024-11-26T05:20:18.891ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3e7aa779-fd66-467c-8445-e284949ae776") failed: Property not found. retry in 1.035420463s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_3e7aa779-fd66-467c-8445-e284949ae776
7152024-11-26T05:20:19.947ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3311 zone = oxz_internal_dns_b663146f-27f0-4d91-99d9-9d880c25a555
7162024-11-26T05:20:19.947ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3311 zone = oxz_internal_dns_3e7aa779-fd66-467c-8445-e284949ae776
7172024-11-26T05:20:19.947ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3311 zone = oxz_internal_dns_edbba3c6-f82f-4429-a7c3-f55287468ddf
7182024-11-26T05:20:19.947ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/8488adc3-a35c-4d33-bd61-39dfc8c64c55/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7192024-11-26T05:20:19.947ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/e4c38366-5212-46e4-b3d0-f797c1f6a6ba/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7202024-11-26T05:20:19.948ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9109666 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:60554 req_id = db0c6fde-f0c9-4c65-b7f3-5cbf42110b2b response_code = 204 uri = /omicron-zones
7212024-11-26T05:20:19.950ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:655
7222024-11-26T05:20:20.145ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 115.096215ms) dns_config_addr = [fd00:1122:3344:1::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:1::1]:5353/config) file = sled-agent/src/rack_setup/service.rs:675
7232024-11-26T05:20:20.278ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:655
7242024-11-26T05:20:20.326ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:655
7252024-11-26T05:20:20.374ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:691
7262024-11-26T05:20:20.374ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7272024-11-26T05:20:20.407ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7282024-11-26T05:20:20.408ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7292024-11-26T05:20:20.408ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7302024-11-26T05:20:20.437ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: edbba3c6-f82f-4429-a7c3-f55287468ddf (service), filesystem_pool: Some(ZpoolName { id: 1b72df9a-7b76-458e-9ee3-3ca99732ea65 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1b72df9a-7b76-458e-9ee3-3ca99732ea65 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 3e7aa779-fd66-467c-8445-e284949ae776 (service), filesystem_pool: Some(ZpoolName { id: 13de655b-3793-4d59-8bc1-22889b3fb01b (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 13de655b-3793-4d59-8bc1-22889b3fb01b (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: b663146f-27f0-4d91-99d9-9d880c25a555 (service), filesystem_pool: Some(ZpoolName { id: 06ee1c63-02b8-46d6-96ed-aa8ab7a8d522 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 06ee1c63-02b8-46d6-96ed-aa8ab7a8d522 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 183f242b-420b-49ab-a81f-72ef238fcd26 (service), filesystem_pool: Some(ZpoolName { id: 9bc99efb-91b7-405a-b8dd-0949d11c1f4a (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: eddacb61-71fc-40d4-ab86-c9b0732efc3e, kind: Service { id: 183f242b-420b-49ab-a81f-72ef238fcd26 }, name: Name("ntp-183f242b-420b-49ab-a81f-72ef238fcd26"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 177, 162])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:538 sled_address = [fd00:1122:3344:101::1]:12345
7312024-11-26T05:20:20.437ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58326
7322024-11-26T05:20:20.437ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: edbba3c6-f82f-4429-a7c3-f55287468ddf, dataset_name: DatasetName { pool_name: ZpoolName { id: 1b72df9a-7b76-458e-9ee3-3ca99732ea65 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
7332024-11-26T05:20:20.437ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: edbba3c6-f82f-4429-a7c3-f55287468ddf, dataset_name: DatasetName { pool_name: ZpoolName { id: 1b72df9a-7b76-458e-9ee3-3ca99732ea65 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7342024-11-26T05:20:20.476ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 3e7aa779-fd66-467c-8445-e284949ae776, dataset_name: DatasetName { pool_name: ZpoolName { id: 13de655b-3793-4d59-8bc1-22889b3fb01b (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
7352024-11-26T05:20:20.476ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 3e7aa779-fd66-467c-8445-e284949ae776, dataset_name: DatasetName { pool_name: ZpoolName { id: 13de655b-3793-4d59-8bc1-22889b3fb01b (zpool), kind: External }, kind: InternalDns }, responder: ... }
7362024-11-26T05:20:20.512ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: b663146f-27f0-4d91-99d9-9d880c25a555, dataset_name: DatasetName { pool_name: ZpoolName { id: 06ee1c63-02b8-46d6-96ed-aa8ab7a8d522 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
7372024-11-26T05:20:20.512ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: b663146f-27f0-4d91-99d9-9d880c25a555, dataset_name: DatasetName { pool_name: ZpoolName { id: 06ee1c63-02b8-46d6-96ed-aa8ab7a8d522 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7382024-11-26T05:20:20.544ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7392024-11-26T05:20:20.545ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8488adc3-a35c-4d33-bd61-39dfc8c64c55/config/omicron-zones.json file = common/src/ledger.rs:177
7402024-11-26T05:20:20.545ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/e4c38366-5212-46e4-b3d0-f797c1f6a6ba/config/omicron-zones.json file = common/src/ledger.rs:177
7412024-11-26T05:20:20.545ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7422024-11-26T05:20:20.556ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7432024-11-26T05:20:20.588ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7442024-11-26T05:20:20.589ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7452024-11-26T05:20:20.589ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7462024-11-26T05:20:20.619ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 177, 162]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
7472024-11-26T05:20:20.619ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = boundary_ntp
7482024-11-26T05:20:20.619ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:83
7492024-11-26T05:20:20.619ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:90
7502024-11-26T05:20:20.620ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:118
7512024-11-26T05:20:20.621ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7522024-11-26T05:20:20.647ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_183f242b-420b-49ab-a81f-72ef238fcd26 file = illumos-utils/src/zone.rs:325
7532024-11-26T05:20:20.666ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_183f242b-420b-49ab-a81f-72ef238fcd26 file = illumos-utils/src/zone.rs:363
7542024-11-26T05:20:20.909ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5087471388282461607 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
7552024-11-26T05:20:20.909ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2142942474541154563 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
7562024-11-26T05:20:21.293ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_183f242b-420b-49ab-a81f-72ef238fcd26: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7572024-11-26T05:20:21.293ZINFOSledAgent (ServiceManager): Booting oxz_ntp_183f242b-420b-49ab-a81f-72ef238fcd26 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_ntp_183f242b-420b-49ab-a81f-72ef238fcd26
7582024-11-26T05:20:21.421ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_183f242b-420b-49ab-a81f-72ef238fcd26") failed: Property not found. retry in 66.044324ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_183f242b-420b-49ab-a81f-72ef238fcd26
7592024-11-26T05:20:21.500ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_183f242b-420b-49ab-a81f-72ef238fcd26") failed: Property not found. retry in 82.52865ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_183f242b-420b-49ab-a81f-72ef238fcd26
7602024-11-26T05:20:21.593ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_183f242b-420b-49ab-a81f-72ef238fcd26") failed: Property not found. retry in 109.675581ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_183f242b-420b-49ab-a81f-72ef238fcd26
7612024-11-26T05:20:21.714ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_183f242b-420b-49ab-a81f-72ef238fcd26") failed: Property not found. retry in 482.394227ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_183f242b-420b-49ab-a81f-72ef238fcd26
7622024-11-26T05:20:22.033ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17839797364047048537 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
7632024-11-26T05:20:22.033ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6605641154872297595 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
7642024-11-26T05:20:22.207ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_183f242b-420b-49ab-a81f-72ef238fcd26") failed: Property not found. retry in 723.938409ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_183f242b-420b-49ab-a81f-72ef238fcd26
7652024-11-26T05:20:22.940ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_183f242b-420b-49ab-a81f-72ef238fcd26") failed: Property not found. retry in 1.1282396s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_183f242b-420b-49ab-a81f-72ef238fcd26
7662024-11-26T05:20:24.078ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_183f242b-420b-49ab-a81f-72ef238fcd26") failed: Property not found. retry in 1.394500056s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_183f242b-420b-49ab-a81f-72ef238fcd26
7672024-11-26T05:20:25.482ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_183f242b-420b-49ab-a81f-72ef238fcd26") failed: Property not found. retry in 943.624681ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_183f242b-420b-49ab-a81f-72ef238fcd26
7682024-11-26T05:20:26.446ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3311 zone = oxz_ntp_183f242b-420b-49ab-a81f-72ef238fcd26
7692024-11-26T05:20:26.446ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/8488adc3-a35c-4d33-bd61-39dfc8c64c55/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7702024-11-26T05:20:26.447ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/e4c38366-5212-46e4-b3d0-f797c1f6a6ba/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7712024-11-26T05:20:26.447ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6009553 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:58326 req_id = c080b144-4a27-4a01-a335-f3573e7c070a response_code = 204 uri = /omicron-zones
7722024-11-26T05:20:26.449ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:732
7732024-11-26T05:20:26.483ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
7742024-11-26T05:20:26.483ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37522
7752024-11-26T05:20:26.495ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_183f242b-420b-49ab-a81f-72ef238fcd26': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3901
7762024-11-26T05:20:26.495ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 11278 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:37522 req_id = 75d97be1-5c40-4fea-8956-fb7b21cd7fe8 response_code = 500 uri = /timesync
7772024-11-26T05:20:26.497ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
7782024-11-26T05:20:26.615ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
7792024-11-26T05:20:26.615ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44608
7802024-11-26T05:20:29.271ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17936401519983205955 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
7812024-11-26T05:20:29.532ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16591598817973984648 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
7822024-11-26T05:20:29.950ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8139731774706432805 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
7832024-11-26T05:20:30.624ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_183f242b-420b-49ab-a81f-72ef238fcd26': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3901
7842024-11-26T05:20:30.624ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 4009015 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:44608 req_id = e13145b0-f4cd-4434-a74e-6de5f61cbb43 response_code = 500 uri = /timesync
7852024-11-26T05:20:30.627ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
7862024-11-26T05:20:30.834ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
7872024-11-26T05:20:30.834ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58188
7882024-11-26T05:20:30.843ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_183f242b-420b-49ab-a81f-72ef238fcd26': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3901
7892024-11-26T05:20:30.843ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 9021 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:58188 req_id = 190578a2-c943-41f4-84b4-c07b04679392 response_code = 500 uri = /timesync
7902024-11-26T05:20:30.847ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
7912024-11-26T05:20:30.912ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5087471388282461607 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
7922024-11-26T05:20:30.912ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2142942474541154563 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
7932024-11-26T05:20:30.963ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
7942024-11-26T05:20:30.963ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53078
7952024-11-26T05:20:32.035ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17839797364047048537 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
7962024-11-26T05:20:32.035ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6605641154872297595 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
7972024-11-26T05:20:36.175ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_183f242b-420b-49ab-a81f-72ef238fcd26': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3901
7982024-11-26T05:20:36.175ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 4008428 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:53078 req_id = 84314762-1ecb-4e5f-8f93-491c03c617fa response_code = 500 uri = /timesync
7992024-11-26T05:20:36.177ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8002024-11-26T05:20:36.340ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8012024-11-26T05:20:36.340ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55908
8022024-11-26T05:20:36.349ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9038 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:55908 req_id = e886353d-c94b-400b-b6b2-d414049cad51 response_code = 200 uri = /timesync
8032024-11-26T05:20:36.351ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1732598434.2195742, correction: -0.312036335 } file = sled-agent/src/rack_setup/service.rs:740
8042024-11-26T05:20:36.351ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8052024-11-26T05:20:36.534ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8062024-11-26T05:20:36.534ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40635
8072024-11-26T05:20:36.543ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8314 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:40635 req_id = 7e39ea08-c2c8-4ede-b8f7-f7dc76fb7566 response_code = 200 uri = /timesync
8082024-11-26T05:20:36.545ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1732598434.2195742, correction: -0.311510116 } file = sled-agent/src/rack_setup/service.rs:740
8092024-11-26T05:20:36.545ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8102024-11-26T05:20:36.796ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8112024-11-26T05:20:36.796ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46802
8122024-11-26T05:20:36.804ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8433 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:46802 req_id = b3ae0cbc-3903-4a78-a12c-0a6f75bac174 response_code = 200 uri = /timesync
8132024-11-26T05:20:36.807ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1732598434.2195742, correction: -0.311024457 } file = sled-agent/src/rack_setup/service.rs:740
8142024-11-26T05:20:36.807ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8152024-11-26T05:20:37.128ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8162024-11-26T05:20:37.128ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48985
8172024-11-26T05:20:37.136ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7971 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:48985 req_id = c0fd8787-1500-4c1c-96fb-27ae1a8e422c response_code = 200 uri = /timesync
8182024-11-26T05:20:37.137ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1732598434.2195742, correction: -0.310124487 } file = sled-agent/src/rack_setup/service.rs:740
8192024-11-26T05:20:37.137ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8202024-11-26T05:20:37.348ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8212024-11-26T05:20:37.348ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:36779
8222024-11-26T05:20:37.356ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7588 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:36779 req_id = 2d81736a-d767-483d-afc6-042e0db1e12a response_code = 200 uri = /timesync
8232024-11-26T05:20:37.359ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1732598434.2195742, correction: -0.30952692 } file = sled-agent/src/rack_setup/service.rs:740
8242024-11-26T05:20:37.359ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8252024-11-26T05:20:37.650ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7748550777703583911 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
8262024-11-26T05:20:37.650ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17635281772808660727 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
8272024-11-26T05:20:37.997ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8282024-11-26T05:20:37.998ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61290
8292024-11-26T05:20:38.007ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9014 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:61290 req_id = e5f7f9d6-907c-4ff5-975a-1bee3610a467 response_code = 200 uri = /timesync
8302024-11-26T05:20:38.009ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1732598434.2195742, correction: -0.307984412 } file = sled-agent/src/rack_setup/service.rs:740
8312024-11-26T05:20:38.009ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8322024-11-26T05:20:38.777ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8332024-11-26T05:20:38.778ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39403
8342024-11-26T05:20:38.787ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8976 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39403 req_id = dca8c6a3-6788-4370-9495-6a2c4416fdb8 response_code = 200 uri = /timesync
8352024-11-26T05:20:38.788ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1732598434.2195742, correction: -0.306474 } file = sled-agent/src/rack_setup/service.rs:740
8362024-11-26T05:20:38.788ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8372024-11-26T05:20:39.083ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 366.95887ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
8382024-11-26T05:20:39.285ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8392024-11-26T05:20:39.285ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44259
8402024-11-26T05:20:39.294ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8567 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:44259 req_id = 8686e1f9-9b37-4b59-957a-24a89b30e984 response_code = 200 uri = /timesync
8412024-11-26T05:20:39.296ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1732598434.2195742, correction: -0.305096656 } file = sled-agent/src/rack_setup/service.rs:740
8422024-11-26T05:20:39.296ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8432024-11-26T05:20:40.279ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8442024-11-26T05:20:40.279ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56097
8452024-11-26T05:20:40.287ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7894 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:56097 req_id = 2e76dc08-30bc-4137-a9bb-0913ac106f93 response_code = 200 uri = /timesync
8462024-11-26T05:20:40.289ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380539, ip_addr: 162.159.200.123, stratum: 4, ref_time: 1732598439.1468823, correction: -0.302468687 } file = sled-agent/src/rack_setup/service.rs:740
8472024-11-26T05:20:40.289ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8482024-11-26T05:20:40.466ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17936401519983205955 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
8492024-11-26T05:20:40.724ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16591598817973984648 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
8502024-11-26T05:20:40.769ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8512024-11-26T05:20:40.769ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57822
8522024-11-26T05:20:40.778ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8952 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:57822 req_id = 7c1be5e8-fa73-443e-93df-3544691e0f9c response_code = 200 uri = /timesync
8532024-11-26T05:20:40.779ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380539, ip_addr: 162.159.200.123, stratum: 4, ref_time: 1732598439.6952236, correction: -0.301040322 } file = sled-agent/src/rack_setup/service.rs:740
8542024-11-26T05:20:40.779ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8552024-11-26T05:20:41.143ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8139731774706432805 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
8562024-11-26T05:20:41.765ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8572024-11-26T05:20:41.766ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:32867
8582024-11-26T05:20:41.774ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8620 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:32867 req_id = ed65b4ed-ea18-4b89-837a-0d6013d57bb5 response_code = 200 uri = /timesync
8592024-11-26T05:20:41.777ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380539, ip_addr: 162.159.200.123, stratum: 4, ref_time: 1732598441.110114, correction: -0.298238754 } file = sled-agent/src/rack_setup/service.rs:740
8602024-11-26T05:20:41.777ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8612024-11-26T05:20:42.101ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5087471388282461607 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
8622024-11-26T05:20:42.101ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2142942474541154563 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
8632024-11-26T05:20:42.380ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:58383
8642024-11-26T05:20:42.380ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:58383 req_id = c9b6214f-e215-44bf-94ab-435f19c177bf response_code = 200 uri = /baseboard
8652024-11-26T05:20:43.221ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17839797364047048537 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
8662024-11-26T05:20:43.221ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6605641154872297595 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
8672024-11-26T05:20:43.564ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8682024-11-26T05:20:43.564ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52330
8692024-11-26T05:20:43.573ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9333 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:52330 req_id = 26330801-1285-4ff2-bbd5-e1907e2c6893 response_code = 200 uri = /timesync
8702024-11-26T05:20:43.575ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380539, ip_addr: 162.159.200.123, stratum: 4, ref_time: 1732598441.450962, correction: -0.292364925 } file = sled-agent/src/rack_setup/service.rs:740
8712024-11-26T05:20:43.575ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8722024-11-26T05:20:44.980ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8732024-11-26T05:20:44.980ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40105
8742024-11-26T05:20:44.989ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9064 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:40105 req_id = 85881616-a120-44b0-a4ad-20eab3d8c2c2 response_code = 200 uri = /timesync
8752024-11-26T05:20:44.991ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380539, ip_addr: 162.159.200.123, stratum: 4, ref_time: 1732598443.654132, correction: -0.288436651 } file = sled-agent/src/rack_setup/service.rs:740
8762024-11-26T05:20:44.991ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8772024-11-26T05:20:46.728ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8782024-11-26T05:20:46.728ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58345
8792024-11-26T05:20:46.737ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7974 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:58345 req_id = cadcf555-bf90-402d-b8cc-980b9c1d2e89 response_code = 200 uri = /timesync
8802024-11-26T05:20:46.739ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380539, ip_addr: 162.159.200.123, stratum: 4, ref_time: 1732598445.477517, correction: -0.28364262 } file = sled-agent/src/rack_setup/service.rs:740
8812024-11-26T05:20:46.739ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8822024-11-26T05:20:47.624ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7748550777703583911 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
8832024-11-26T05:20:47.624ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17635281772808660727 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
8842024-11-26T05:20:48.241ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8852024-11-26T05:20:48.241ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35093
8862024-11-26T05:20:48.250ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8558 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:35093 req_id = d36a46fb-9200-4243-b352-010f7e046cc0 response_code = 200 uri = /timesync
8872024-11-26T05:20:48.252ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380539, ip_addr: 162.159.200.123, stratum: 4, ref_time: 1732598446.5199373, correction: -0.279521108 } file = sled-agent/src/rack_setup/service.rs:740
8882024-11-26T05:20:48.252ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8892024-11-26T05:20:49.679ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8902024-11-26T05:20:49.679ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62194
8912024-11-26T05:20:49.689ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9575 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:62194 req_id = edff30ee-e806-4e39-b091-4ac6c05f291c response_code = 200 uri = /timesync
8922024-11-26T05:20:49.691ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380539, ip_addr: 162.159.200.123, stratum: 4, ref_time: 1732598447.9322083, correction: -0.275599182 } file = sled-agent/src/rack_setup/service.rs:740
8932024-11-26T05:20:49.691ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8942024-11-26T05:20:50.440ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17936401519983205955 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
8952024-11-26T05:20:50.698ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16591598817973984648 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
8962024-11-26T05:20:51.117ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8139731774706432805 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
8972024-11-26T05:20:51.372ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8982024-11-26T05:20:51.372ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:38998
8992024-11-26T05:20:51.382ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9285 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:38998 req_id = 11c1494f-e6ee-49a0-a73e-56953cfd1dd1 response_code = 200 uri = /timesync
9002024-11-26T05:20:51.385ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380539, ip_addr: 162.159.200.123, stratum: 4, ref_time: 1732598449.8923726, correction: -0.271028668 } file = sled-agent/src/rack_setup/service.rs:740
9012024-11-26T05:20:51.385ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9022024-11-26T05:20:52.076ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5087471388282461607 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
9032024-11-26T05:20:52.076ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2142942474541154563 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
9042024-11-26T05:20:53.195ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17839797364047048537 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
9052024-11-26T05:20:53.196ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6605641154872297595 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
9062024-11-26T05:20:54.444ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 395.210151ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
9072024-11-26T05:20:54.816ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9082024-11-26T05:20:54.816ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57891
9092024-11-26T05:20:54.826ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9781 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:57891 req_id = 76656041-564c-4262-8b98-f10caace48c1 response_code = 200 uri = /timesync
9102024-11-26T05:20:54.829ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380539, ip_addr: 162.159.200.123, stratum: 4, ref_time: 1732598453.085138, correction: -0.261648208 } file = sled-agent/src/rack_setup/service.rs:740
9112024-11-26T05:20:54.829ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9122024-11-26T05:20:57.598ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7748550777703583911 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
9132024-11-26T05:20:57.598ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17635281772808660727 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
9142024-11-26T05:20:57.703ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9152024-11-26T05:20:57.703ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47433
9162024-11-26T05:20:57.712ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:47433 req_id = 6f139b7a-2913-457e-a894-ab8a6b22e95e response_code = 200 uri = /timesync
9172024-11-26T05:20:57.715ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380539, ip_addr: 162.159.200.123, stratum: 4, ref_time: 1732598456.0929012, correction: -0.253819108 } file = sled-agent/src/rack_setup/service.rs:740
9182024-11-26T05:20:57.715ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9192024-11-26T05:21:00.416ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17936401519983205955 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
9202024-11-26T05:21:00.671ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16591598817973984648 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
9212024-11-26T05:21:01.092ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8139731774706432805 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
9222024-11-26T05:21:02.050ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 5087471388282461607 reason = Duration(60s) sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
9232024-11-26T05:21:02.051ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 2142942474541154563 reason = Duration(60s) sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
9242024-11-26T05:21:02.285ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9252024-11-26T05:21:02.285ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48114
9262024-11-26T05:21:02.294ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8679 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:48114 req_id = 0de2ffda-db6d-41c8-a1ec-e60d13b267c9 response_code = 200 uri = /timesync
9272024-11-26T05:21:02.297ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380539, ip_addr: 162.159.200.123, stratum: 4, ref_time: 1732598459.7573647, correction: -0.241330668 } file = sled-agent/src/rack_setup/service.rs:740
9282024-11-26T05:21:02.297ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9292024-11-26T05:21:03.171ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17839797364047048537 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
9302024-11-26T05:21:03.171ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6605641154872297595 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
9312024-11-26T05:21:07.574ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7748550777703583911 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
9322024-11-26T05:21:07.574ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17635281772808660727 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
9332024-11-26T05:21:09.834ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.09202332s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
9342024-11-26T05:21:10.391ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17936401519983205955 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
9352024-11-26T05:21:10.645ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16591598817973984648 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
9362024-11-26T05:21:11.067ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8139731774706432805 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
9372024-11-26T05:21:11.548ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9382024-11-26T05:21:11.549ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44408
9392024-11-26T05:21:11.558ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8775 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:44408 req_id = ae991de5-8e48-4eca-ac43-974f3c08a585 response_code = 200 uri = /timesync
9402024-11-26T05:21:11.560ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380539, ip_addr: 162.159.200.123, stratum: 4, ref_time: 1732598468.5929973, correction: -0.216208026 } file = sled-agent/src/rack_setup/service.rs:740
9412024-11-26T05:21:11.560ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9422024-11-26T05:21:12.332ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:35305
9432024-11-26T05:21:12.332ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:35305 req_id = 734c811e-a30c-4c7b-b63e-84176405332f response_code = 200 uri = /baseboard
9442024-11-26T05:21:13.147ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17839797364047048537 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
9452024-11-26T05:21:13.147ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6605641154872297595 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
9462024-11-26T05:21:17.548ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7748550777703583911 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
9472024-11-26T05:21:17.548ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17635281772808660727 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
9482024-11-26T05:21:20.366ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 17936401519983205955 reason = Duration(60s) sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
9492024-11-26T05:21:20.619ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 16591598817973984648 reason = Duration(60s) sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
9502024-11-26T05:21:21.042ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 8139731774706432805 reason = Duration(60s) sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
9512024-11-26T05:21:21.172ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9522024-11-26T05:21:21.172ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59217
9532024-11-26T05:21:21.183ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10000 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:59217 req_id = 7e70f74d-ff53-440d-b893-89d1d1fbda15 response_code = 200 uri = /timesync
9542024-11-26T05:21:21.185ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380539, ip_addr: 162.159.200.123, stratum: 4, ref_time: 1732598476.608461, correction: -0.190049946 } file = sled-agent/src/rack_setup/service.rs:740
9552024-11-26T05:21:21.185ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9562024-11-26T05:21:23.121ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17839797364047048537 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
9572024-11-26T05:21:23.122ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6605641154872297595 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
9582024-11-26T05:21:25.919ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.433549391s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
9592024-11-26T05:21:27.523ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 7748550777703583911 reason = Duration(60s) sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
9602024-11-26T05:21:27.524ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 17635281772808660727 reason = Duration(60s) sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
9612024-11-26T05:21:33.096ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17839797364047048537 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
9622024-11-26T05:21:33.096ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6605641154872297595 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
9632024-11-26T05:21:34.649ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9642024-11-26T05:21:34.649ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42999
9652024-11-26T05:21:34.658ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8865 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42999 req_id = b438bc9d-1ff9-4c60-a361-4ac16ec3f473 response_code = 200 uri = /timesync
9662024-11-26T05:21:34.661ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380539, ip_addr: 162.159.200.123, stratum: 4, ref_time: 1732598488.940544, correction: -0.153422132 } file = sled-agent/src/rack_setup/service.rs:740
9672024-11-26T05:21:34.661ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9682024-11-26T05:21:42.285ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:36687
9692024-11-26T05:21:42.285ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:36687 req_id = ac54df4d-88de-4f86-a802-736700ac4098 response_code = 200 uri = /baseboard
9702024-11-26T05:21:42.343ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 5.585572615s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
9712024-11-26T05:21:43.072ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17839797364047048537 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
9722024-11-26T05:21:43.072ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6605641154872297595 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
9732024-11-26T05:21:50.397ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9742024-11-26T05:21:50.397ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48690
9752024-11-26T05:21:50.406ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8810 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:48690 req_id = 5eeb58d0-fd76-41d0-a496-453899af97d8 response_code = 200 uri = /timesync
9762024-11-26T05:21:50.409ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380539, ip_addr: 162.159.200.123, stratum: 4, ref_time: 1732598505.2653582, correction: -0.110718675 } file = sled-agent/src/rack_setup/service.rs:740
9772024-11-26T05:21:50.409ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9782024-11-26T05:21:53.047ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17839797364047048537 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
9792024-11-26T05:21:53.047ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6605641154872297595 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
9802024-11-26T05:22:00.075ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9812024-11-26T05:22:00.075ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55144
9822024-11-26T05:22:00.084ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9063 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:55144 req_id = d539e13e-1959-4d6f-8891-8ebad259c9bd response_code = 200 uri = /timesync
9832024-11-26T05:22:00.087ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380539, ip_addr: 162.159.200.123, stratum: 4, ref_time: 1732598512.90556, correction: -0.084438346 } file = sled-agent/src/rack_setup/service.rs:740
9842024-11-26T05:22:00.087ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9852024-11-26T05:22:02.909ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 6.577977491s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
9862024-11-26T05:22:03.022ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17839797364047048537 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
9872024-11-26T05:22:03.022ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6605641154872297595 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
9882024-11-26T05:22:11.289ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9892024-11-26T05:22:11.290ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41734
9902024-11-26T05:22:11.299ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9286 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:41734 req_id = 2716ae92-e372-4be7-b057-634873546f18 response_code = 200 uri = /timesync
9912024-11-26T05:22:11.302ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380539, ip_addr: 162.159.200.123, stratum: 4, ref_time: 1732598529.1423423, correction: -0.0539116 } file = sled-agent/src/rack_setup/service.rs:740
9922024-11-26T05:22:11.302ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9932024-11-26T05:22:12.238ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:44092
9942024-11-26T05:22:12.239ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:44092 req_id = c69ae718-1538-4b53-84da-e3645dc341a5 response_code = 200 uri = /baseboard
9952024-11-26T05:22:12.997ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17839797364047048537 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
9962024-11-26T05:22:12.997ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6605641154872297595 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
9972024-11-26T05:22:22.972ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17839797364047048537 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
9982024-11-26T05:22:22.972ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6605641154872297595 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
9992024-11-26T05:22:24.464ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 20.171132084s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
10002024-11-26T05:22:25.409ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
10012024-11-26T05:22:25.409ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63451
10022024-11-26T05:22:25.431ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 21167 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:63451 req_id = 01dfd1b4-ab8c-43c1-bfc7-44abdf319202 response_code = 200 uri = /timesync
10032024-11-26T05:22:25.431ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-26T05:21:20.619439437Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 16591598817973984648 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
10042024-11-26T05:22:25.432ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-26T05:21:27.524254354Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 17635281772808660727 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
10052024-11-26T05:22:25.432ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-26T05:21:02.050593005Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 5087471388282461607 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
10062024-11-26T05:22:25.433ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-26T05:21:02.051174516Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 2142942474541154563 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
10072024-11-26T05:22:25.433ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-26T05:21:20.366559711Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 17936401519983205955 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
10082024-11-26T05:22:25.434ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-26T05:21:27.523739223Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 7748550777703583911 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
10092024-11-26T05:22:25.434ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-26T05:21:21.042601666Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 8139731774706432805 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
10102024-11-26T05:22:25.435ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 2728380539, ip_addr: 162.159.200.123, stratum: 4, ref_time: 1732598536.6770632, correction: -0.015561965 } file = sled-agent/src/rack_setup/service.rs:740
10112024-11-26T05:22:25.435ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1425
10122024-11-26T05:22:25.464ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: edbba3c6-f82f-4429-a7c3-f55287468ddf (service), filesystem_pool: Some(ZpoolName { id: 1b72df9a-7b76-458e-9ee3-3ca99732ea65 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1b72df9a-7b76-458e-9ee3-3ca99732ea65 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 3e7aa779-fd66-467c-8445-e284949ae776 (service), filesystem_pool: Some(ZpoolName { id: 13de655b-3793-4d59-8bc1-22889b3fb01b (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 13de655b-3793-4d59-8bc1-22889b3fb01b (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: b663146f-27f0-4d91-99d9-9d880c25a555 (service), filesystem_pool: Some(ZpoolName { id: 06ee1c63-02b8-46d6-96ed-aa8ab7a8d522 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 06ee1c63-02b8-46d6-96ed-aa8ab7a8d522 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 183f242b-420b-49ab-a81f-72ef238fcd26 (service), filesystem_pool: Some(ZpoolName { id: 9bc99efb-91b7-405a-b8dd-0949d11c1f4a (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: eddacb61-71fc-40d4-ab86-c9b0732efc3e, kind: Service { id: 183f242b-420b-49ab-a81f-72ef238fcd26 }, name: Name("ntp-183f242b-420b-49ab-a81f-72ef238fcd26"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 177, 162])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: afc5473a-4cc3-4263-8522-c328753d2c8d (service), filesystem_pool: Some(ZpoolName { id: 1b72df9a-7b76-458e-9ee3-3ca99732ea65 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1b72df9a-7b76-458e-9ee3-3ca99732ea65 (zpool), kind: External } } } }, OmicronZoneConfig { id: 97bef1ac-058e-4c8a-9591-6029bf7ab0ad (service), filesystem_pool: Some(ZpoolName { id: 13de655b-3793-4d59-8bc1-22889b3fb01b (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 13de655b-3793-4d59-8bc1-22889b3fb01b (zpool), kind: External } } } }, OmicronZoneConfig { id: 45015942-f0b4-4b68-80a7-c9af4274ff35 (service), filesystem_pool: Some(ZpoolName { id: 06ee1c63-02b8-46d6-96ed-aa8ab7a8d522 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 06ee1c63-02b8-46d6-96ed-aa8ab7a8d522 (zpool), kind: External } } } }, OmicronZoneConfig { id: 591416ad-4f91-4b1e-9e61-71515d759ba4 (service), filesystem_pool: Some(ZpoolName { id: 4fe72516-6144-43ef-96ee-e7fbaeb34f42 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 4fe72516-6144-43ef-96ee-e7fbaeb34f42 (zpool), kind: External } } } }, OmicronZoneConfig { id: 078ab58f-5ac4-4c10-8dfe-84a92fb7bb65 (service), filesystem_pool: Some(ZpoolName { id: 580c5897-a97f-4c76-9a8f-bf80d62b760e (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 580c5897-a97f-4c76-9a8f-bf80d62b760e (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:538 sled_address = [fd00:1122:3344:101::1]:12345
10132024-11-26T05:22:25.465ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64135
10142024-11-26T05:22:25.465ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: edbba3c6-f82f-4429-a7c3-f55287468ddf, dataset_name: DatasetName { pool_name: ZpoolName { id: 1b72df9a-7b76-458e-9ee3-3ca99732ea65 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
10152024-11-26T05:22:25.465ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: edbba3c6-f82f-4429-a7c3-f55287468ddf, dataset_name: DatasetName { pool_name: ZpoolName { id: 1b72df9a-7b76-458e-9ee3-3ca99732ea65 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10162024-11-26T05:22:25.501ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 3e7aa779-fd66-467c-8445-e284949ae776, dataset_name: DatasetName { pool_name: ZpoolName { id: 13de655b-3793-4d59-8bc1-22889b3fb01b (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
10172024-11-26T05:22:25.501ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 3e7aa779-fd66-467c-8445-e284949ae776, dataset_name: DatasetName { pool_name: ZpoolName { id: 13de655b-3793-4d59-8bc1-22889b3fb01b (zpool), kind: External }, kind: InternalDns }, responder: ... }
10182024-11-26T05:22:25.534ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: b663146f-27f0-4d91-99d9-9d880c25a555, dataset_name: DatasetName { pool_name: ZpoolName { id: 06ee1c63-02b8-46d6-96ed-aa8ab7a8d522 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
10192024-11-26T05:22:25.534ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: b663146f-27f0-4d91-99d9-9d880c25a555, dataset_name: DatasetName { pool_name: ZpoolName { id: 06ee1c63-02b8-46d6-96ed-aa8ab7a8d522 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10202024-11-26T05:22:25.566ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: afc5473a-4cc3-4263-8522-c328753d2c8d, dataset_name: DatasetName { pool_name: ZpoolName { id: 1b72df9a-7b76-458e-9ee3-3ca99732ea65 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10212024-11-26T05:22:25.566ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: afc5473a-4cc3-4263-8522-c328753d2c8d, dataset_name: DatasetName { pool_name: ZpoolName { id: 1b72df9a-7b76-458e-9ee3-3ca99732ea65 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10222024-11-26T05:22:25.597ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 97bef1ac-058e-4c8a-9591-6029bf7ab0ad, dataset_name: DatasetName { pool_name: ZpoolName { id: 13de655b-3793-4d59-8bc1-22889b3fb01b (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10232024-11-26T05:22:25.597ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 97bef1ac-058e-4c8a-9591-6029bf7ab0ad, dataset_name: DatasetName { pool_name: ZpoolName { id: 13de655b-3793-4d59-8bc1-22889b3fb01b (zpool), kind: External }, kind: Cockroach }, responder: ... }
10242024-11-26T05:22:25.628ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 45015942-f0b4-4b68-80a7-c9af4274ff35, dataset_name: DatasetName { pool_name: ZpoolName { id: 06ee1c63-02b8-46d6-96ed-aa8ab7a8d522 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10252024-11-26T05:22:25.628ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 45015942-f0b4-4b68-80a7-c9af4274ff35, dataset_name: DatasetName { pool_name: ZpoolName { id: 06ee1c63-02b8-46d6-96ed-aa8ab7a8d522 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10262024-11-26T05:22:25.660ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 591416ad-4f91-4b1e-9e61-71515d759ba4, dataset_name: DatasetName { pool_name: ZpoolName { id: 4fe72516-6144-43ef-96ee-e7fbaeb34f42 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10272024-11-26T05:22:25.660ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 591416ad-4f91-4b1e-9e61-71515d759ba4, dataset_name: DatasetName { pool_name: ZpoolName { id: 4fe72516-6144-43ef-96ee-e7fbaeb34f42 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10282024-11-26T05:22:25.691ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 078ab58f-5ac4-4c10-8dfe-84a92fb7bb65, dataset_name: DatasetName { pool_name: ZpoolName { id: 580c5897-a97f-4c76-9a8f-bf80d62b760e (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10292024-11-26T05:22:25.691ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 078ab58f-5ac4-4c10-8dfe-84a92fb7bb65, dataset_name: DatasetName { pool_name: ZpoolName { id: 580c5897-a97f-4c76-9a8f-bf80d62b760e (zpool), kind: External }, kind: Cockroach }, responder: ... }
10302024-11-26T05:22:25.722ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10312024-11-26T05:22:25.722ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8488adc3-a35c-4d33-bd61-39dfc8c64c55/config/omicron-zones.json file = common/src/ledger.rs:177
10322024-11-26T05:22:25.722ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/e4c38366-5212-46e4-b3d0-f797c1f6a6ba/config/omicron-zones.json file = common/src/ledger.rs:177
10332024-11-26T05:22:25.723ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10342024-11-26T05:22:25.808ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10352024-11-26T05:22:25.808ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10362024-11-26T05:22:25.808ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10372024-11-26T05:22:25.808ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10382024-11-26T05:22:25.808ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10392024-11-26T05:22:25.903ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_afc5473a-4cc3-4263-8522-c328753d2c8d file = illumos-utils/src/zone.rs:325
10402024-11-26T05:22:25.908ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_97bef1ac-058e-4c8a-9591-6029bf7ab0ad file = illumos-utils/src/zone.rs:325
10412024-11-26T05:22:25.912ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_45015942-f0b4-4b68-80a7-c9af4274ff35 file = illumos-utils/src/zone.rs:325
10422024-11-26T05:22:25.917ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_591416ad-4f91-4b1e-9e61-71515d759ba4 file = illumos-utils/src/zone.rs:325
10432024-11-26T05:22:25.921ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_078ab58f-5ac4-4c10-8dfe-84a92fb7bb65 file = illumos-utils/src/zone.rs:325
10442024-11-26T05:22:25.926ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_afc5473a-4cc3-4263-8522-c328753d2c8d file = illumos-utils/src/zone.rs:363
10452024-11-26T05:22:25.930ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_97bef1ac-058e-4c8a-9591-6029bf7ab0ad file = illumos-utils/src/zone.rs:363
10462024-11-26T05:22:25.935ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_45015942-f0b4-4b68-80a7-c9af4274ff35 file = illumos-utils/src/zone.rs:363
10472024-11-26T05:22:25.940ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_591416ad-4f91-4b1e-9e61-71515d759ba4 file = illumos-utils/src/zone.rs:363
10482024-11-26T05:22:25.945ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_078ab58f-5ac4-4c10-8dfe-84a92fb7bb65 file = illumos-utils/src/zone.rs:363
10492024-11-26T05:22:28.794ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_078ab58f-5ac4-4c10-8dfe-84a92fb7bb65: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='078ab58f-5ac4-4c10-8dfe-84a92fb7bb65'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10502024-11-26T05:22:28.794ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_078ab58f-5ac4-4c10-8dfe-84a92fb7bb65 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_078ab58f-5ac4-4c10-8dfe-84a92fb7bb65
10512024-11-26T05:22:28.800ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_97bef1ac-058e-4c8a-9591-6029bf7ab0ad: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='97bef1ac-058e-4c8a-9591-6029bf7ab0ad'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10522024-11-26T05:22:28.800ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_45015942-f0b4-4b68-80a7-c9af4274ff35: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='45015942-f0b4-4b68-80a7-c9af4274ff35'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10532024-11-26T05:22:28.800ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_97bef1ac-058e-4c8a-9591-6029bf7ab0ad zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_97bef1ac-058e-4c8a-9591-6029bf7ab0ad
10542024-11-26T05:22:28.805ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_45015942-f0b4-4b68-80a7-c9af4274ff35 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_45015942-f0b4-4b68-80a7-c9af4274ff35
10552024-11-26T05:22:28.811ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_afc5473a-4cc3-4263-8522-c328753d2c8d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='afc5473a-4cc3-4263-8522-c328753d2c8d'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10562024-11-26T05:22:28.811ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_afc5473a-4cc3-4263-8522-c328753d2c8d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_afc5473a-4cc3-4263-8522-c328753d2c8d
10572024-11-26T05:22:28.816ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_591416ad-4f91-4b1e-9e61-71515d759ba4: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='591416ad-4f91-4b1e-9e61-71515d759ba4'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10582024-11-26T05:22:28.816ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_591416ad-4f91-4b1e-9e61-71515d759ba4 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_591416ad-4f91-4b1e-9e61-71515d759ba4
10592024-11-26T05:22:28.944ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_97bef1ac-058e-4c8a-9591-6029bf7ab0ad") failed: Property not found. retry in 44.113341ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_97bef1ac-058e-4c8a-9591-6029bf7ab0ad
10602024-11-26T05:22:28.952ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_afc5473a-4cc3-4263-8522-c328753d2c8d") failed: Property not found. retry in 66.34551ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_afc5473a-4cc3-4263-8522-c328753d2c8d
10612024-11-26T05:22:28.959ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_45015942-f0b4-4b68-80a7-c9af4274ff35") failed: Property not found. retry in 63.4611ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_45015942-f0b4-4b68-80a7-c9af4274ff35
10622024-11-26T05:22:28.967ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_078ab58f-5ac4-4c10-8dfe-84a92fb7bb65") failed: Property not found. retry in 67.476355ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_078ab58f-5ac4-4c10-8dfe-84a92fb7bb65
10632024-11-26T05:22:28.974ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_591416ad-4f91-4b1e-9e61-71515d759ba4") failed: Property not found. retry in 38.898772ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_591416ad-4f91-4b1e-9e61-71515d759ba4
10642024-11-26T05:22:28.995ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_97bef1ac-058e-4c8a-9591-6029bf7ab0ad") failed: Property not found. retry in 141.274033ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_97bef1ac-058e-4c8a-9591-6029bf7ab0ad
10652024-11-26T05:22:29.178ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_591416ad-4f91-4b1e-9e61-71515d759ba4") failed: Property not found. retry in 144.456556ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_591416ad-4f91-4b1e-9e61-71515d759ba4
10662024-11-26T05:22:29.629ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_afc5473a-4cc3-4263-8522-c328753d2c8d") failed: Property not found. retry in 79.210689ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_afc5473a-4cc3-4263-8522-c328753d2c8d
10672024-11-26T05:22:29.721ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_97bef1ac-058e-4c8a-9591-6029bf7ab0ad") failed: Property not found. retry in 228.220071ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_97bef1ac-058e-4c8a-9591-6029bf7ab0ad
10682024-11-26T05:22:29.760ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_45015942-f0b4-4b68-80a7-c9af4274ff35") failed: Property not found. retry in 92.336196ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_45015942-f0b4-4b68-80a7-c9af4274ff35
10692024-11-26T05:22:29.920ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_591416ad-4f91-4b1e-9e61-71515d759ba4") failed: Property not found. retry in 143.959608ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_591416ad-4f91-4b1e-9e61-71515d759ba4
10702024-11-26T05:22:29.950ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_078ab58f-5ac4-4c10-8dfe-84a92fb7bb65") failed: Property not found. retry in 65.960033ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_078ab58f-5ac4-4c10-8dfe-84a92fb7bb65
10712024-11-26T05:22:29.999ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_afc5473a-4cc3-4263-8522-c328753d2c8d") failed: Property not found. retry in 219.818405ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_afc5473a-4cc3-4263-8522-c328753d2c8d
10722024-11-26T05:22:30.250ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_97bef1ac-058e-4c8a-9591-6029bf7ab0ad") failed: Property not found. retry in 540.667169ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_97bef1ac-058e-4c8a-9591-6029bf7ab0ad
10732024-11-26T05:22:30.380ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_45015942-f0b4-4b68-80a7-c9af4274ff35") failed: Property not found. retry in 279.607043ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_45015942-f0b4-4b68-80a7-c9af4274ff35
10742024-11-26T05:22:30.574ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_591416ad-4f91-4b1e-9e61-71515d759ba4") failed: Property not found. retry in 273.61663ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_591416ad-4f91-4b1e-9e61-71515d759ba4
10752024-11-26T05:22:31.102ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_078ab58f-5ac4-4c10-8dfe-84a92fb7bb65") failed: Property not found. retry in 236.44262ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_078ab58f-5ac4-4c10-8dfe-84a92fb7bb65
10762024-11-26T05:22:31.162ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_afc5473a-4cc3-4263-8522-c328753d2c8d") failed: Property not found. retry in 516.011969ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_afc5473a-4cc3-4263-8522-c328753d2c8d
10772024-11-26T05:22:31.843ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_97bef1ac-058e-4c8a-9591-6029bf7ab0ad") failed: Property not found. retry in 439.396088ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_97bef1ac-058e-4c8a-9591-6029bf7ab0ad
10782024-11-26T05:22:31.882ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_45015942-f0b4-4b68-80a7-c9af4274ff35") failed: Property not found. retry in 454.420205ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_45015942-f0b4-4b68-80a7-c9af4274ff35
10792024-11-26T05:22:31.961ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_591416ad-4f91-4b1e-9e61-71515d759ba4") failed: Property not found. retry in 1.118051424s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_591416ad-4f91-4b1e-9e61-71515d759ba4
10802024-11-26T05:22:31.986ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_078ab58f-5ac4-4c10-8dfe-84a92fb7bb65") failed: Property not found. retry in 203.197713ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_078ab58f-5ac4-4c10-8dfe-84a92fb7bb65
10812024-11-26T05:22:32.007ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_afc5473a-4cc3-4263-8522-c328753d2c8d") failed: Property not found. retry in 1.18292371s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_afc5473a-4cc3-4263-8522-c328753d2c8d
10822024-11-26T05:22:32.199ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_078ab58f-5ac4-4c10-8dfe-84a92fb7bb65") failed: Property not found. retry in 431.893145ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_078ab58f-5ac4-4c10-8dfe-84a92fb7bb65
10832024-11-26T05:22:32.294ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_97bef1ac-058e-4c8a-9591-6029bf7ab0ad") failed: Property not found. retry in 897.591637ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_97bef1ac-058e-4c8a-9591-6029bf7ab0ad
10842024-11-26T05:22:32.348ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_45015942-f0b4-4b68-80a7-c9af4274ff35") failed: Property not found. retry in 1.174836262s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_45015942-f0b4-4b68-80a7-c9af4274ff35
10852024-11-26T05:22:32.644ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_078ab58f-5ac4-4c10-8dfe-84a92fb7bb65") failed: Property not found. retry in 864.50201ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_078ab58f-5ac4-4c10-8dfe-84a92fb7bb65
10862024-11-26T05:22:33.090ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_591416ad-4f91-4b1e-9e61-71515d759ba4") failed: Property not found. retry in 1.318519943s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_591416ad-4f91-4b1e-9e61-71515d759ba4
10872024-11-26T05:22:33.200ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_afc5473a-4cc3-4263-8522-c328753d2c8d") failed: Property not found. retry in 1.079283121s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_afc5473a-4cc3-4263-8522-c328753d2c8d
10882024-11-26T05:22:33.207ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_97bef1ac-058e-4c8a-9591-6029bf7ab0ad") failed: Property not found. retry in 1.006516671s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_97bef1ac-058e-4c8a-9591-6029bf7ab0ad
10892024-11-26T05:22:33.519ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_078ab58f-5ac4-4c10-8dfe-84a92fb7bb65") failed: Property not found. retry in 1.4424494s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_078ab58f-5ac4-4c10-8dfe-84a92fb7bb65
10902024-11-26T05:22:33.533ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_45015942-f0b4-4b68-80a7-c9af4274ff35") failed: Property not found. retry in 788.336102ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_45015942-f0b4-4b68-80a7-c9af4274ff35
10912024-11-26T05:22:34.225ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_97bef1ac-058e-4c8a-9591-6029bf7ab0ad") failed: Property not found. retry in 708.30976ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_97bef1ac-058e-4c8a-9591-6029bf7ab0ad
10922024-11-26T05:22:34.290ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_afc5473a-4cc3-4263-8522-c328753d2c8d") failed: Property not found. retry in 614.657216ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_afc5473a-4cc3-4263-8522-c328753d2c8d
10932024-11-26T05:22:34.330ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_45015942-f0b4-4b68-80a7-c9af4274ff35") failed: Property not found. retry in 505.346013ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_45015942-f0b4-4b68-80a7-c9af4274ff35
10942024-11-26T05:22:34.418ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_591416ad-4f91-4b1e-9e61-71515d759ba4") failed: Property not found. retry in 1.163425149s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_591416ad-4f91-4b1e-9e61-71515d759ba4
10952024-11-26T05:22:34.846ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_45015942-f0b4-4b68-80a7-c9af4274ff35") failed: Property not found. retry in 749.570948ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_45015942-f0b4-4b68-80a7-c9af4274ff35
10962024-11-26T05:22:34.914ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_afc5473a-4cc3-4263-8522-c328753d2c8d") failed: Property not found. retry in 878.460623ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_afc5473a-4cc3-4263-8522-c328753d2c8d
10972024-11-26T05:22:34.943ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_97bef1ac-058e-4c8a-9591-6029bf7ab0ad") failed: Property not found. retry in 711.436134ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_97bef1ac-058e-4c8a-9591-6029bf7ab0ad
10982024-11-26T05:22:34.971ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_078ab58f-5ac4-4c10-8dfe-84a92fb7bb65") failed: Property not found. retry in 530.170392ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_078ab58f-5ac4-4c10-8dfe-84a92fb7bb65
10992024-11-26T05:22:35.513ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_078ab58f-5ac4-4c10-8dfe-84a92fb7bb65") failed: Property not found. retry in 505.727504ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_078ab58f-5ac4-4c10-8dfe-84a92fb7bb65
11002024-11-26T05:22:35.595ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_591416ad-4f91-4b1e-9e61-71515d759ba4") failed: Property not found. retry in 1.405854023s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_591416ad-4f91-4b1e-9e61-71515d759ba4
11012024-11-26T05:22:35.608ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_45015942-f0b4-4b68-80a7-c9af4274ff35") failed: Property not found. retry in 1.005062334s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_45015942-f0b4-4b68-80a7-c9af4274ff35
11022024-11-26T05:22:35.673ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_97bef1ac-058e-4c8a-9591-6029bf7ab0ad") failed: Property not found. retry in 1.424981708s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_97bef1ac-058e-4c8a-9591-6029bf7ab0ad
11032024-11-26T05:22:35.805ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_afc5473a-4cc3-4263-8522-c328753d2c8d") failed: Property not found. retry in 585.290909ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_afc5473a-4cc3-4263-8522-c328753d2c8d
11042024-11-26T05:22:36.028ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_078ab58f-5ac4-4c10-8dfe-84a92fb7bb65") failed: Property not found. retry in 639.809345ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_078ab58f-5ac4-4c10-8dfe-84a92fb7bb65
11052024-11-26T05:22:36.400ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_afc5473a-4cc3-4263-8522-c328753d2c8d") failed: Property not found. retry in 1.052729428s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_afc5473a-4cc3-4263-8522-c328753d2c8d
11062024-11-26T05:22:36.622ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_45015942-f0b4-4b68-80a7-c9af4274ff35") failed: Property not found. retry in 1.252957854s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_45015942-f0b4-4b68-80a7-c9af4274ff35
11072024-11-26T05:22:36.676ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_078ab58f-5ac4-4c10-8dfe-84a92fb7bb65") failed: Property not found. retry in 1.434474991s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_078ab58f-5ac4-4c10-8dfe-84a92fb7bb65
11082024-11-26T05:22:37.011ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_591416ad-4f91-4b1e-9e61-71515d759ba4") failed: Property not found. retry in 523.487371ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_591416ad-4f91-4b1e-9e61-71515d759ba4
11092024-11-26T05:22:37.106ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_97bef1ac-058e-4c8a-9591-6029bf7ab0ad") failed: Property not found. retry in 829.96756ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_97bef1ac-058e-4c8a-9591-6029bf7ab0ad
11102024-11-26T05:22:37.461ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_afc5473a-4cc3-4263-8522-c328753d2c8d") failed: Property not found. retry in 806.707967ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_afc5473a-4cc3-4263-8522-c328753d2c8d
11112024-11-26T05:22:37.543ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_591416ad-4f91-4b1e-9e61-71515d759ba4") failed: Property not found. retry in 1.112689051s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_591416ad-4f91-4b1e-9e61-71515d759ba4
11122024-11-26T05:22:37.885ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_45015942-f0b4-4b68-80a7-c9af4274ff35") failed: Property not found. retry in 632.153475ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_45015942-f0b4-4b68-80a7-c9af4274ff35
11132024-11-26T05:22:37.945ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_97bef1ac-058e-4c8a-9591-6029bf7ab0ad") failed: Property not found. retry in 1.081674305s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_97bef1ac-058e-4c8a-9591-6029bf7ab0ad
11142024-11-26T05:22:38.120ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_078ab58f-5ac4-4c10-8dfe-84a92fb7bb65") failed: Property not found. retry in 1.186475037s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_078ab58f-5ac4-4c10-8dfe-84a92fb7bb65
11152024-11-26T05:22:38.279ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_afc5473a-4cc3-4263-8522-c328753d2c8d") failed: Property not found. retry in 1.145238269s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_afc5473a-4cc3-4263-8522-c328753d2c8d
11162024-11-26T05:22:38.527ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_45015942-f0b4-4b68-80a7-c9af4274ff35") failed: Property not found. retry in 1.07770468s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_45015942-f0b4-4b68-80a7-c9af4274ff35
11172024-11-26T05:22:38.667ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_591416ad-4f91-4b1e-9e61-71515d759ba4") failed: Property not found. retry in 1.186798899s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_591416ad-4f91-4b1e-9e61-71515d759ba4
11182024-11-26T05:22:39.036ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_97bef1ac-058e-4c8a-9591-6029bf7ab0ad") failed: Property not found. retry in 1.197503591s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_97bef1ac-058e-4c8a-9591-6029bf7ab0ad
11192024-11-26T05:22:39.622ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_45015942-f0b4-4b68-80a7-c9af4274ff35") failed: Property not found. retry in 764.040718ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_45015942-f0b4-4b68-80a7-c9af4274ff35
11202024-11-26T05:22:39.864ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_591416ad-4f91-4b1e-9e61-71515d759ba4") failed: Property not found. retry in 1.205171103s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_591416ad-4f91-4b1e-9e61-71515d759ba4
11212024-11-26T05:22:40.244ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_97bef1ac-058e-4c8a-9591-6029bf7ab0ad") failed: Property not found. retry in 580.929217ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_97bef1ac-058e-4c8a-9591-6029bf7ab0ad
11222024-11-26T05:22:40.396ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_45015942-f0b4-4b68-80a7-c9af4274ff35") failed: Property not found. retry in 1.137974715s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_45015942-f0b4-4b68-80a7-c9af4274ff35
11232024-11-26T05:22:40.839ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_97bef1ac-058e-4c8a-9591-6029bf7ab0ad") failed: Property not found. retry in 890.209162ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_97bef1ac-058e-4c8a-9591-6029bf7ab0ad
11242024-11-26T05:22:41.084ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_591416ad-4f91-4b1e-9e61-71515d759ba4") failed: Property not found. retry in 999.295276ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_591416ad-4f91-4b1e-9e61-71515d759ba4
11252024-11-26T05:22:41.545ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_45015942-f0b4-4b68-80a7-c9af4274ff35") failed: Property not found. retry in 573.594722ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_45015942-f0b4-4b68-80a7-c9af4274ff35
11262024-11-26T05:22:41.741ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_97bef1ac-058e-4c8a-9591-6029bf7ab0ad") failed: Property not found. retry in 801.000582ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_97bef1ac-058e-4c8a-9591-6029bf7ab0ad
11272024-11-26T05:22:42.095ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_591416ad-4f91-4b1e-9e61-71515d759ba4") failed: Property not found. retry in 1.372271684s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_591416ad-4f91-4b1e-9e61-71515d759ba4
11282024-11-26T05:22:42.129ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_45015942-f0b4-4b68-80a7-c9af4274ff35") failed: Property not found. retry in 1.410524352s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_45015942-f0b4-4b68-80a7-c9af4274ff35
11292024-11-26T05:22:42.225ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:35722
11302024-11-26T05:22:42.225ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:35722 req_id = e4804ab4-a602-4162-bff5-e11c59669a3f response_code = 200 uri = /baseboard
11312024-11-26T05:22:42.553ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_97bef1ac-058e-4c8a-9591-6029bf7ab0ad") failed: Property not found. retry in 1.258415648s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_97bef1ac-058e-4c8a-9591-6029bf7ab0ad
11322024-11-26T05:22:43.478ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_591416ad-4f91-4b1e-9e61-71515d759ba4") failed: Property not found. retry in 1.334334159s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_591416ad-4f91-4b1e-9e61-71515d759ba4
11332024-11-26T05:22:43.548ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_45015942-f0b4-4b68-80a7-c9af4274ff35") failed: Property not found. retry in 1.383377601s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_45015942-f0b4-4b68-80a7-c9af4274ff35
11342024-11-26T05:22:43.820ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_97bef1ac-058e-4c8a-9591-6029bf7ab0ad") failed: Property not found. retry in 791.28562ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_97bef1ac-058e-4c8a-9591-6029bf7ab0ad
11352024-11-26T05:22:44.620ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_97bef1ac-058e-4c8a-9591-6029bf7ab0ad") failed: Property not found. retry in 1.245875878s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_97bef1ac-058e-4c8a-9591-6029bf7ab0ad
11362024-11-26T05:22:44.820ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_591416ad-4f91-4b1e-9e61-71515d759ba4") failed: Property not found. retry in 726.889635ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_591416ad-4f91-4b1e-9e61-71515d759ba4
11372024-11-26T05:22:44.940ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_45015942-f0b4-4b68-80a7-c9af4274ff35") failed: Property not found. retry in 1.288008289s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_45015942-f0b4-4b68-80a7-c9af4274ff35
11382024-11-26T05:22:45.557ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_591416ad-4f91-4b1e-9e61-71515d759ba4") failed: Property not found. retry in 523.712631ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_591416ad-4f91-4b1e-9e61-71515d759ba4
11392024-11-26T05:22:45.875ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_97bef1ac-058e-4c8a-9591-6029bf7ab0ad") failed: Property not found. retry in 1.200605391s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_97bef1ac-058e-4c8a-9591-6029bf7ab0ad
11402024-11-26T05:22:46.090ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_591416ad-4f91-4b1e-9e61-71515d759ba4") failed: Property not found. retry in 780.035272ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_591416ad-4f91-4b1e-9e61-71515d759ba4
11412024-11-26T05:22:46.237ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_45015942-f0b4-4b68-80a7-c9af4274ff35") failed: Property not found. retry in 795.913644ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_45015942-f0b4-4b68-80a7-c9af4274ff35
11422024-11-26T05:22:46.878ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_591416ad-4f91-4b1e-9e61-71515d759ba4") failed: Property not found. retry in 1.245053529s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_591416ad-4f91-4b1e-9e61-71515d759ba4
11432024-11-26T05:22:47.042ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_45015942-f0b4-4b68-80a7-c9af4274ff35") failed: Property not found. retry in 1.399945734s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_45015942-f0b4-4b68-80a7-c9af4274ff35
11442024-11-26T05:22:47.084ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_97bef1ac-058e-4c8a-9591-6029bf7ab0ad") failed: Property not found. retry in 1.131184396s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_97bef1ac-058e-4c8a-9591-6029bf7ab0ad
11452024-11-26T05:22:48.132ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_591416ad-4f91-4b1e-9e61-71515d759ba4") failed: Property not found. retry in 1.412171381s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_591416ad-4f91-4b1e-9e61-71515d759ba4
11462024-11-26T05:22:48.224ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_97bef1ac-058e-4c8a-9591-6029bf7ab0ad") failed: Property not found. retry in 807.051594ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_97bef1ac-058e-4c8a-9591-6029bf7ab0ad
11472024-11-26T05:22:48.450ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_45015942-f0b4-4b68-80a7-c9af4274ff35") failed: Property not found. retry in 855.823769ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_45015942-f0b4-4b68-80a7-c9af4274ff35
11482024-11-26T05:22:49.570ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3311 zone = oxz_cockroachdb_afc5473a-4cc3-4263-8522-c328753d2c8d
11492024-11-26T05:22:49.570ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3311 zone = oxz_cockroachdb_97bef1ac-058e-4c8a-9591-6029bf7ab0ad
11502024-11-26T05:22:49.570ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3311 zone = oxz_cockroachdb_45015942-f0b4-4b68-80a7-c9af4274ff35
11512024-11-26T05:22:49.570ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3311 zone = oxz_cockroachdb_591416ad-4f91-4b1e-9e61-71515d759ba4
11522024-11-26T05:22:49.570ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3311 zone = oxz_cockroachdb_078ab58f-5ac4-4c10-8dfe-84a92fb7bb65
11532024-11-26T05:22:49.570ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/8488adc3-a35c-4d33-bd61-39dfc8c64c55/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
11542024-11-26T05:22:49.570ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/e4c38366-5212-46e4-b3d0-f797c1f6a6ba/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
11552024-11-26T05:22:49.571ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 24121698 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:64135 req_id = 24491210-ee1e-49e6-b48a-0c5438926fa5 response_code = 204 uri = /omicron-zones
11562024-11-26T05:22:49.610ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44668
11572024-11-26T05:22:49.641ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::7]:32221 file = sled-agent/src/services.rs:3744
11582024-11-26T05:22:49.817ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3762
11592024-11-26T05:23:11.022ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3785
11602024-11-26T05:23:11.024ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 21413921 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:44668 req_id = 1d3fb7fc-cbfa-49b1-8190-9a29b9473a87 response_code = 204 uri = /cockroachdb
11612024-11-26T05:23:11.044ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 25.343138571s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
11622024-11-26T05:23:11.090ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: edbba3c6-f82f-4429-a7c3-f55287468ddf (service), filesystem_pool: Some(ZpoolName { id: 1b72df9a-7b76-458e-9ee3-3ca99732ea65 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1b72df9a-7b76-458e-9ee3-3ca99732ea65 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 3e7aa779-fd66-467c-8445-e284949ae776 (service), filesystem_pool: Some(ZpoolName { id: 13de655b-3793-4d59-8bc1-22889b3fb01b (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 13de655b-3793-4d59-8bc1-22889b3fb01b (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: b663146f-27f0-4d91-99d9-9d880c25a555 (service), filesystem_pool: Some(ZpoolName { id: 06ee1c63-02b8-46d6-96ed-aa8ab7a8d522 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 06ee1c63-02b8-46d6-96ed-aa8ab7a8d522 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 183f242b-420b-49ab-a81f-72ef238fcd26 (service), filesystem_pool: Some(ZpoolName { id: 9bc99efb-91b7-405a-b8dd-0949d11c1f4a (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: eddacb61-71fc-40d4-ab86-c9b0732efc3e, kind: Service { id: 183f242b-420b-49ab-a81f-72ef238fcd26 }, name: Name("ntp-183f242b-420b-49ab-a81f-72ef238fcd26"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 177, 162])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: afc5473a-4cc3-4263-8522-c328753d2c8d (service), filesystem_pool: Some(ZpoolName { id: 1b72df9a-7b76-458e-9ee3-3ca99732ea65 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1b72df9a-7b76-458e-9ee3-3ca99732ea65 (zpool), kind: External } } } }, OmicronZoneConfig { id: 97bef1ac-058e-4c8a-9591-6029bf7ab0ad (service), filesystem_pool: Some(ZpoolName { id: 13de655b-3793-4d59-8bc1-22889b3fb01b (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 13de655b-3793-4d59-8bc1-22889b3fb01b (zpool), kind: External } } } }, OmicronZoneConfig { id: 45015942-f0b4-4b68-80a7-c9af4274ff35 (service), filesystem_pool: Some(ZpoolName { id: 06ee1c63-02b8-46d6-96ed-aa8ab7a8d522 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 06ee1c63-02b8-46d6-96ed-aa8ab7a8d522 (zpool), kind: External } } } }, OmicronZoneConfig { id: 591416ad-4f91-4b1e-9e61-71515d759ba4 (service), filesystem_pool: Some(ZpoolName { id: 4fe72516-6144-43ef-96ee-e7fbaeb34f42 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 4fe72516-6144-43ef-96ee-e7fbaeb34f42 (zpool), kind: External } } } }, OmicronZoneConfig { id: 078ab58f-5ac4-4c10-8dfe-84a92fb7bb65 (service), filesystem_pool: Some(ZpoolName { id: 580c5897-a97f-4c76-9a8f-bf80d62b760e (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 580c5897-a97f-4c76-9a8f-bf80d62b760e (zpool), kind: External } } } }, OmicronZoneConfig { id: 7de56ef8-bdda-46b0-a9a9-fa5e97a778c5 (service), filesystem_pool: Some(ZpoolName { id: 1b72df9a-7b76-458e-9ee3-3ca99732ea65 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1b72df9a-7b76-458e-9ee3-3ca99732ea65 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.2.164:53, nic: NetworkInterface { id: 2f3ae2da-b0e7-4755-a7ae-d54ffe51eccc, kind: Service { id: 7de56ef8-bdda-46b0-a9a9-fa5e97a778c5 }, name: Name("external-dns-7de56ef8-bdda-46b0-a9a9-fa5e97a778c5"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 146])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 4e9fd39d-4113-4491-beca-e49e9a07f310 (service), filesystem_pool: Some(ZpoolName { id: 13de655b-3793-4d59-8bc1-22889b3fb01b (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 13de655b-3793-4d59-8bc1-22889b3fb01b (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.2.165:53, nic: NetworkInterface { id: 1dbf9b5b-ede3-4cf4-b0d0-091aa188969a, kind: Service { id: 4e9fd39d-4113-4491-beca-e49e9a07f310 }, name: Name("external-dns-4e9fd39d-4113-4491-beca-e49e9a07f310"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 201, 3])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: ccf769ca-e6aa-41c6-80d6-7f1cfa2a624a (service), filesystem_pool: Some(ZpoolName { id: 06ee1c63-02b8-46d6-96ed-aa8ab7a8d522 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.2.166, nic: NetworkInterface { id: e7b24131-9921-4152-b1bb-f948db445563, kind: Service { id: ccf769ca-e6aa-41c6-80d6-7f1cfa2a624a }, name: Name("nexus-ccf769ca-e6aa-41c6-80d6-7f1cfa2a624a"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 212, 242])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: de715031-fa5a-4cf9-bf82-9cec9db59d81 (service), filesystem_pool: Some(ZpoolName { id: 4fe72516-6144-43ef-96ee-e7fbaeb34f42 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.2.167, nic: NetworkInterface { id: afc30658-25b2-44db-9d11-ba075ebc447b, kind: Service { id: de715031-fa5a-4cf9-bf82-9cec9db59d81 }, name: Name("nexus-de715031-fa5a-4cf9-bf82-9cec9db59d81"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 180, 14])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: eea1c48b-e597-47f2-a9c9-8bf328dab7cd (service), filesystem_pool: Some(ZpoolName { id: af39775d-5158-4242-88aa-5dd2d3c14817 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.2.168, nic: NetworkInterface { id: f88dd6c2-772e-44fb-bf3f-d4557d3228a8, kind: Service { id: eea1c48b-e597-47f2-a9c9-8bf328dab7cd }, name: Name("nexus-eea1c48b-e597-47f2-a9c9-8bf328dab7cd"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 159, 25])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: a4232f21-0674-457e-97a4-41c6f360d0c1 (service), filesystem_pool: Some(ZpoolName { id: 13de655b-3793-4d59-8bc1-22889b3fb01b (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: c80384a9-167d-483b-9108-3eccbfc759ce (service), filesystem_pool: Some(ZpoolName { id: 1b72df9a-7b76-458e-9ee3-3ca99732ea65 (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1b72df9a-7b76-458e-9ee3-3ca99732ea65 (zpool), kind: External } } } }, OmicronZoneConfig { id: bbffc850-2c64-4359-b922-de172ab3a4a1 (service), filesystem_pool: Some(ZpoolName { id: 06ee1c63-02b8-46d6-96ed-aa8ab7a8d522 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: 7ea0f6a9-f6ea-4a00-8862-957ae8407d39 (service), filesystem_pool: Some(ZpoolName { id: 580c5897-a97f-4c76-9a8f-bf80d62b760e (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: b0f7327e-9818-4b74-82bf-6f6bf3231db9 (service), filesystem_pool: Some(ZpoolName { id: 62fc8f20-7ce8-489b-a022-013df6640479 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: 6f93cace-fd0a-439d-b070-fb3e7a93d785 (service), filesystem_pool: Some(ZpoolName { id: 1b72df9a-7b76-458e-9ee3-3ca99732ea65 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1b72df9a-7b76-458e-9ee3-3ca99732ea65 (zpool), kind: External } } } }, OmicronZoneConfig { id: 8b990e0a-1c33-413f-8695-830485958f9e (service), filesystem_pool: Some(ZpoolName { id: 13de655b-3793-4d59-8bc1-22889b3fb01b (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 13de655b-3793-4d59-8bc1-22889b3fb01b (zpool), kind: External } } } }, OmicronZoneConfig { id: e0bf1273-c01d-45a7-81e1-d34f6eb6d99b (service), filesystem_pool: Some(ZpoolName { id: 06ee1c63-02b8-46d6-96ed-aa8ab7a8d522 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 06ee1c63-02b8-46d6-96ed-aa8ab7a8d522 (zpool), kind: External } } } }, OmicronZoneConfig { id: fd8c0b95-28ad-4b2a-97d9-6778a8a37605 (service), filesystem_pool: Some(ZpoolName { id: 4fe72516-6144-43ef-96ee-e7fbaeb34f42 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 4fe72516-6144-43ef-96ee-e7fbaeb34f42 (zpool), kind: External } } } }, OmicronZoneConfig { id: 0cbd328d-2b71-482b-8212-63117b07c620 (service), filesystem_pool: Some(ZpoolName { id: 580c5897-a97f-4c76-9a8f-bf80d62b760e (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 580c5897-a97f-4c76-9a8f-bf80d62b760e (zpool), kind: External } } } }, OmicronZoneConfig { id: 506e6a7b-f08a-43e3-ae23-7818916b2247 (service), filesystem_pool: Some(ZpoolName { id: 62fc8f20-7ce8-489b-a022-013df6640479 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 62fc8f20-7ce8-489b-a022-013df6640479 (zpool), kind: External } } } }, OmicronZoneConfig { id: 90a408e9-936a-4920-ae45-8ca2dc33ed86 (service), filesystem_pool: Some(ZpoolName { id: af39775d-5158-4242-88aa-5dd2d3c14817 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: af39775d-5158-4242-88aa-5dd2d3c14817 (zpool), kind: External } } } }, OmicronZoneConfig { id: be1e42ff-fa98-49f3-a5ff-e865a51b0418 (service), filesystem_pool: Some(ZpoolName { id: 9bc99efb-91b7-405a-b8dd-0949d11c1f4a (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9bc99efb-91b7-405a-b8dd-0949d11c1f4a (zpool), kind: External } } } }, OmicronZoneConfig { id: 50516551-aadd-4094-86ba-7d3c3018bfd8 (service), filesystem_pool: Some(ZpoolName { id: da133136-28dd-4eff-a3ed-9f84ec495a60 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: da133136-28dd-4eff-a3ed-9f84ec495a60 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:538 sled_address = [fd00:1122:3344:101::1]:12345
11632024-11-26T05:23:11.091ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33774
11642024-11-26T05:23:11.092ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: edbba3c6-f82f-4429-a7c3-f55287468ddf, dataset_name: DatasetName { pool_name: ZpoolName { id: 1b72df9a-7b76-458e-9ee3-3ca99732ea65 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
11652024-11-26T05:23:11.092ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: edbba3c6-f82f-4429-a7c3-f55287468ddf, dataset_name: DatasetName { pool_name: ZpoolName { id: 1b72df9a-7b76-458e-9ee3-3ca99732ea65 (zpool), kind: External }, kind: InternalDns }, responder: ... }
11662024-11-26T05:23:11.177ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 3e7aa779-fd66-467c-8445-e284949ae776, dataset_name: DatasetName { pool_name: ZpoolName { id: 13de655b-3793-4d59-8bc1-22889b3fb01b (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
11672024-11-26T05:23:11.177ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 3e7aa779-fd66-467c-8445-e284949ae776, dataset_name: DatasetName { pool_name: ZpoolName { id: 13de655b-3793-4d59-8bc1-22889b3fb01b (zpool), kind: External }, kind: InternalDns }, responder: ... }
11682024-11-26T05:23:11.253ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: b663146f-27f0-4d91-99d9-9d880c25a555, dataset_name: DatasetName { pool_name: ZpoolName { id: 06ee1c63-02b8-46d6-96ed-aa8ab7a8d522 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
11692024-11-26T05:23:11.253ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: b663146f-27f0-4d91-99d9-9d880c25a555, dataset_name: DatasetName { pool_name: ZpoolName { id: 06ee1c63-02b8-46d6-96ed-aa8ab7a8d522 (zpool), kind: External }, kind: InternalDns }, responder: ... }
11702024-11-26T05:23:11.313ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: afc5473a-4cc3-4263-8522-c328753d2c8d, dataset_name: DatasetName { pool_name: ZpoolName { id: 1b72df9a-7b76-458e-9ee3-3ca99732ea65 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
11712024-11-26T05:23:11.313ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: afc5473a-4cc3-4263-8522-c328753d2c8d, dataset_name: DatasetName { pool_name: ZpoolName { id: 1b72df9a-7b76-458e-9ee3-3ca99732ea65 (zpool), kind: External }, kind: Cockroach }, responder: ... }
11722024-11-26T05:23:11.386ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 97bef1ac-058e-4c8a-9591-6029bf7ab0ad, dataset_name: DatasetName { pool_name: ZpoolName { id: 13de655b-3793-4d59-8bc1-22889b3fb01b (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
11732024-11-26T05:23:11.386ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 97bef1ac-058e-4c8a-9591-6029bf7ab0ad, dataset_name: DatasetName { pool_name: ZpoolName { id: 13de655b-3793-4d59-8bc1-22889b3fb01b (zpool), kind: External }, kind: Cockroach }, responder: ... }
11742024-11-26T05:23:11.439ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 45015942-f0b4-4b68-80a7-c9af4274ff35, dataset_name: DatasetName { pool_name: ZpoolName { id: 06ee1c63-02b8-46d6-96ed-aa8ab7a8d522 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
11752024-11-26T05:23:11.439ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 45015942-f0b4-4b68-80a7-c9af4274ff35, dataset_name: DatasetName { pool_name: ZpoolName { id: 06ee1c63-02b8-46d6-96ed-aa8ab7a8d522 (zpool), kind: External }, kind: Cockroach }, responder: ... }
11762024-11-26T05:23:11.502ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 591416ad-4f91-4b1e-9e61-71515d759ba4, dataset_name: DatasetName { pool_name: ZpoolName { id: 4fe72516-6144-43ef-96ee-e7fbaeb34f42 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
11772024-11-26T05:23:11.502ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 591416ad-4f91-4b1e-9e61-71515d759ba4, dataset_name: DatasetName { pool_name: ZpoolName { id: 4fe72516-6144-43ef-96ee-e7fbaeb34f42 (zpool), kind: External }, kind: Cockroach }, responder: ... }
11782024-11-26T05:23:11.600ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 078ab58f-5ac4-4c10-8dfe-84a92fb7bb65, dataset_name: DatasetName { pool_name: ZpoolName { id: 580c5897-a97f-4c76-9a8f-bf80d62b760e (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
11792024-11-26T05:23:11.600ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 078ab58f-5ac4-4c10-8dfe-84a92fb7bb65, dataset_name: DatasetName { pool_name: ZpoolName { id: 580c5897-a97f-4c76-9a8f-bf80d62b760e (zpool), kind: External }, kind: Cockroach }, responder: ... }
11802024-11-26T05:23:11.684ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 7de56ef8-bdda-46b0-a9a9-fa5e97a778c5, dataset_name: DatasetName { pool_name: ZpoolName { id: 1b72df9a-7b76-458e-9ee3-3ca99732ea65 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
11812024-11-26T05:23:11.684ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 7de56ef8-bdda-46b0-a9a9-fa5e97a778c5, dataset_name: DatasetName { pool_name: ZpoolName { id: 1b72df9a-7b76-458e-9ee3-3ca99732ea65 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
11822024-11-26T05:23:11.783ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 4e9fd39d-4113-4491-beca-e49e9a07f310, dataset_name: DatasetName { pool_name: ZpoolName { id: 13de655b-3793-4d59-8bc1-22889b3fb01b (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
11832024-11-26T05:23:11.783ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 4e9fd39d-4113-4491-beca-e49e9a07f310, dataset_name: DatasetName { pool_name: ZpoolName { id: 13de655b-3793-4d59-8bc1-22889b3fb01b (zpool), kind: External }, kind: ExternalDns }, responder: ... }
11842024-11-26T05:23:11.841ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: c80384a9-167d-483b-9108-3eccbfc759ce, dataset_name: DatasetName { pool_name: ZpoolName { id: 1b72df9a-7b76-458e-9ee3-3ca99732ea65 (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:603
11852024-11-26T05:23:11.841ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: c80384a9-167d-483b-9108-3eccbfc759ce, dataset_name: DatasetName { pool_name: ZpoolName { id: 1b72df9a-7b76-458e-9ee3-3ca99732ea65 (zpool), kind: External }, kind: Clickhouse }, responder: ... }
11862024-11-26T05:23:11.900ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 6f93cace-fd0a-439d-b070-fb3e7a93d785, dataset_name: DatasetName { pool_name: ZpoolName { id: 1b72df9a-7b76-458e-9ee3-3ca99732ea65 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
11872024-11-26T05:23:11.901ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 6f93cace-fd0a-439d-b070-fb3e7a93d785, dataset_name: DatasetName { pool_name: ZpoolName { id: 1b72df9a-7b76-458e-9ee3-3ca99732ea65 (zpool), kind: External }, kind: Crucible }, responder: ... }
11882024-11-26T05:23:11.972ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 8b990e0a-1c33-413f-8695-830485958f9e, dataset_name: DatasetName { pool_name: ZpoolName { id: 13de655b-3793-4d59-8bc1-22889b3fb01b (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
11892024-11-26T05:23:11.972ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 8b990e0a-1c33-413f-8695-830485958f9e, dataset_name: DatasetName { pool_name: ZpoolName { id: 13de655b-3793-4d59-8bc1-22889b3fb01b (zpool), kind: External }, kind: Crucible }, responder: ... }
11902024-11-26T05:23:12.061ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: e0bf1273-c01d-45a7-81e1-d34f6eb6d99b, dataset_name: DatasetName { pool_name: ZpoolName { id: 06ee1c63-02b8-46d6-96ed-aa8ab7a8d522 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
11912024-11-26T05:23:12.061ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: e0bf1273-c01d-45a7-81e1-d34f6eb6d99b, dataset_name: DatasetName { pool_name: ZpoolName { id: 06ee1c63-02b8-46d6-96ed-aa8ab7a8d522 (zpool), kind: External }, kind: Crucible }, responder: ... }
11922024-11-26T05:23:12.167ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: fd8c0b95-28ad-4b2a-97d9-6778a8a37605, dataset_name: DatasetName { pool_name: ZpoolName { id: 4fe72516-6144-43ef-96ee-e7fbaeb34f42 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
11932024-11-26T05:23:12.167ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: fd8c0b95-28ad-4b2a-97d9-6778a8a37605, dataset_name: DatasetName { pool_name: ZpoolName { id: 4fe72516-6144-43ef-96ee-e7fbaeb34f42 (zpool), kind: External }, kind: Crucible }, responder: ... }
11942024-11-26T05:23:12.238ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 0cbd328d-2b71-482b-8212-63117b07c620, dataset_name: DatasetName { pool_name: ZpoolName { id: 580c5897-a97f-4c76-9a8f-bf80d62b760e (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
11952024-11-26T05:23:12.238ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 0cbd328d-2b71-482b-8212-63117b07c620, dataset_name: DatasetName { pool_name: ZpoolName { id: 580c5897-a97f-4c76-9a8f-bf80d62b760e (zpool), kind: External }, kind: Crucible }, responder: ... }
11962024-11-26T05:23:12.270ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:38947
11972024-11-26T05:23:12.272ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 419 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:38947 req_id = 1c0786ca-17f3-48d8-b140-d840b3db3ab0 response_code = 200 uri = /baseboard
11982024-11-26T05:23:12.312ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 506e6a7b-f08a-43e3-ae23-7818916b2247, dataset_name: DatasetName { pool_name: ZpoolName { id: 62fc8f20-7ce8-489b-a022-013df6640479 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
11992024-11-26T05:23:12.312ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 506e6a7b-f08a-43e3-ae23-7818916b2247, dataset_name: DatasetName { pool_name: ZpoolName { id: 62fc8f20-7ce8-489b-a022-013df6640479 (zpool), kind: External }, kind: Crucible }, responder: ... }
12002024-11-26T05:23:12.424ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 90a408e9-936a-4920-ae45-8ca2dc33ed86, dataset_name: DatasetName { pool_name: ZpoolName { id: af39775d-5158-4242-88aa-5dd2d3c14817 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
12012024-11-26T05:23:12.424ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 90a408e9-936a-4920-ae45-8ca2dc33ed86, dataset_name: DatasetName { pool_name: ZpoolName { id: af39775d-5158-4242-88aa-5dd2d3c14817 (zpool), kind: External }, kind: Crucible }, responder: ... }
12022024-11-26T05:23:12.552ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: be1e42ff-fa98-49f3-a5ff-e865a51b0418, dataset_name: DatasetName { pool_name: ZpoolName { id: 9bc99efb-91b7-405a-b8dd-0949d11c1f4a (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
12032024-11-26T05:23:12.552ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: be1e42ff-fa98-49f3-a5ff-e865a51b0418, dataset_name: DatasetName { pool_name: ZpoolName { id: 9bc99efb-91b7-405a-b8dd-0949d11c1f4a (zpool), kind: External }, kind: Crucible }, responder: ... }
12042024-11-26T05:23:12.622ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 50516551-aadd-4094-86ba-7d3c3018bfd8, dataset_name: DatasetName { pool_name: ZpoolName { id: da133136-28dd-4eff-a3ed-9f84ec495a60 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
12052024-11-26T05:23:12.622ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 50516551-aadd-4094-86ba-7d3c3018bfd8, dataset_name: DatasetName { pool_name: ZpoolName { id: da133136-28dd-4eff-a3ed-9f84ec495a60 (zpool), kind: External }, kind: Crucible }, responder: ... }
12062024-11-26T05:23:12.727ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12072024-11-26T05:23:12.728ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8488adc3-a35c-4d33-bd61-39dfc8c64c55/config/omicron-zones.json file = common/src/ledger.rs:177
12082024-11-26T05:23:12.728ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/e4c38366-5212-46e4-b3d0-f797c1f6a6ba/config/omicron-zones.json file = common/src/ledger.rs:177
12092024-11-26T05:23:12.728ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12102024-11-26T05:23:12.886ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12112024-11-26T05:23:12.887ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12122024-11-26T05:23:12.887ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12132024-11-26T05:23:12.887ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12142024-11-26T05:23:12.935ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12152024-11-26T05:23:12.935ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12162024-11-26T05:23:12.935ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12172024-11-26T05:23:12.935ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12182024-11-26T05:23:12.935ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12192024-11-26T05:23:12.935ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12202024-11-26T05:23:13.120ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12212024-11-26T05:23:13.120ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12222024-11-26T05:23:13.169ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12232024-11-26T05:23:13.170ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12242024-11-26T05:23:13.170ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12252024-11-26T05:23:13.170ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12262024-11-26T05:23:13.170ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12272024-11-26T05:23:13.171ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12282024-11-26T05:23:13.172ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12292024-11-26T05:23:13.173ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_7ea0f6a9-f6ea-4a00-8862-957ae8407d39 file = illumos-utils/src/zone.rs:325
12302024-11-26T05:23:13.178ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_6f93cace-fd0a-439d-b070-fb3e7a93d785 file = illumos-utils/src/zone.rs:325
12312024-11-26T05:23:13.184ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_506e6a7b-f08a-43e3-ae23-7818916b2247 file = illumos-utils/src/zone.rs:325
12322024-11-26T05:23:13.191ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_bbffc850-2c64-4359-b922-de172ab3a4a1 file = illumos-utils/src/zone.rs:325
12332024-11-26T05:23:13.197ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_8b990e0a-1c33-413f-8695-830485958f9e file = illumos-utils/src/zone.rs:325
12342024-11-26T05:23:13.202ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_a4232f21-0674-457e-97a4-41c6f360d0c1 file = illumos-utils/src/zone.rs:325
12352024-11-26T05:23:13.207ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_e0bf1273-c01d-45a7-81e1-d34f6eb6d99b file = illumos-utils/src/zone.rs:325
12362024-11-26T05:23:13.211ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_0cbd328d-2b71-482b-8212-63117b07c620 file = illumos-utils/src/zone.rs:325
12372024-11-26T05:23:13.216ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_be1e42ff-fa98-49f3-a5ff-e865a51b0418 file = illumos-utils/src/zone.rs:325
12382024-11-26T05:23:13.317ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_7ea0f6a9-f6ea-4a00-8862-957ae8407d39 file = illumos-utils/src/zone.rs:363
12392024-11-26T05:23:13.322ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_6f93cace-fd0a-439d-b070-fb3e7a93d785 file = illumos-utils/src/zone.rs:363
12402024-11-26T05:23:13.327ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_506e6a7b-f08a-43e3-ae23-7818916b2247 file = illumos-utils/src/zone.rs:363
12412024-11-26T05:23:13.331ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_bbffc850-2c64-4359-b922-de172ab3a4a1 file = illumos-utils/src/zone.rs:363
12422024-11-26T05:23:13.336ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_8b990e0a-1c33-413f-8695-830485958f9e file = illumos-utils/src/zone.rs:363
12432024-11-26T05:23:13.341ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_a4232f21-0674-457e-97a4-41c6f360d0c1 file = illumos-utils/src/zone.rs:363
12442024-11-26T05:23:13.345ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_e0bf1273-c01d-45a7-81e1-d34f6eb6d99b file = illumos-utils/src/zone.rs:363
12452024-11-26T05:23:13.349ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_0cbd328d-2b71-482b-8212-63117b07c620 file = illumos-utils/src/zone.rs:363
12462024-11-26T05:23:13.354ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_be1e42ff-fa98-49f3-a5ff-e865a51b0418 file = illumos-utils/src/zone.rs:363
12472024-11-26T05:23:13.358ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_fd8c0b95-28ad-4b2a-97d9-6778a8a37605 file = illumos-utils/src/zone.rs:325
12482024-11-26T05:23:13.364ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_c80384a9-167d-483b-9108-3eccbfc759ce file = illumos-utils/src/zone.rs:325
12492024-11-26T05:23:13.369ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_90a408e9-936a-4920-ae45-8ca2dc33ed86 file = illumos-utils/src/zone.rs:325
12502024-11-26T05:23:13.374ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_b0f7327e-9818-4b74-82bf-6f6bf3231db9 file = illumos-utils/src/zone.rs:325
12512024-11-26T05:23:13.380ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_50516551-aadd-4094-86ba-7d3c3018bfd8 file = illumos-utils/src/zone.rs:325
12522024-11-26T05:23:13.444ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12532024-11-26T05:23:13.445ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_fd8c0b95-28ad-4b2a-97d9-6778a8a37605 file = illumos-utils/src/zone.rs:363
12542024-11-26T05:23:13.455ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_c80384a9-167d-483b-9108-3eccbfc759ce file = illumos-utils/src/zone.rs:363
12552024-11-26T05:23:13.470ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_90a408e9-936a-4920-ae45-8ca2dc33ed86 file = illumos-utils/src/zone.rs:363
12562024-11-26T05:23:13.482ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_b0f7327e-9818-4b74-82bf-6f6bf3231db9 file = illumos-utils/src/zone.rs:363
12572024-11-26T05:23:13.511ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_50516551-aadd-4094-86ba-7d3c3018bfd8 file = illumos-utils/src/zone.rs:363
12582024-11-26T05:23:13.594ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12592024-11-26T05:23:13.649ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12602024-11-26T05:23:13.708ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12612024-11-26T05:23:13.765ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12622024-11-26T05:23:13.767ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12632024-11-26T05:23:13.776ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12642024-11-26T05:23:13.838ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 201, 3]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
12652024-11-26T05:23:13.838ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = external_dns
12662024-11-26T05:23:13.842ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12672024-11-26T05:23:13.842ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12682024-11-26T05:23:13.898ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 255, 146]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
12692024-11-26T05:23:13.898ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = external_dns
12702024-11-26T05:23:13.900ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12712024-11-26T05:23:13.900ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12722024-11-26T05:23:13.954ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 212, 242]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
12732024-11-26T05:23:13.954ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
12742024-11-26T05:23:13.956ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12752024-11-26T05:23:13.956ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12762024-11-26T05:23:14.010ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 180, 14]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
12772024-11-26T05:23:14.010ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
12782024-11-26T05:23:14.012ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12792024-11-26T05:23:14.012ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12802024-11-26T05:23:14.067ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 159, 25]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
12812024-11-26T05:23:14.067ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
12822024-11-26T05:23:14.067ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:83
12832024-11-26T05:23:14.067ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:90
12842024-11-26T05:23:14.068ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:83
12852024-11-26T05:23:14.068ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:90
12862024-11-26T05:23:14.074ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:83
12872024-11-26T05:23:14.074ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:90
12882024-11-26T05:23:14.074ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:83
12892024-11-26T05:23:14.074ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:90
12902024-11-26T05:23:14.074ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:83
12912024-11-26T05:23:14.074ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:90
12922024-11-26T05:23:14.082ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:118
12932024-11-26T05:23:14.083ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:118
12942024-11-26T05:23:14.085ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:118
12952024-11-26T05:23:14.085ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12962024-11-26T05:23:14.085ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12972024-11-26T05:23:14.088ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:118
12982024-11-26T05:23:14.091ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:118
12992024-11-26T05:23:14.091ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
13002024-11-26T05:23:14.091ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
13012024-11-26T05:23:14.205ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
13022024-11-26T05:23:14.372ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_ccf769ca-e6aa-41c6-80d6-7f1cfa2a624a file = illumos-utils/src/zone.rs:325
13032024-11-26T05:23:14.384ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_de715031-fa5a-4cf9-bf82-9cec9db59d81 file = illumos-utils/src/zone.rs:325
13042024-11-26T05:23:14.400ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_4e9fd39d-4113-4491-beca-e49e9a07f310 file = illumos-utils/src/zone.rs:325
13052024-11-26T05:23:14.411ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_eea1c48b-e597-47f2-a9c9-8bf328dab7cd file = illumos-utils/src/zone.rs:325
13062024-11-26T05:23:14.423ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_7de56ef8-bdda-46b0-a9a9-fa5e97a778c5 file = illumos-utils/src/zone.rs:325
13072024-11-26T05:23:14.434ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_ccf769ca-e6aa-41c6-80d6-7f1cfa2a624a file = illumos-utils/src/zone.rs:363
13082024-11-26T05:23:14.447ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_de715031-fa5a-4cf9-bf82-9cec9db59d81 file = illumos-utils/src/zone.rs:363
13092024-11-26T05:23:14.457ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_4e9fd39d-4113-4491-beca-e49e9a07f310 file = illumos-utils/src/zone.rs:363
13102024-11-26T05:23:14.466ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_eea1c48b-e597-47f2-a9c9-8bf328dab7cd file = illumos-utils/src/zone.rs:363
13112024-11-26T05:23:14.474ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_7de56ef8-bdda-46b0-a9a9-fa5e97a778c5 file = illumos-utils/src/zone.rs:363
13122024-11-26T05:23:29.928ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_b0f7327e-9818-4b74-82bf-6f6bf3231db9: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13132024-11-26T05:23:29.934ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_7ea0f6a9-f6ea-4a00-8862-957ae8407d39: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13142024-11-26T05:23:29.934ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_b0f7327e-9818-4b74-82bf-6f6bf3231db9 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_b0f7327e-9818-4b74-82bf-6f6bf3231db9
13152024-11-26T05:23:29.954ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_7ea0f6a9-f6ea-4a00-8862-957ae8407d39 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_7ea0f6a9-f6ea-4a00-8862-957ae8407d39
13162024-11-26T05:23:30.271ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_50516551-aadd-4094-86ba-7d3c3018bfd8: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_da133136-28dd-4eff-a3ed-9f84ec495a60/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='3ae24476-7f62-4118-adc0-bdd19f556870'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13172024-11-26T05:23:30.271ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_506e6a7b-f08a-43e3-ae23-7818916b2247: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_62fc8f20-7ce8-489b-a022-013df6640479/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='a6751057-963a-4f99-998d-d10dd13642fc'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13182024-11-26T05:23:30.272ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_0cbd328d-2b71-482b-8212-63117b07c620: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_580c5897-a97f-4c76-9a8f-bf80d62b760e/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='48916013-7cac-444b-8a09-205acee5069e'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13192024-11-26T05:23:30.272ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_be1e42ff-fa98-49f3-a5ff-e865a51b0418: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_9bc99efb-91b7-405a-b8dd-0949d11c1f4a/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='9bc5b305-7c82-4b92-9c90-79f1e79afdc3'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13202024-11-26T05:23:30.272ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_fd8c0b95-28ad-4b2a-97d9-6778a8a37605: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_4fe72516-6144-43ef-96ee-e7fbaeb34f42/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='f96d7af1-b90c-4151-9d4e-03b6719ee486'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13212024-11-26T05:23:30.272ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_90a408e9-936a-4920-ae45-8ca2dc33ed86: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_af39775d-5158-4242-88aa-5dd2d3c14817/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='b4b974d1-5099-4f0a-a436-43c9308dcc0f'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13222024-11-26T05:23:30.272ZINFOSledAgent (ServiceManager): Booting oxz_crucible_50516551-aadd-4094-86ba-7d3c3018bfd8 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_50516551-aadd-4094-86ba-7d3c3018bfd8
13232024-11-26T05:23:30.280ZINFOSledAgent (ServiceManager): Booting oxz_crucible_506e6a7b-f08a-43e3-ae23-7818916b2247 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_506e6a7b-f08a-43e3-ae23-7818916b2247
13242024-11-26T05:23:30.288ZINFOSledAgent (ServiceManager): Booting oxz_crucible_0cbd328d-2b71-482b-8212-63117b07c620 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_0cbd328d-2b71-482b-8212-63117b07c620
13252024-11-26T05:23:30.294ZINFOSledAgent (ServiceManager): Booting oxz_crucible_be1e42ff-fa98-49f3-a5ff-e865a51b0418 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_be1e42ff-fa98-49f3-a5ff-e865a51b0418
13262024-11-26T05:23:30.300ZINFOSledAgent (ServiceManager): Booting oxz_crucible_fd8c0b95-28ad-4b2a-97d9-6778a8a37605 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_fd8c0b95-28ad-4b2a-97d9-6778a8a37605
13272024-11-26T05:23:30.307ZINFOSledAgent (ServiceManager): Booting oxz_crucible_90a408e9-936a-4920-ae45-8ca2dc33ed86 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_90a408e9-936a-4920-ae45-8ca2dc33ed86
13282024-11-26T05:23:30.338ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7ea0f6a9-f6ea-4a00-8862-957ae8407d39") failed: Property not found. retry in 66.18188ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7ea0f6a9-f6ea-4a00-8862-957ae8407d39
13292024-11-26T05:23:30.350ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b0f7327e-9818-4b74-82bf-6f6bf3231db9") failed: Property not found. retry in 57.344435ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b0f7327e-9818-4b74-82bf-6f6bf3231db9
13302024-11-26T05:23:30.418ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7ea0f6a9-f6ea-4a00-8862-957ae8407d39") failed: Property not found. retry in 115.527068ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7ea0f6a9-f6ea-4a00-8862-957ae8407d39
13312024-11-26T05:23:30.431ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b0f7327e-9818-4b74-82bf-6f6bf3231db9") failed: Property not found. retry in 127.895499ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b0f7327e-9818-4b74-82bf-6f6bf3231db9
13322024-11-26T05:23:30.488ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_50516551-aadd-4094-86ba-7d3c3018bfd8") failed: Property not found. retry in 26.892328ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_50516551-aadd-4094-86ba-7d3c3018bfd8
13332024-11-26T05:23:30.521ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0cbd328d-2b71-482b-8212-63117b07c620") failed: Property not found. retry in 70.588377ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0cbd328d-2b71-482b-8212-63117b07c620
13342024-11-26T05:23:30.533ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_50516551-aadd-4094-86ba-7d3c3018bfd8") failed: Property not found. retry in 84.633153ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_50516551-aadd-4094-86ba-7d3c3018bfd8
13352024-11-26T05:23:30.545ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_506e6a7b-f08a-43e3-ae23-7818916b2247") failed: Property not found. retry in 71.987315ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_506e6a7b-f08a-43e3-ae23-7818916b2247
13362024-11-26T05:23:30.557ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_be1e42ff-fa98-49f3-a5ff-e865a51b0418") failed: Property not found. retry in 28.15252ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_be1e42ff-fa98-49f3-a5ff-e865a51b0418
13372024-11-26T05:23:30.566ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fd8c0b95-28ad-4b2a-97d9-6778a8a37605") failed: Property not found. retry in 70.655023ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fd8c0b95-28ad-4b2a-97d9-6778a8a37605
13382024-11-26T05:23:30.576ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_90a408e9-936a-4920-ae45-8ca2dc33ed86") failed: Property not found. retry in 57.189002ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_90a408e9-936a-4920-ae45-8ca2dc33ed86
13392024-11-26T05:23:30.587ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7ea0f6a9-f6ea-4a00-8862-957ae8407d39") failed: Property not found. retry in 170.533606ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7ea0f6a9-f6ea-4a00-8862-957ae8407d39
13402024-11-26T05:23:30.603ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b0f7327e-9818-4b74-82bf-6f6bf3231db9") failed: Property not found. retry in 150.755455ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b0f7327e-9818-4b74-82bf-6f6bf3231db9
13412024-11-26T05:23:30.613ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0cbd328d-2b71-482b-8212-63117b07c620") failed: Property not found. retry in 149.540572ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0cbd328d-2b71-482b-8212-63117b07c620
13422024-11-26T05:23:30.624ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_be1e42ff-fa98-49f3-a5ff-e865a51b0418") failed: Property not found. retry in 143.830182ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_be1e42ff-fa98-49f3-a5ff-e865a51b0418
13432024-11-26T05:23:30.634ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_506e6a7b-f08a-43e3-ae23-7818916b2247") failed: Property not found. retry in 120.756292ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_506e6a7b-f08a-43e3-ae23-7818916b2247
13442024-11-26T05:23:30.645ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_90a408e9-936a-4920-ae45-8ca2dc33ed86") failed: Property not found. retry in 74.117115ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_90a408e9-936a-4920-ae45-8ca2dc33ed86
13452024-11-26T05:23:30.655ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_50516551-aadd-4094-86ba-7d3c3018bfd8") failed: Property not found. retry in 203.542884ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_50516551-aadd-4094-86ba-7d3c3018bfd8
13462024-11-26T05:23:30.665ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fd8c0b95-28ad-4b2a-97d9-6778a8a37605") failed: Property not found. retry in 87.610371ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fd8c0b95-28ad-4b2a-97d9-6778a8a37605
13472024-11-26T05:23:30.733ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_90a408e9-936a-4920-ae45-8ca2dc33ed86") failed: Property not found. retry in 296.576115ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_90a408e9-936a-4920-ae45-8ca2dc33ed86
13482024-11-26T05:23:30.765ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fd8c0b95-28ad-4b2a-97d9-6778a8a37605") failed: Property not found. retry in 144.312154ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fd8c0b95-28ad-4b2a-97d9-6778a8a37605
13492024-11-26T05:23:30.775ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b0f7327e-9818-4b74-82bf-6f6bf3231db9") failed: Property not found. retry in 206.759023ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b0f7327e-9818-4b74-82bf-6f6bf3231db9
13502024-11-26T05:23:30.786ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7ea0f6a9-f6ea-4a00-8862-957ae8407d39") failed: Property not found. retry in 407.488759ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7ea0f6a9-f6ea-4a00-8862-957ae8407d39
13512024-11-26T05:23:30.795ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_506e6a7b-f08a-43e3-ae23-7818916b2247") failed: Property not found. retry in 173.97785ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_506e6a7b-f08a-43e3-ae23-7818916b2247
13522024-11-26T05:23:30.809ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0cbd328d-2b71-482b-8212-63117b07c620") failed: Property not found. retry in 152.97726ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0cbd328d-2b71-482b-8212-63117b07c620
13532024-11-26T05:23:30.821ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_be1e42ff-fa98-49f3-a5ff-e865a51b0418") failed: Property not found. retry in 124.179463ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_be1e42ff-fa98-49f3-a5ff-e865a51b0418
13542024-11-26T05:23:30.875ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_50516551-aadd-4094-86ba-7d3c3018bfd8") failed: Property not found. retry in 237.9834ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_50516551-aadd-4094-86ba-7d3c3018bfd8
13552024-11-26T05:23:30.925ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fd8c0b95-28ad-4b2a-97d9-6778a8a37605") failed: Property not found. retry in 570.029588ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fd8c0b95-28ad-4b2a-97d9-6778a8a37605
13562024-11-26T05:23:30.958ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_be1e42ff-fa98-49f3-a5ff-e865a51b0418") failed: Property not found. retry in 384.639693ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_be1e42ff-fa98-49f3-a5ff-e865a51b0418
13572024-11-26T05:23:30.975ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0cbd328d-2b71-482b-8212-63117b07c620") failed: Property not found. retry in 268.894956ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0cbd328d-2b71-482b-8212-63117b07c620
13582024-11-26T05:23:30.987ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_506e6a7b-f08a-43e3-ae23-7818916b2247") failed: Property not found. retry in 598.677212ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_506e6a7b-f08a-43e3-ae23-7818916b2247
13592024-11-26T05:23:30.999ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b0f7327e-9818-4b74-82bf-6f6bf3231db9") failed: Property not found. retry in 719.312538ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b0f7327e-9818-4b74-82bf-6f6bf3231db9
13602024-11-26T05:23:31.046ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_90a408e9-936a-4920-ae45-8ca2dc33ed86") failed: Property not found. retry in 303.510939ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_90a408e9-936a-4920-ae45-8ca2dc33ed86
13612024-11-26T05:23:31.126ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_50516551-aadd-4094-86ba-7d3c3018bfd8") failed: Property not found. retry in 975.067333ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_50516551-aadd-4094-86ba-7d3c3018bfd8
13622024-11-26T05:23:31.208ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7ea0f6a9-f6ea-4a00-8862-957ae8407d39") failed: Property not found. retry in 677.957222ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7ea0f6a9-f6ea-4a00-8862-957ae8407d39
13632024-11-26T05:23:31.256ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0cbd328d-2b71-482b-8212-63117b07c620") failed: Property not found. retry in 728.993637ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0cbd328d-2b71-482b-8212-63117b07c620
13642024-11-26T05:23:31.357ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_be1e42ff-fa98-49f3-a5ff-e865a51b0418") failed: Property not found. retry in 772.573129ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_be1e42ff-fa98-49f3-a5ff-e865a51b0418
13652024-11-26T05:23:31.368ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_90a408e9-936a-4920-ae45-8ca2dc33ed86") failed: Property not found. retry in 1.123263968s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_90a408e9-936a-4920-ae45-8ca2dc33ed86
13662024-11-26T05:23:31.509ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fd8c0b95-28ad-4b2a-97d9-6778a8a37605") failed: Property not found. retry in 655.694086ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fd8c0b95-28ad-4b2a-97d9-6778a8a37605
13672024-11-26T05:23:31.603ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_506e6a7b-f08a-43e3-ae23-7818916b2247") failed: Property not found. retry in 987.160811ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_506e6a7b-f08a-43e3-ae23-7818916b2247
13682024-11-26T05:23:31.734ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b0f7327e-9818-4b74-82bf-6f6bf3231db9") failed: Property not found. retry in 1.104018651s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b0f7327e-9818-4b74-82bf-6f6bf3231db9
13692024-11-26T05:23:31.900ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7ea0f6a9-f6ea-4a00-8862-957ae8407d39") failed: Property not found. retry in 1.399405112s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7ea0f6a9-f6ea-4a00-8862-957ae8407d39
13702024-11-26T05:23:31.998ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0cbd328d-2b71-482b-8212-63117b07c620") failed: Property not found. retry in 1.003822855s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0cbd328d-2b71-482b-8212-63117b07c620
13712024-11-26T05:23:32.113ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_50516551-aadd-4094-86ba-7d3c3018bfd8") failed: Property not found. retry in 746.987374ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_50516551-aadd-4094-86ba-7d3c3018bfd8
13722024-11-26T05:23:32.141ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_be1e42ff-fa98-49f3-a5ff-e865a51b0418") failed: Property not found. retry in 1.000153049s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_be1e42ff-fa98-49f3-a5ff-e865a51b0418
13732024-11-26T05:23:32.178ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fd8c0b95-28ad-4b2a-97d9-6778a8a37605") failed: Property not found. retry in 505.905082ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fd8c0b95-28ad-4b2a-97d9-6778a8a37605
13742024-11-26T05:23:32.422ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_eea1c48b-e597-47f2-a9c9-8bf328dab7cd: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13752024-11-26T05:23:32.422ZINFOSledAgent (ServiceManager): Booting oxz_nexus_eea1c48b-e597-47f2-a9c9-8bf328dab7cd zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_eea1c48b-e597-47f2-a9c9-8bf328dab7cd
13762024-11-26T05:23:32.430ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_de715031-fa5a-4cf9-bf82-9cec9db59d81: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13772024-11-26T05:23:32.430ZINFOSledAgent (ServiceManager): Booting oxz_nexus_de715031-fa5a-4cf9-bf82-9cec9db59d81 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_de715031-fa5a-4cf9-bf82-9cec9db59d81
13782024-11-26T05:23:32.505ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_90a408e9-936a-4920-ae45-8ca2dc33ed86") failed: Property not found. retry in 1.154357221s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_90a408e9-936a-4920-ae45-8ca2dc33ed86
13792024-11-26T05:23:32.603ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_506e6a7b-f08a-43e3-ae23-7818916b2247") failed: Property not found. retry in 1.294146345s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_506e6a7b-f08a-43e3-ae23-7818916b2247
13802024-11-26T05:23:32.645ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_eea1c48b-e597-47f2-a9c9-8bf328dab7cd") failed: Property not found. retry in 33.695591ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_eea1c48b-e597-47f2-a9c9-8bf328dab7cd
13812024-11-26T05:23:32.656ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_de715031-fa5a-4cf9-bf82-9cec9db59d81") failed: Property not found. retry in 63.618868ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_de715031-fa5a-4cf9-bf82-9cec9db59d81
13822024-11-26T05:23:32.689ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_eea1c48b-e597-47f2-a9c9-8bf328dab7cd") failed: Property not found. retry in 63.282714ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_eea1c48b-e597-47f2-a9c9-8bf328dab7cd
13832024-11-26T05:23:32.698ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fd8c0b95-28ad-4b2a-97d9-6778a8a37605") failed: Property not found. retry in 1.018245886s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fd8c0b95-28ad-4b2a-97d9-6778a8a37605
13842024-11-26T05:23:32.730ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_de715031-fa5a-4cf9-bf82-9cec9db59d81") failed: Property not found. retry in 97.978488ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_de715031-fa5a-4cf9-bf82-9cec9db59d81
13852024-11-26T05:23:32.763ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_eea1c48b-e597-47f2-a9c9-8bf328dab7cd") failed: Property not found. retry in 172.274109ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_eea1c48b-e597-47f2-a9c9-8bf328dab7cd
13862024-11-26T05:23:32.838ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_de715031-fa5a-4cf9-bf82-9cec9db59d81") failed: Property not found. retry in 161.192791ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_de715031-fa5a-4cf9-bf82-9cec9db59d81
13872024-11-26T05:23:32.849ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b0f7327e-9818-4b74-82bf-6f6bf3231db9") failed: Property not found. retry in 1.116466883s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b0f7327e-9818-4b74-82bf-6f6bf3231db9
13882024-11-26T05:23:32.872ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_50516551-aadd-4094-86ba-7d3c3018bfd8") failed: Property not found. retry in 970.935549ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_50516551-aadd-4094-86ba-7d3c3018bfd8
13892024-11-26T05:23:32.948ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_eea1c48b-e597-47f2-a9c9-8bf328dab7cd") failed: Property not found. retry in 433.438544ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_eea1c48b-e597-47f2-a9c9-8bf328dab7cd
13902024-11-26T05:23:33.013ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_de715031-fa5a-4cf9-bf82-9cec9db59d81") failed: Property not found. retry in 216.005803ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_de715031-fa5a-4cf9-bf82-9cec9db59d81
13912024-11-26T05:23:33.023ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0cbd328d-2b71-482b-8212-63117b07c620") failed: Property not found. retry in 1.092010179s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0cbd328d-2b71-482b-8212-63117b07c620
13922024-11-26T05:23:33.153ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_be1e42ff-fa98-49f3-a5ff-e865a51b0418") failed: Property not found. retry in 1.169975811s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_be1e42ff-fa98-49f3-a5ff-e865a51b0418
13932024-11-26T05:23:33.240ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_de715031-fa5a-4cf9-bf82-9cec9db59d81") failed: Property not found. retry in 453.770243ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_de715031-fa5a-4cf9-bf82-9cec9db59d81
13942024-11-26T05:23:33.314ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7ea0f6a9-f6ea-4a00-8862-957ae8407d39") failed: Property not found. retry in 517.230012ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7ea0f6a9-f6ea-4a00-8862-957ae8407d39
13952024-11-26T05:23:33.443ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_eea1c48b-e597-47f2-a9c9-8bf328dab7cd") failed: Property not found. retry in 429.687407ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_eea1c48b-e597-47f2-a9c9-8bf328dab7cd
13962024-11-26T05:23:33.737ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_90a408e9-936a-4920-ae45-8ca2dc33ed86") failed: Property not found. retry in 1.083381923s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_90a408e9-936a-4920-ae45-8ca2dc33ed86
13972024-11-26T05:23:33.769ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fd8c0b95-28ad-4b2a-97d9-6778a8a37605") failed: Property not found. retry in 545.406732ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fd8c0b95-28ad-4b2a-97d9-6778a8a37605
13982024-11-26T05:23:33.791ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_de715031-fa5a-4cf9-bf82-9cec9db59d81") failed: Property not found. retry in 1.082802713s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_de715031-fa5a-4cf9-bf82-9cec9db59d81
13992024-11-26T05:23:33.853ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7ea0f6a9-f6ea-4a00-8862-957ae8407d39") failed: Property not found. retry in 855.083392ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7ea0f6a9-f6ea-4a00-8862-957ae8407d39
14002024-11-26T05:23:33.870ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_50516551-aadd-4094-86ba-7d3c3018bfd8") failed: Property not found. retry in 982.570617ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_50516551-aadd-4094-86ba-7d3c3018bfd8
14012024-11-26T05:23:33.887ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_eea1c48b-e597-47f2-a9c9-8bf328dab7cd") failed: Property not found. retry in 732.025986ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_eea1c48b-e597-47f2-a9c9-8bf328dab7cd
14022024-11-26T05:23:33.915ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_506e6a7b-f08a-43e3-ae23-7818916b2247") failed: Property not found. retry in 1.234572598s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_506e6a7b-f08a-43e3-ae23-7818916b2247
14032024-11-26T05:23:33.982ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b0f7327e-9818-4b74-82bf-6f6bf3231db9") failed: Property not found. retry in 1.421439406s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b0f7327e-9818-4b74-82bf-6f6bf3231db9
14042024-11-26T05:23:34.128ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0cbd328d-2b71-482b-8212-63117b07c620") failed: Property not found. retry in 1.120716846s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0cbd328d-2b71-482b-8212-63117b07c620
14052024-11-26T05:23:34.238ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_6f93cace-fd0a-439d-b070-fb3e7a93d785: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_1b72df9a-7b76-458e-9ee3-3ca99732ea65/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='bdfe03f4-7041-45a3-bbf0-ef1e05efb6f7'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14062024-11-26T05:23:34.238ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_e0bf1273-c01d-45a7-81e1-d34f6eb6d99b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_06ee1c63-02b8-46d6-96ed-aa8ab7a8d522/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='f67160db-8c2a-402e-b793-bb85a5c425b6'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14072024-11-26T05:23:34.239ZINFOSledAgent (ServiceManager): Booting oxz_crucible_6f93cace-fd0a-439d-b070-fb3e7a93d785 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_6f93cace-fd0a-439d-b070-fb3e7a93d785
14082024-11-26T05:23:34.246ZINFOSledAgent (ServiceManager): Booting oxz_crucible_e0bf1273-c01d-45a7-81e1-d34f6eb6d99b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_e0bf1273-c01d-45a7-81e1-d34f6eb6d99b
14092024-11-26T05:23:34.299ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_8b990e0a-1c33-413f-8695-830485958f9e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_13de655b-3793-4d59-8bc1-22889b3fb01b/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='4b00b9eb-5589-4ee1-b6f3-767af364f270'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14102024-11-26T05:23:34.299ZINFOSledAgent (ServiceManager): Booting oxz_crucible_8b990e0a-1c33-413f-8695-830485958f9e zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_8b990e0a-1c33-413f-8695-830485958f9e
14112024-11-26T05:23:34.328ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fd8c0b95-28ad-4b2a-97d9-6778a8a37605") failed: Property not found. retry in 1.423245125s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fd8c0b95-28ad-4b2a-97d9-6778a8a37605
14122024-11-26T05:23:34.339ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_be1e42ff-fa98-49f3-a5ff-e865a51b0418") failed: Property not found. retry in 817.360096ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_be1e42ff-fa98-49f3-a5ff-e865a51b0418
14132024-11-26T05:23:34.342ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_bbffc850-2c64-4359-b922-de172ab3a4a1: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14142024-11-26T05:23:34.343ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_bbffc850-2c64-4359-b922-de172ab3a4a1 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_bbffc850-2c64-4359-b922-de172ab3a4a1
14152024-11-26T05:23:34.468ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e0bf1273-c01d-45a7-81e1-d34f6eb6d99b") failed: Property not found. retry in 34.745754ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e0bf1273-c01d-45a7-81e1-d34f6eb6d99b
14162024-11-26T05:23:34.480ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f93cace-fd0a-439d-b070-fb3e7a93d785") failed: Property not found. retry in 41.644738ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f93cace-fd0a-439d-b070-fb3e7a93d785
14172024-11-26T05:23:34.514ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8b990e0a-1c33-413f-8695-830485958f9e") failed: Property not found. retry in 26.164246ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8b990e0a-1c33-413f-8695-830485958f9e
14182024-11-26T05:23:34.524ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e0bf1273-c01d-45a7-81e1-d34f6eb6d99b") failed: Property not found. retry in 118.386697ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e0bf1273-c01d-45a7-81e1-d34f6eb6d99b
14192024-11-26T05:23:34.534ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f93cace-fd0a-439d-b070-fb3e7a93d785") failed: Property not found. retry in 71.264065ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f93cace-fd0a-439d-b070-fb3e7a93d785
14202024-11-26T05:23:34.552ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8b990e0a-1c33-413f-8695-830485958f9e") failed: Property not found. retry in 104.728585ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8b990e0a-1c33-413f-8695-830485958f9e
14212024-11-26T05:23:34.561ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_bbffc850-2c64-4359-b922-de172ab3a4a1") failed: Property not found. retry in 41.652774ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_bbffc850-2c64-4359-b922-de172ab3a4a1
14222024-11-26T05:23:34.691ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f93cace-fd0a-439d-b070-fb3e7a93d785") failed: Property not found. retry in 228.262595ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f93cace-fd0a-439d-b070-fb3e7a93d785
14232024-11-26T05:23:34.797ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_bbffc850-2c64-4359-b922-de172ab3a4a1") failed: Property not found. retry in 60.154439ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_bbffc850-2c64-4359-b922-de172ab3a4a1
14242024-11-26T05:23:34.840ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8b990e0a-1c33-413f-8695-830485958f9e") failed: Property not found. retry in 182.41874ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8b990e0a-1c33-413f-8695-830485958f9e
14252024-11-26T05:23:34.889ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e0bf1273-c01d-45a7-81e1-d34f6eb6d99b") failed: Property not found. retry in 166.087818ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e0bf1273-c01d-45a7-81e1-d34f6eb6d99b
14262024-11-26T05:23:34.903ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_eea1c48b-e597-47f2-a9c9-8bf328dab7cd") failed: Property not found. retry in 763.372855ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_eea1c48b-e597-47f2-a9c9-8bf328dab7cd
14272024-11-26T05:23:34.916ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_90a408e9-936a-4920-ae45-8ca2dc33ed86") failed: Property not found. retry in 1.086268681s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_90a408e9-936a-4920-ae45-8ca2dc33ed86
14282024-11-26T05:23:34.931ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_50516551-aadd-4094-86ba-7d3c3018bfd8") failed: Property not found. retry in 1.425128158s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_50516551-aadd-4094-86ba-7d3c3018bfd8
14292024-11-26T05:23:34.957ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_de715031-fa5a-4cf9-bf82-9cec9db59d81") failed: Property not found. retry in 1.101058257s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_de715031-fa5a-4cf9-bf82-9cec9db59d81
14302024-11-26T05:23:34.985ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7ea0f6a9-f6ea-4a00-8862-957ae8407d39") failed: Property not found. retry in 1.067172594s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7ea0f6a9-f6ea-4a00-8862-957ae8407d39
14312024-11-26T05:23:35.006ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f93cace-fd0a-439d-b070-fb3e7a93d785") failed: Property not found. retry in 596.923438ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f93cace-fd0a-439d-b070-fb3e7a93d785
14322024-11-26T05:23:35.020ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_bbffc850-2c64-4359-b922-de172ab3a4a1") failed: Property not found. retry in 287.149874ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_bbffc850-2c64-4359-b922-de172ab3a4a1
14332024-11-26T05:23:35.036ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8b990e0a-1c33-413f-8695-830485958f9e") failed: Property not found. retry in 517.709106ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8b990e0a-1c33-413f-8695-830485958f9e
14342024-11-26T05:23:35.077ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e0bf1273-c01d-45a7-81e1-d34f6eb6d99b") failed: Property not found. retry in 237.961587ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e0bf1273-c01d-45a7-81e1-d34f6eb6d99b
14352024-11-26T05:23:35.165ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_506e6a7b-f08a-43e3-ae23-7818916b2247") failed: Property not found. retry in 950.481217ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_506e6a7b-f08a-43e3-ae23-7818916b2247
14362024-11-26T05:23:35.180ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_be1e42ff-fa98-49f3-a5ff-e865a51b0418") failed: Property not found. retry in 1.428243943s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_be1e42ff-fa98-49f3-a5ff-e865a51b0418
14372024-11-26T05:23:35.181ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_4e9fd39d-4113-4491-beca-e49e9a07f310: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14382024-11-26T05:23:35.181ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_4e9fd39d-4113-4491-beca-e49e9a07f310 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_4e9fd39d-4113-4491-beca-e49e9a07f310
14392024-11-26T05:23:35.189ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_7de56ef8-bdda-46b0-a9a9-fa5e97a778c5: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14402024-11-26T05:23:35.192ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_7de56ef8-bdda-46b0-a9a9-fa5e97a778c5 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_7de56ef8-bdda-46b0-a9a9-fa5e97a778c5
14412024-11-26T05:23:35.270ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0cbd328d-2b71-482b-8212-63117b07c620") failed: Property not found. retry in 1.346447634s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0cbd328d-2b71-482b-8212-63117b07c620
14422024-11-26T05:23:35.328ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_bbffc850-2c64-4359-b922-de172ab3a4a1") failed: Property not found. retry in 443.06265ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_bbffc850-2c64-4359-b922-de172ab3a4a1
14432024-11-26T05:23:35.344ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e0bf1273-c01d-45a7-81e1-d34f6eb6d99b") failed: Property not found. retry in 1.163098863s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e0bf1273-c01d-45a7-81e1-d34f6eb6d99b
14442024-11-26T05:23:35.419ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b0f7327e-9818-4b74-82bf-6f6bf3231db9") failed: Property not found. retry in 682.959114ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b0f7327e-9818-4b74-82bf-6f6bf3231db9
14452024-11-26T05:23:35.464ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4e9fd39d-4113-4491-beca-e49e9a07f310") failed: Property not found. retry in 33.502938ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4e9fd39d-4113-4491-beca-e49e9a07f310
14462024-11-26T05:23:35.507ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7de56ef8-bdda-46b0-a9a9-fa5e97a778c5") failed: Property not found. retry in 67.068461ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_7de56ef8-bdda-46b0-a9a9-fa5e97a778c5
14472024-11-26T05:23:35.520ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4e9fd39d-4113-4491-beca-e49e9a07f310") failed: Property not found. retry in 132.026008ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4e9fd39d-4113-4491-beca-e49e9a07f310
14482024-11-26T05:23:35.568ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8b990e0a-1c33-413f-8695-830485958f9e") failed: Property not found. retry in 1.027312777s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8b990e0a-1c33-413f-8695-830485958f9e
14492024-11-26T05:23:35.587ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7de56ef8-bdda-46b0-a9a9-fa5e97a778c5") failed: Property not found. retry in 61.445453ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_7de56ef8-bdda-46b0-a9a9-fa5e97a778c5
14502024-11-26T05:23:35.618ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f93cace-fd0a-439d-b070-fb3e7a93d785") failed: Property not found. retry in 685.976012ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f93cace-fd0a-439d-b070-fb3e7a93d785
14512024-11-26T05:23:35.676ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4e9fd39d-4113-4491-beca-e49e9a07f310") failed: Property not found. retry in 179.613349ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4e9fd39d-4113-4491-beca-e49e9a07f310
14522024-11-26T05:23:35.688ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7de56ef8-bdda-46b0-a9a9-fa5e97a778c5") failed: Property not found. retry in 231.188737ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_7de56ef8-bdda-46b0-a9a9-fa5e97a778c5
14532024-11-26T05:23:35.701ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_eea1c48b-e597-47f2-a9c9-8bf328dab7cd") failed: Property not found. retry in 590.290507ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_eea1c48b-e597-47f2-a9c9-8bf328dab7cd
14542024-11-26T05:23:35.764ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fd8c0b95-28ad-4b2a-97d9-6778a8a37605") failed: Property not found. retry in 906.657225ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fd8c0b95-28ad-4b2a-97d9-6778a8a37605
14552024-11-26T05:23:35.783ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_bbffc850-2c64-4359-b922-de172ab3a4a1") failed: Property not found. retry in 929.469647ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_bbffc850-2c64-4359-b922-de172ab3a4a1
14562024-11-26T05:23:35.871ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4e9fd39d-4113-4491-beca-e49e9a07f310") failed: Property not found. retry in 230.977034ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4e9fd39d-4113-4491-beca-e49e9a07f310
14572024-11-26T05:23:35.933ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7de56ef8-bdda-46b0-a9a9-fa5e97a778c5") failed: Property not found. retry in 450.04271ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_7de56ef8-bdda-46b0-a9a9-fa5e97a778c5
14582024-11-26T05:23:36.018ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_90a408e9-936a-4920-ae45-8ca2dc33ed86") failed: Property not found. retry in 1.470447241s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_90a408e9-936a-4920-ae45-8ca2dc33ed86
14592024-11-26T05:23:36.066ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7ea0f6a9-f6ea-4a00-8862-957ae8407d39") failed: Property not found. retry in 1.178330173s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7ea0f6a9-f6ea-4a00-8862-957ae8407d39
14602024-11-26T05:23:36.080ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_de715031-fa5a-4cf9-bf82-9cec9db59d81") failed: Property not found. retry in 928.530636ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_de715031-fa5a-4cf9-bf82-9cec9db59d81
14612024-11-26T05:23:36.081ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_ccf769ca-e6aa-41c6-80d6-7f1cfa2a624a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14622024-11-26T05:23:36.169ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b0f7327e-9818-4b74-82bf-6f6bf3231db9") failed: Property not found. retry in 583.723281ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b0f7327e-9818-4b74-82bf-6f6bf3231db9
14632024-11-26T05:23:36.169ZINFOSledAgent (ServiceManager): Booting oxz_nexus_ccf769ca-e6aa-41c6-80d6-7f1cfa2a624a zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_ccf769ca-e6aa-41c6-80d6-7f1cfa2a624a
14642024-11-26T05:23:36.189ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_506e6a7b-f08a-43e3-ae23-7818916b2247") failed: Property not found. retry in 1.323376149s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_506e6a7b-f08a-43e3-ae23-7818916b2247
14652024-11-26T05:23:36.200ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4e9fd39d-4113-4491-beca-e49e9a07f310") failed: Property not found. retry in 1.038908928s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4e9fd39d-4113-4491-beca-e49e9a07f310
14662024-11-26T05:23:36.305ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_eea1c48b-e597-47f2-a9c9-8bf328dab7cd") failed: Property not found. retry in 806.150065ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_eea1c48b-e597-47f2-a9c9-8bf328dab7cd
14672024-11-26T05:23:36.317ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f93cace-fd0a-439d-b070-fb3e7a93d785") failed: Property not found. retry in 1.328464215s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f93cace-fd0a-439d-b070-fb3e7a93d785
14682024-11-26T05:23:36.318ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_a4232f21-0674-457e-97a4-41c6f360d0c1: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='a4232f21-0674-457e-97a4-41c6f360d0c1'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14692024-11-26T05:23:36.318ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_a4232f21-0674-457e-97a4-41c6f360d0c1 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_oximeter_a4232f21-0674-457e-97a4-41c6f360d0c1
14702024-11-26T05:23:36.369ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_50516551-aadd-4094-86ba-7d3c3018bfd8") failed: Property not found. retry in 1.235672279s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_50516551-aadd-4094-86ba-7d3c3018bfd8
14712024-11-26T05:23:36.396ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7de56ef8-bdda-46b0-a9a9-fa5e97a778c5") failed: Property not found. retry in 812.918068ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_7de56ef8-bdda-46b0-a9a9-fa5e97a778c5
14722024-11-26T05:23:36.610ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e0bf1273-c01d-45a7-81e1-d34f6eb6d99b") failed: Property not found. retry in 640.445836ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e0bf1273-c01d-45a7-81e1-d34f6eb6d99b
14732024-11-26T05:23:36.621ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8b990e0a-1c33-413f-8695-830485958f9e") failed: Property not found. retry in 607.640041ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8b990e0a-1c33-413f-8695-830485958f9e
14742024-11-26T05:23:36.631ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_be1e42ff-fa98-49f3-a5ff-e865a51b0418") failed: Property not found. retry in 592.756012ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_be1e42ff-fa98-49f3-a5ff-e865a51b0418
14752024-11-26T05:23:36.638ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a4232f21-0674-457e-97a4-41c6f360d0c1") failed: Property not found. retry in 27.746516ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a4232f21-0674-457e-97a4-41c6f360d0c1
14762024-11-26T05:23:36.646ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0cbd328d-2b71-482b-8212-63117b07c620") failed: Property not found. retry in 562.625723ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0cbd328d-2b71-482b-8212-63117b07c620
14772024-11-26T05:23:36.654ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ccf769ca-e6aa-41c6-80d6-7f1cfa2a624a") failed: Property not found. retry in 69.835013ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ccf769ca-e6aa-41c6-80d6-7f1cfa2a624a
14782024-11-26T05:23:36.675ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a4232f21-0674-457e-97a4-41c6f360d0c1") failed: Property not found. retry in 88.973302ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a4232f21-0674-457e-97a4-41c6f360d0c1
14792024-11-26T05:23:36.683ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fd8c0b95-28ad-4b2a-97d9-6778a8a37605") failed: Property not found. retry in 802.667581ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fd8c0b95-28ad-4b2a-97d9-6778a8a37605
14802024-11-26T05:23:36.775ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_bbffc850-2c64-4359-b922-de172ab3a4a1") failed: Property not found. retry in 731.039254ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_bbffc850-2c64-4359-b922-de172ab3a4a1
14812024-11-26T05:23:36.782ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a4232f21-0674-457e-97a4-41c6f360d0c1") failed: Property not found. retry in 201.047062ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a4232f21-0674-457e-97a4-41c6f360d0c1
14822024-11-26T05:23:36.791ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b0f7327e-9818-4b74-82bf-6f6bf3231db9") failed: Property not found. retry in 896.893771ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b0f7327e-9818-4b74-82bf-6f6bf3231db9
14832024-11-26T05:23:36.798ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ccf769ca-e6aa-41c6-80d6-7f1cfa2a624a") failed: Property not found. retry in 105.167466ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ccf769ca-e6aa-41c6-80d6-7f1cfa2a624a
14842024-11-26T05:23:36.912ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ccf769ca-e6aa-41c6-80d6-7f1cfa2a624a") failed: Property not found. retry in 103.502484ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ccf769ca-e6aa-41c6-80d6-7f1cfa2a624a
14852024-11-26T05:23:36.995ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a4232f21-0674-457e-97a4-41c6f360d0c1") failed: Property not found. retry in 590.309011ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a4232f21-0674-457e-97a4-41c6f360d0c1
14862024-11-26T05:23:37.017ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_de715031-fa5a-4cf9-bf82-9cec9db59d81") failed: Property not found. retry in 1.169066248s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_de715031-fa5a-4cf9-bf82-9cec9db59d81
14872024-11-26T05:23:37.023ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ccf769ca-e6aa-41c6-80d6-7f1cfa2a624a") failed: Property not found. retry in 399.388547ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ccf769ca-e6aa-41c6-80d6-7f1cfa2a624a
14882024-11-26T05:23:37.120ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_eea1c48b-e597-47f2-a9c9-8bf328dab7cd") failed: Property not found. retry in 1.140613791s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_eea1c48b-e597-47f2-a9c9-8bf328dab7cd
14892024-11-26T05:23:37.219ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0cbd328d-2b71-482b-8212-63117b07c620") failed: Property not found. retry in 626.316554ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0cbd328d-2b71-482b-8212-63117b07c620
14902024-11-26T05:23:37.226ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7de56ef8-bdda-46b0-a9a9-fa5e97a778c5") failed: Property not found. retry in 1.442353682s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_7de56ef8-bdda-46b0-a9a9-fa5e97a778c5
14912024-11-26T05:23:37.233ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_be1e42ff-fa98-49f3-a5ff-e865a51b0418") failed: Property not found. retry in 1.427897472s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_be1e42ff-fa98-49f3-a5ff-e865a51b0418
14922024-11-26T05:23:37.241ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8b990e0a-1c33-413f-8695-830485958f9e") failed: Property not found. retry in 724.479547ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8b990e0a-1c33-413f-8695-830485958f9e
14932024-11-26T05:23:37.249ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4e9fd39d-4113-4491-beca-e49e9a07f310") failed: Property not found. retry in 1.071702958s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4e9fd39d-4113-4491-beca-e49e9a07f310
14942024-11-26T05:23:37.256ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7ea0f6a9-f6ea-4a00-8862-957ae8407d39") failed: Property not found. retry in 757.67934ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7ea0f6a9-f6ea-4a00-8862-957ae8407d39
14952024-11-26T05:23:37.264ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e0bf1273-c01d-45a7-81e1-d34f6eb6d99b") failed: Property not found. retry in 876.637952ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e0bf1273-c01d-45a7-81e1-d34f6eb6d99b
14962024-11-26T05:23:37.432ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ccf769ca-e6aa-41c6-80d6-7f1cfa2a624a") failed: Property not found. retry in 522.363462ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ccf769ca-e6aa-41c6-80d6-7f1cfa2a624a
14972024-11-26T05:23:37.495ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fd8c0b95-28ad-4b2a-97d9-6778a8a37605") failed: Property not found. retry in 811.438117ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fd8c0b95-28ad-4b2a-97d9-6778a8a37605
14982024-11-26T05:23:37.504ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_90a408e9-936a-4920-ae45-8ca2dc33ed86") failed: Property not found. retry in 786.190719ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_90a408e9-936a-4920-ae45-8ca2dc33ed86
14992024-11-26T05:23:37.515ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_bbffc850-2c64-4359-b922-de172ab3a4a1") failed: Property not found. retry in 895.965875ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_bbffc850-2c64-4359-b922-de172ab3a4a1
15002024-11-26T05:23:37.522ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_506e6a7b-f08a-43e3-ae23-7818916b2247") failed: Property not found. retry in 1.284286118s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_506e6a7b-f08a-43e3-ae23-7818916b2247
15012024-11-26T05:23:37.595ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a4232f21-0674-457e-97a4-41c6f360d0c1") failed: Property not found. retry in 693.57857ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a4232f21-0674-457e-97a4-41c6f360d0c1
15022024-11-26T05:23:37.614ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_50516551-aadd-4094-86ba-7d3c3018bfd8") failed: Property not found. retry in 978.008714ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_50516551-aadd-4094-86ba-7d3c3018bfd8
15032024-11-26T05:23:37.655ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f93cace-fd0a-439d-b070-fb3e7a93d785") failed: Property not found. retry in 1.042024739s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f93cace-fd0a-439d-b070-fb3e7a93d785
15042024-11-26T05:23:37.696ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b0f7327e-9818-4b74-82bf-6f6bf3231db9") failed: Property not found. retry in 966.191563ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b0f7327e-9818-4b74-82bf-6f6bf3231db9
15052024-11-26T05:23:37.855ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0cbd328d-2b71-482b-8212-63117b07c620") failed: Property not found. retry in 1.421120541s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0cbd328d-2b71-482b-8212-63117b07c620
15062024-11-26T05:23:37.962ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ccf769ca-e6aa-41c6-80d6-7f1cfa2a624a") failed: Property not found. retry in 1.027007684s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ccf769ca-e6aa-41c6-80d6-7f1cfa2a624a
15072024-11-26T05:23:37.974ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8b990e0a-1c33-413f-8695-830485958f9e") failed: Property not found. retry in 1.334070876s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8b990e0a-1c33-413f-8695-830485958f9e
15082024-11-26T05:23:38.023ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7ea0f6a9-f6ea-4a00-8862-957ae8407d39") failed: Property not found. retry in 776.114219ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7ea0f6a9-f6ea-4a00-8862-957ae8407d39
15092024-11-26T05:23:38.150ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e0bf1273-c01d-45a7-81e1-d34f6eb6d99b") failed: Property not found. retry in 742.834751ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e0bf1273-c01d-45a7-81e1-d34f6eb6d99b
15102024-11-26T05:23:38.196ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_de715031-fa5a-4cf9-bf82-9cec9db59d81") failed: Property not found. retry in 918.464732ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_de715031-fa5a-4cf9-bf82-9cec9db59d81
15112024-11-26T05:23:38.271ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_eea1c48b-e597-47f2-a9c9-8bf328dab7cd") failed: Property not found. retry in 710.243957ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_eea1c48b-e597-47f2-a9c9-8bf328dab7cd
15122024-11-26T05:23:38.298ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a4232f21-0674-457e-97a4-41c6f360d0c1") failed: Property not found. retry in 822.274518ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a4232f21-0674-457e-97a4-41c6f360d0c1
15132024-11-26T05:23:38.306ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_90a408e9-936a-4920-ae45-8ca2dc33ed86") failed: Property not found. retry in 1.437513751s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_90a408e9-936a-4920-ae45-8ca2dc33ed86
15142024-11-26T05:23:38.314ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fd8c0b95-28ad-4b2a-97d9-6778a8a37605") failed: Property not found. retry in 1.461476481s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fd8c0b95-28ad-4b2a-97d9-6778a8a37605
15152024-11-26T05:23:38.329ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4e9fd39d-4113-4491-beca-e49e9a07f310") failed: Property not found. retry in 957.221694ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4e9fd39d-4113-4491-beca-e49e9a07f310
15162024-11-26T05:23:38.419ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_bbffc850-2c64-4359-b922-de172ab3a4a1") failed: Property not found. retry in 583.7611ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_bbffc850-2c64-4359-b922-de172ab3a4a1
15172024-11-26T05:23:38.671ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_be1e42ff-fa98-49f3-a5ff-e865a51b0418") failed: Property not found. retry in 1.025825053s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_be1e42ff-fa98-49f3-a5ff-e865a51b0418
15182024-11-26T05:23:38.679ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_50516551-aadd-4094-86ba-7d3c3018bfd8") failed: Property not found. retry in 682.389387ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_50516551-aadd-4094-86ba-7d3c3018bfd8
15192024-11-26T05:23:38.732ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b0f7327e-9818-4b74-82bf-6f6bf3231db9") failed: Property not found. retry in 979.207489ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b0f7327e-9818-4b74-82bf-6f6bf3231db9
15202024-11-26T05:23:38.740ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7de56ef8-bdda-46b0-a9a9-fa5e97a778c5") failed: Property not found. retry in 872.351162ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_7de56ef8-bdda-46b0-a9a9-fa5e97a778c5
15212024-11-26T05:23:38.748ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f93cace-fd0a-439d-b070-fb3e7a93d785") failed: Property not found. retry in 1.484428479s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f93cace-fd0a-439d-b070-fb3e7a93d785
15222024-11-26T05:23:38.809ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7ea0f6a9-f6ea-4a00-8862-957ae8407d39") failed: Property not found. retry in 715.624025ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7ea0f6a9-f6ea-4a00-8862-957ae8407d39
15232024-11-26T05:23:38.817ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_506e6a7b-f08a-43e3-ae23-7818916b2247") failed: Property not found. retry in 1.031410771s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_506e6a7b-f08a-43e3-ae23-7818916b2247
15242024-11-26T05:23:38.902ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e0bf1273-c01d-45a7-81e1-d34f6eb6d99b") failed: Property not found. retry in 769.565351ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e0bf1273-c01d-45a7-81e1-d34f6eb6d99b
15252024-11-26T05:23:38.990ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_eea1c48b-e597-47f2-a9c9-8bf328dab7cd") failed: Property not found. retry in 820.369897ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_eea1c48b-e597-47f2-a9c9-8bf328dab7cd
15262024-11-26T05:23:38.998ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ccf769ca-e6aa-41c6-80d6-7f1cfa2a624a") failed: Property not found. retry in 867.198838ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ccf769ca-e6aa-41c6-80d6-7f1cfa2a624a
15272024-11-26T05:23:39.014ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_bbffc850-2c64-4359-b922-de172ab3a4a1") failed: Property not found. retry in 767.428739ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_bbffc850-2c64-4359-b922-de172ab3a4a1
15282024-11-26T05:23:39.126ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_de715031-fa5a-4cf9-bf82-9cec9db59d81") failed: Property not found. retry in 1.236717112s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_de715031-fa5a-4cf9-bf82-9cec9db59d81
15292024-11-26T05:23:39.134ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a4232f21-0674-457e-97a4-41c6f360d0c1") failed: Property not found. retry in 1.289243103s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a4232f21-0674-457e-97a4-41c6f360d0c1
15302024-11-26T05:23:39.298ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0cbd328d-2b71-482b-8212-63117b07c620") failed: Property not found. retry in 852.232145ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0cbd328d-2b71-482b-8212-63117b07c620
15312024-11-26T05:23:39.353ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4e9fd39d-4113-4491-beca-e49e9a07f310") failed: Property not found. retry in 1.265535282s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4e9fd39d-4113-4491-beca-e49e9a07f310
15322024-11-26T05:23:39.362ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8b990e0a-1c33-413f-8695-830485958f9e") failed: Property not found. retry in 632.60632ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8b990e0a-1c33-413f-8695-830485958f9e
15332024-11-26T05:23:39.370ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_50516551-aadd-4094-86ba-7d3c3018bfd8") failed: Property not found. retry in 1.388021581s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_50516551-aadd-4094-86ba-7d3c3018bfd8
15342024-11-26T05:23:39.535ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7ea0f6a9-f6ea-4a00-8862-957ae8407d39") failed: Property not found. retry in 1.210822267s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7ea0f6a9-f6ea-4a00-8862-957ae8407d39
15352024-11-26T05:23:39.622ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7de56ef8-bdda-46b0-a9a9-fa5e97a778c5") failed: Property not found. retry in 904.484828ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_7de56ef8-bdda-46b0-a9a9-fa5e97a778c5
15362024-11-26T05:23:39.680ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e0bf1273-c01d-45a7-81e1-d34f6eb6d99b") failed: Property not found. retry in 533.87419ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e0bf1273-c01d-45a7-81e1-d34f6eb6d99b
15372024-11-26T05:23:39.704ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_be1e42ff-fa98-49f3-a5ff-e865a51b0418") failed: Property not found. retry in 1.31943044s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_be1e42ff-fa98-49f3-a5ff-e865a51b0418
15382024-11-26T05:23:39.720ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b0f7327e-9818-4b74-82bf-6f6bf3231db9") failed: Property not found. retry in 1.328000869s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b0f7327e-9818-4b74-82bf-6f6bf3231db9
15392024-11-26T05:23:39.753ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_90a408e9-936a-4920-ae45-8ca2dc33ed86") failed: Property not found. retry in 614.255414ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_90a408e9-936a-4920-ae45-8ca2dc33ed86
15402024-11-26T05:23:39.784ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fd8c0b95-28ad-4b2a-97d9-6778a8a37605") failed: Property not found. retry in 663.39765ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fd8c0b95-28ad-4b2a-97d9-6778a8a37605
15412024-11-26T05:23:39.791ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_bbffc850-2c64-4359-b922-de172ab3a4a1") failed: Property not found. retry in 814.836705ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_bbffc850-2c64-4359-b922-de172ab3a4a1
15422024-11-26T05:23:39.819ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_eea1c48b-e597-47f2-a9c9-8bf328dab7cd") failed: Property not found. retry in 578.906579ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_eea1c48b-e597-47f2-a9c9-8bf328dab7cd
15432024-11-26T05:23:39.856ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_506e6a7b-f08a-43e3-ae23-7818916b2247") failed: Property not found. retry in 872.329878ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_506e6a7b-f08a-43e3-ae23-7818916b2247
15442024-11-26T05:23:39.872ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ccf769ca-e6aa-41c6-80d6-7f1cfa2a624a") failed: Property not found. retry in 930.031297ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ccf769ca-e6aa-41c6-80d6-7f1cfa2a624a
15452024-11-26T05:23:40.004ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8b990e0a-1c33-413f-8695-830485958f9e") failed: Property not found. retry in 1.023440379s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8b990e0a-1c33-413f-8695-830485958f9e
15462024-11-26T05:23:40.159ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0cbd328d-2b71-482b-8212-63117b07c620") failed: Property not found. retry in 754.991169ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0cbd328d-2b71-482b-8212-63117b07c620
15472024-11-26T05:23:40.222ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e0bf1273-c01d-45a7-81e1-d34f6eb6d99b") failed: Property not found. retry in 1.280457581s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e0bf1273-c01d-45a7-81e1-d34f6eb6d99b
15482024-11-26T05:23:40.241ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f93cace-fd0a-439d-b070-fb3e7a93d785") failed: Property not found. retry in 598.507509ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f93cace-fd0a-439d-b070-fb3e7a93d785
15492024-11-26T05:23:40.371ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_de715031-fa5a-4cf9-bf82-9cec9db59d81") failed: Property not found. retry in 1.387501317s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_de715031-fa5a-4cf9-bf82-9cec9db59d81
15502024-11-26T05:23:40.381ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_90a408e9-936a-4920-ae45-8ca2dc33ed86") failed: Property not found. retry in 1.353020933s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_90a408e9-936a-4920-ae45-8ca2dc33ed86
15512024-11-26T05:23:40.406ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_eea1c48b-e597-47f2-a9c9-8bf328dab7cd") failed: Property not found. retry in 1.292322897s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_eea1c48b-e597-47f2-a9c9-8bf328dab7cd
15522024-11-26T05:23:40.432ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a4232f21-0674-457e-97a4-41c6f360d0c1") failed: Property not found. retry in 561.958818ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a4232f21-0674-457e-97a4-41c6f360d0c1
15532024-11-26T05:23:40.455ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fd8c0b95-28ad-4b2a-97d9-6778a8a37605") failed: Property not found. retry in 750.250964ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fd8c0b95-28ad-4b2a-97d9-6778a8a37605
15542024-11-26T05:23:40.535ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7de56ef8-bdda-46b0-a9a9-fa5e97a778c5") failed: Property not found. retry in 944.389284ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_7de56ef8-bdda-46b0-a9a9-fa5e97a778c5
15552024-11-26T05:23:40.616ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_bbffc850-2c64-4359-b922-de172ab3a4a1") failed: Property not found. retry in 1.052053183s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_bbffc850-2c64-4359-b922-de172ab3a4a1
15562024-11-26T05:23:40.626ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4e9fd39d-4113-4491-beca-e49e9a07f310") failed: Property not found. retry in 504.990867ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4e9fd39d-4113-4491-beca-e49e9a07f310
15572024-11-26T05:23:40.737ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_506e6a7b-f08a-43e3-ae23-7818916b2247") failed: Property not found. retry in 1.210921399s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_506e6a7b-f08a-43e3-ae23-7818916b2247
15582024-11-26T05:23:40.754ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7ea0f6a9-f6ea-4a00-8862-957ae8407d39") failed: Property not found. retry in 781.352887ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7ea0f6a9-f6ea-4a00-8862-957ae8407d39
15592024-11-26T05:23:40.768ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_50516551-aadd-4094-86ba-7d3c3018bfd8") failed: Property not found. retry in 1.391087414s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_50516551-aadd-4094-86ba-7d3c3018bfd8
15602024-11-26T05:23:40.811ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ccf769ca-e6aa-41c6-80d6-7f1cfa2a624a") failed: Property not found. retry in 1.382487431s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ccf769ca-e6aa-41c6-80d6-7f1cfa2a624a
15612024-11-26T05:23:40.847ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f93cace-fd0a-439d-b070-fb3e7a93d785") failed: Property not found. retry in 625.878107ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f93cace-fd0a-439d-b070-fb3e7a93d785
15622024-11-26T05:23:40.923ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0cbd328d-2b71-482b-8212-63117b07c620") failed: Property not found. retry in 921.033509ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0cbd328d-2b71-482b-8212-63117b07c620
15632024-11-26T05:23:41.002ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a4232f21-0674-457e-97a4-41c6f360d0c1") failed: Property not found. retry in 1.27150726s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a4232f21-0674-457e-97a4-41c6f360d0c1
15642024-11-26T05:23:41.032ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_be1e42ff-fa98-49f3-a5ff-e865a51b0418") failed: Property not found. retry in 848.308282ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_be1e42ff-fa98-49f3-a5ff-e865a51b0418
15652024-11-26T05:23:41.039ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8b990e0a-1c33-413f-8695-830485958f9e") failed: Property not found. retry in 1.329283218s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8b990e0a-1c33-413f-8695-830485958f9e
15662024-11-26T05:23:41.057ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b0f7327e-9818-4b74-82bf-6f6bf3231db9") failed: Property not found. retry in 1.32931796s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b0f7327e-9818-4b74-82bf-6f6bf3231db9
15672024-11-26T05:23:41.142ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4e9fd39d-4113-4491-beca-e49e9a07f310") failed: Property not found. retry in 1.450124342s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4e9fd39d-4113-4491-beca-e49e9a07f310
15682024-11-26T05:23:41.214ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fd8c0b95-28ad-4b2a-97d9-6778a8a37605") failed: Property not found. retry in 1.128086329s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fd8c0b95-28ad-4b2a-97d9-6778a8a37605
15692024-11-26T05:23:41.485ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f93cace-fd0a-439d-b070-fb3e7a93d785") failed: Property not found. retry in 809.190522ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f93cace-fd0a-439d-b070-fb3e7a93d785
15702024-11-26T05:23:41.494ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7de56ef8-bdda-46b0-a9a9-fa5e97a778c5") failed: Property not found. retry in 641.214305ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_7de56ef8-bdda-46b0-a9a9-fa5e97a778c5
15712024-11-26T05:23:41.512ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e0bf1273-c01d-45a7-81e1-d34f6eb6d99b") failed: Property not found. retry in 1.251278929s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e0bf1273-c01d-45a7-81e1-d34f6eb6d99b
15722024-11-26T05:23:41.544ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7ea0f6a9-f6ea-4a00-8862-957ae8407d39") failed: Property not found. retry in 994.775229ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7ea0f6a9-f6ea-4a00-8862-957ae8407d39
15732024-11-26T05:23:41.679ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_bbffc850-2c64-4359-b922-de172ab3a4a1") failed: Property not found. retry in 1.276004744s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_bbffc850-2c64-4359-b922-de172ab3a4a1
15742024-11-26T05:23:41.708ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_eea1c48b-e597-47f2-a9c9-8bf328dab7cd") failed: Property not found. retry in 1.433008815s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_eea1c48b-e597-47f2-a9c9-8bf328dab7cd
15752024-11-26T05:23:41.742ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_90a408e9-936a-4920-ae45-8ca2dc33ed86") failed: Property not found. retry in 1.055904612s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_90a408e9-936a-4920-ae45-8ca2dc33ed86
15762024-11-26T05:23:41.769ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_de715031-fa5a-4cf9-bf82-9cec9db59d81") failed: Property not found. retry in 1.143633412s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_de715031-fa5a-4cf9-bf82-9cec9db59d81
15772024-11-26T05:23:41.854ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0cbd328d-2b71-482b-8212-63117b07c620") failed: Property not found. retry in 1.00267403s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0cbd328d-2b71-482b-8212-63117b07c620
15782024-11-26T05:23:41.889ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_be1e42ff-fa98-49f3-a5ff-e865a51b0418") failed: Property not found. retry in 1.001786845s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_be1e42ff-fa98-49f3-a5ff-e865a51b0418
15792024-11-26T05:23:41.957ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_506e6a7b-f08a-43e3-ae23-7818916b2247") failed: Property not found. retry in 711.201285ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_506e6a7b-f08a-43e3-ae23-7818916b2247
15802024-11-26T05:23:42.144ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7de56ef8-bdda-46b0-a9a9-fa5e97a778c5") failed: Property not found. retry in 716.551231ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_7de56ef8-bdda-46b0-a9a9-fa5e97a778c5
15812024-11-26T05:23:42.168ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_50516551-aadd-4094-86ba-7d3c3018bfd8") failed: Property not found. retry in 989.7474ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_50516551-aadd-4094-86ba-7d3c3018bfd8
15822024-11-26T05:23:42.203ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ccf769ca-e6aa-41c6-80d6-7f1cfa2a624a") failed: Property not found. retry in 1.083054019s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ccf769ca-e6aa-41c6-80d6-7f1cfa2a624a
15832024-11-26T05:23:42.283ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a4232f21-0674-457e-97a4-41c6f360d0c1") failed: Property not found. retry in 1.268440377s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a4232f21-0674-457e-97a4-41c6f360d0c1
15842024-11-26T05:23:42.303ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f93cace-fd0a-439d-b070-fb3e7a93d785") failed: Property not found. retry in 1.445492178s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f93cace-fd0a-439d-b070-fb3e7a93d785
15852024-11-26T05:23:42.353ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fd8c0b95-28ad-4b2a-97d9-6778a8a37605") failed: Property not found. retry in 667.855074ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fd8c0b95-28ad-4b2a-97d9-6778a8a37605
15862024-11-26T05:23:42.377ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8b990e0a-1c33-413f-8695-830485958f9e") failed: Property not found. retry in 1.080767959s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8b990e0a-1c33-413f-8695-830485958f9e
15872024-11-26T05:23:42.396ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b0f7327e-9818-4b74-82bf-6f6bf3231db9") failed: Property not found. retry in 889.13153ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b0f7327e-9818-4b74-82bf-6f6bf3231db9
15882024-11-26T05:23:42.397ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:39387
15892024-11-26T05:23:42.435ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37103 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:39387 req_id = 34ae7d57-0de2-40cf-9873-050f80c80af2 response_code = 200 uri = /baseboard
15902024-11-26T05:23:42.547ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7ea0f6a9-f6ea-4a00-8862-957ae8407d39") failed: Property not found. retry in 1.071176228s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7ea0f6a9-f6ea-4a00-8862-957ae8407d39
15912024-11-26T05:23:42.600ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4e9fd39d-4113-4491-beca-e49e9a07f310") failed: Property not found. retry in 716.492306ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4e9fd39d-4113-4491-beca-e49e9a07f310
15922024-11-26T05:23:42.676ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_506e6a7b-f08a-43e3-ae23-7818916b2247") failed: Property not found. retry in 979.662566ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_506e6a7b-f08a-43e3-ae23-7818916b2247
15932024-11-26T05:23:42.772ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e0bf1273-c01d-45a7-81e1-d34f6eb6d99b") failed: Property not found. retry in 1.361777782s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e0bf1273-c01d-45a7-81e1-d34f6eb6d99b
15942024-11-26T05:23:42.807ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_90a408e9-936a-4920-ae45-8ca2dc33ed86") failed: Property not found. retry in 1.085758917s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_90a408e9-936a-4920-ae45-8ca2dc33ed86
15952024-11-26T05:23:42.867ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0cbd328d-2b71-482b-8212-63117b07c620") failed: Property not found. retry in 868.193465ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0cbd328d-2b71-482b-8212-63117b07c620
15962024-11-26T05:23:42.876ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7de56ef8-bdda-46b0-a9a9-fa5e97a778c5") failed: Property not found. retry in 848.828917ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_7de56ef8-bdda-46b0-a9a9-fa5e97a778c5
15972024-11-26T05:23:42.901ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_be1e42ff-fa98-49f3-a5ff-e865a51b0418") failed: Property not found. retry in 1.279050442s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_be1e42ff-fa98-49f3-a5ff-e865a51b0418
15982024-11-26T05:23:42.921ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_de715031-fa5a-4cf9-bf82-9cec9db59d81") failed: Property not found. retry in 718.089388ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_de715031-fa5a-4cf9-bf82-9cec9db59d81
15992024-11-26T05:23:42.965ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_bbffc850-2c64-4359-b922-de172ab3a4a1") failed: Property not found. retry in 930.455306ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_bbffc850-2c64-4359-b922-de172ab3a4a1
16002024-11-26T05:23:43.031ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fd8c0b95-28ad-4b2a-97d9-6778a8a37605") failed: Property not found. retry in 1.248510219s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fd8c0b95-28ad-4b2a-97d9-6778a8a37605
16012024-11-26T05:23:43.150ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_eea1c48b-e597-47f2-a9c9-8bf328dab7cd") failed: Property not found. retry in 863.476476ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_eea1c48b-e597-47f2-a9c9-8bf328dab7cd
16022024-11-26T05:23:43.167ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_50516551-aadd-4094-86ba-7d3c3018bfd8") failed: Property not found. retry in 1.109225629s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_50516551-aadd-4094-86ba-7d3c3018bfd8
16032024-11-26T05:23:43.297ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b0f7327e-9818-4b74-82bf-6f6bf3231db9") failed: Property not found. retry in 952.643802ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b0f7327e-9818-4b74-82bf-6f6bf3231db9
16042024-11-26T05:23:43.306ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ccf769ca-e6aa-41c6-80d6-7f1cfa2a624a") failed: Property not found. retry in 805.204015ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ccf769ca-e6aa-41c6-80d6-7f1cfa2a624a
16052024-11-26T05:23:43.327ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4e9fd39d-4113-4491-beca-e49e9a07f310") failed: Property not found. retry in 1.063798349s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4e9fd39d-4113-4491-beca-e49e9a07f310
16062024-11-26T05:23:43.469ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8b990e0a-1c33-413f-8695-830485958f9e") failed: Property not found. retry in 817.602906ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8b990e0a-1c33-413f-8695-830485958f9e
16072024-11-26T05:23:43.562ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a4232f21-0674-457e-97a4-41c6f360d0c1") failed: Property not found. retry in 1.333468102s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a4232f21-0674-457e-97a4-41c6f360d0c1
16082024-11-26T05:23:43.629ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7ea0f6a9-f6ea-4a00-8862-957ae8407d39") failed: Property not found. retry in 670.570222ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7ea0f6a9-f6ea-4a00-8862-957ae8407d39
16092024-11-26T05:23:43.649ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_de715031-fa5a-4cf9-bf82-9cec9db59d81") failed: Property not found. retry in 1.344919125s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_de715031-fa5a-4cf9-bf82-9cec9db59d81
16102024-11-26T05:23:43.665ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_506e6a7b-f08a-43e3-ae23-7818916b2247") failed: Property not found. retry in 1.478919117s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_506e6a7b-f08a-43e3-ae23-7818916b2247
16112024-11-26T05:23:43.734ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7de56ef8-bdda-46b0-a9a9-fa5e97a778c5") failed: Property not found. retry in 858.343471ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_7de56ef8-bdda-46b0-a9a9-fa5e97a778c5
16122024-11-26T05:23:43.745ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0cbd328d-2b71-482b-8212-63117b07c620") failed: Property not found. retry in 1.036178424s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0cbd328d-2b71-482b-8212-63117b07c620
16132024-11-26T05:23:43.758ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f93cace-fd0a-439d-b070-fb3e7a93d785") failed: Property not found. retry in 857.356084ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f93cace-fd0a-439d-b070-fb3e7a93d785
16142024-11-26T05:23:43.903ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_90a408e9-936a-4920-ae45-8ca2dc33ed86") failed: Property not found. retry in 1.242215648s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_90a408e9-936a-4920-ae45-8ca2dc33ed86
16152024-11-26T05:23:43.911ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_bbffc850-2c64-4359-b922-de172ab3a4a1") failed: Property not found. retry in 674.424691ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_bbffc850-2c64-4359-b922-de172ab3a4a1
16162024-11-26T05:23:44.023ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_eea1c48b-e597-47f2-a9c9-8bf328dab7cd") failed: Property not found. retry in 1.266489239s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_eea1c48b-e597-47f2-a9c9-8bf328dab7cd
16172024-11-26T05:23:44.122ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ccf769ca-e6aa-41c6-80d6-7f1cfa2a624a") failed: Property not found. retry in 654.434637ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ccf769ca-e6aa-41c6-80d6-7f1cfa2a624a
16182024-11-26T05:23:44.144ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e0bf1273-c01d-45a7-81e1-d34f6eb6d99b") failed: Property not found. retry in 556.45179ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e0bf1273-c01d-45a7-81e1-d34f6eb6d99b
16192024-11-26T05:23:44.190ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_be1e42ff-fa98-49f3-a5ff-e865a51b0418") failed: Property not found. retry in 1.251048829s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_be1e42ff-fa98-49f3-a5ff-e865a51b0418
16202024-11-26T05:23:44.258ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b0f7327e-9818-4b74-82bf-6f6bf3231db9") failed: Property not found. retry in 920.10905ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b0f7327e-9818-4b74-82bf-6f6bf3231db9
16212024-11-26T05:23:44.285ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_50516551-aadd-4094-86ba-7d3c3018bfd8") failed: Property not found. retry in 720.506995ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_50516551-aadd-4094-86ba-7d3c3018bfd8
16222024-11-26T05:23:44.292ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fd8c0b95-28ad-4b2a-97d9-6778a8a37605") failed: Property not found. retry in 600.260003ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fd8c0b95-28ad-4b2a-97d9-6778a8a37605
16232024-11-26T05:23:44.300ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8b990e0a-1c33-413f-8695-830485958f9e") failed: Property not found. retry in 1.125358579s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8b990e0a-1c33-413f-8695-830485958f9e
16242024-11-26T05:23:44.312ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7ea0f6a9-f6ea-4a00-8862-957ae8407d39") failed: Property not found. retry in 1.058432269s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7ea0f6a9-f6ea-4a00-8862-957ae8407d39
16252024-11-26T05:23:44.402ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4e9fd39d-4113-4491-beca-e49e9a07f310") failed: Property not found. retry in 1.131731143s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4e9fd39d-4113-4491-beca-e49e9a07f310
16262024-11-26T05:23:44.594ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_bbffc850-2c64-4359-b922-de172ab3a4a1") failed: Property not found. retry in 764.550856ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_bbffc850-2c64-4359-b922-de172ab3a4a1
16272024-11-26T05:23:44.603ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7de56ef8-bdda-46b0-a9a9-fa5e97a778c5") failed: Property not found. retry in 918.328062ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_7de56ef8-bdda-46b0-a9a9-fa5e97a778c5
16282024-11-26T05:23:44.625ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f93cace-fd0a-439d-b070-fb3e7a93d785") failed: Property not found. retry in 765.71436ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f93cace-fd0a-439d-b070-fb3e7a93d785
16292024-11-26T05:23:44.712ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e0bf1273-c01d-45a7-81e1-d34f6eb6d99b") failed: Property not found. retry in 1.39752454s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e0bf1273-c01d-45a7-81e1-d34f6eb6d99b
16302024-11-26T05:23:44.786ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ccf769ca-e6aa-41c6-80d6-7f1cfa2a624a") failed: Property not found. retry in 1.34641474s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ccf769ca-e6aa-41c6-80d6-7f1cfa2a624a
16312024-11-26T05:23:44.795ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0cbd328d-2b71-482b-8212-63117b07c620") failed: Property not found. retry in 1.236339125s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0cbd328d-2b71-482b-8212-63117b07c620
16322024-11-26T05:23:44.904ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fd8c0b95-28ad-4b2a-97d9-6778a8a37605") failed: Property not found. retry in 1.154555792s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fd8c0b95-28ad-4b2a-97d9-6778a8a37605
16332024-11-26T05:23:44.913ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a4232f21-0674-457e-97a4-41c6f360d0c1") failed: Property not found. retry in 1.082558124s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a4232f21-0674-457e-97a4-41c6f360d0c1
16342024-11-26T05:23:45.004ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_de715031-fa5a-4cf9-bf82-9cec9db59d81") failed: Property not found. retry in 1.141590562s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_de715031-fa5a-4cf9-bf82-9cec9db59d81
16352024-11-26T05:23:45.017ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_50516551-aadd-4094-86ba-7d3c3018bfd8") failed: Property not found. retry in 1.2486794s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_50516551-aadd-4094-86ba-7d3c3018bfd8
16362024-11-26T05:23:45.153ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_506e6a7b-f08a-43e3-ae23-7818916b2247") failed: Property not found. retry in 1.360536406s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_506e6a7b-f08a-43e3-ae23-7818916b2247
16372024-11-26T05:23:45.160ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_90a408e9-936a-4920-ae45-8ca2dc33ed86") failed: Property not found. retry in 1.045221363s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_90a408e9-936a-4920-ae45-8ca2dc33ed86
16382024-11-26T05:23:45.187ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b0f7327e-9818-4b74-82bf-6f6bf3231db9") failed: Property not found. retry in 1.244429464s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b0f7327e-9818-4b74-82bf-6f6bf3231db9
16392024-11-26T05:23:45.299ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_eea1c48b-e597-47f2-a9c9-8bf328dab7cd") failed: Property not found. retry in 1.487143981s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_eea1c48b-e597-47f2-a9c9-8bf328dab7cd
16402024-11-26T05:23:45.369ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_bbffc850-2c64-4359-b922-de172ab3a4a1") failed: Property not found. retry in 1.343252948s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_bbffc850-2c64-4359-b922-de172ab3a4a1
16412024-11-26T05:23:45.382ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7ea0f6a9-f6ea-4a00-8862-957ae8407d39") failed: Property not found. retry in 1.239613749s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7ea0f6a9-f6ea-4a00-8862-957ae8407d39
16422024-11-26T05:23:45.400ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f93cace-fd0a-439d-b070-fb3e7a93d785") failed: Property not found. retry in 801.895154ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f93cace-fd0a-439d-b070-fb3e7a93d785
16432024-11-26T05:23:45.434ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8b990e0a-1c33-413f-8695-830485958f9e") failed: Property not found. retry in 606.646706ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8b990e0a-1c33-413f-8695-830485958f9e
16442024-11-26T05:23:45.448ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_be1e42ff-fa98-49f3-a5ff-e865a51b0418") failed: Property not found. retry in 1.438086433s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_be1e42ff-fa98-49f3-a5ff-e865a51b0418
16452024-11-26T05:23:45.530ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7de56ef8-bdda-46b0-a9a9-fa5e97a778c5") failed: Property not found. retry in 991.560946ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_7de56ef8-bdda-46b0-a9a9-fa5e97a778c5
16462024-11-26T05:23:45.542ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4e9fd39d-4113-4491-beca-e49e9a07f310") failed: Property not found. retry in 895.891892ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4e9fd39d-4113-4491-beca-e49e9a07f310
16472024-11-26T05:23:45.691ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_c80384a9-167d-483b-9108-3eccbfc759ce: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin-single"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:8123'/> <propval type="astring" name="ch_binary" value='/opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
16482024-11-26T05:23:45.691ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_c80384a9-167d-483b-9108-3eccbfc759ce zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_clickhouse_c80384a9-167d-483b-9108-3eccbfc759ce
16492024-11-26T05:23:45.874ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_c80384a9-167d-483b-9108-3eccbfc759ce") failed: Property not found. retry in 33.677108ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_c80384a9-167d-483b-9108-3eccbfc759ce
16502024-11-26T05:23:45.921ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_c80384a9-167d-483b-9108-3eccbfc759ce") failed: Property not found. retry in 88.632419ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_c80384a9-167d-483b-9108-3eccbfc759ce
16512024-11-26T05:23:46.031ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a4232f21-0674-457e-97a4-41c6f360d0c1") failed: Property not found. retry in 1.314669222s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a4232f21-0674-457e-97a4-41c6f360d0c1
16522024-11-26T05:23:46.058ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_c80384a9-167d-483b-9108-3eccbfc759ce") failed: Property not found. retry in 284.592146ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_c80384a9-167d-483b-9108-3eccbfc759ce
16532024-11-26T05:23:46.069ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8b990e0a-1c33-413f-8695-830485958f9e") failed: Property not found. retry in 1.232886351s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8b990e0a-1c33-413f-8695-830485958f9e
16542024-11-26T05:23:46.080ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0cbd328d-2b71-482b-8212-63117b07c620") failed: Property not found. retry in 627.798369ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0cbd328d-2b71-482b-8212-63117b07c620
16552024-11-26T05:23:46.092ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fd8c0b95-28ad-4b2a-97d9-6778a8a37605") failed: Property not found. retry in 1.008807085s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fd8c0b95-28ad-4b2a-97d9-6778a8a37605
16562024-11-26T05:23:46.133ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e0bf1273-c01d-45a7-81e1-d34f6eb6d99b") failed: Property not found. retry in 773.882773ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e0bf1273-c01d-45a7-81e1-d34f6eb6d99b
16572024-11-26T05:23:46.145ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ccf769ca-e6aa-41c6-80d6-7f1cfa2a624a") failed: Property not found. retry in 1.44363173s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ccf769ca-e6aa-41c6-80d6-7f1cfa2a624a
16582024-11-26T05:23:46.158ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_de715031-fa5a-4cf9-bf82-9cec9db59d81") failed: Property not found. retry in 1.15220985s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_de715031-fa5a-4cf9-bf82-9cec9db59d81
16592024-11-26T05:23:46.215ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f93cace-fd0a-439d-b070-fb3e7a93d785") failed: Property not found. retry in 937.627251ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f93cace-fd0a-439d-b070-fb3e7a93d785
16602024-11-26T05:23:46.230ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_90a408e9-936a-4920-ae45-8ca2dc33ed86") failed: Property not found. retry in 1.375614082s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_90a408e9-936a-4920-ae45-8ca2dc33ed86
16612024-11-26T05:23:46.278ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_50516551-aadd-4094-86ba-7d3c3018bfd8") failed: Property not found. retry in 1.242918056s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_50516551-aadd-4094-86ba-7d3c3018bfd8
16622024-11-26T05:23:46.357ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_c80384a9-167d-483b-9108-3eccbfc759ce") failed: Property not found. retry in 543.270387ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_c80384a9-167d-483b-9108-3eccbfc759ce
16632024-11-26T05:23:46.443ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b0f7327e-9818-4b74-82bf-6f6bf3231db9") failed: Property not found. retry in 1.431248286s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b0f7327e-9818-4b74-82bf-6f6bf3231db9
16642024-11-26T05:23:46.452ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4e9fd39d-4113-4491-beca-e49e9a07f310") failed: Property not found. retry in 1.089359049s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4e9fd39d-4113-4491-beca-e49e9a07f310
16652024-11-26T05:23:46.525ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_506e6a7b-f08a-43e3-ae23-7818916b2247") failed: Property not found. retry in 1.304992226s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_506e6a7b-f08a-43e3-ae23-7818916b2247
16662024-11-26T05:23:46.536ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7de56ef8-bdda-46b0-a9a9-fa5e97a778c5") failed: Property not found. retry in 1.116813241s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_7de56ef8-bdda-46b0-a9a9-fa5e97a778c5
16672024-11-26T05:23:46.631ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7ea0f6a9-f6ea-4a00-8862-957ae8407d39") failed: Property not found. retry in 1.378720362s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7ea0f6a9-f6ea-4a00-8862-957ae8407d39
16682024-11-26T05:23:46.722ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0cbd328d-2b71-482b-8212-63117b07c620") failed: Property not found. retry in 963.32406ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0cbd328d-2b71-482b-8212-63117b07c620
16692024-11-26T05:23:46.735ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_bbffc850-2c64-4359-b922-de172ab3a4a1") failed: Property not found. retry in 1.11492106s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_bbffc850-2c64-4359-b922-de172ab3a4a1
16702024-11-26T05:23:46.801ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_eea1c48b-e597-47f2-a9c9-8bf328dab7cd") failed: Property not found. retry in 1.269423301s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_eea1c48b-e597-47f2-a9c9-8bf328dab7cd
16712024-11-26T05:23:46.900ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_be1e42ff-fa98-49f3-a5ff-e865a51b0418") failed: Property not found. retry in 820.717839ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_be1e42ff-fa98-49f3-a5ff-e865a51b0418
16722024-11-26T05:23:46.916ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_c80384a9-167d-483b-9108-3eccbfc759ce") failed: Property not found. retry in 784.770575ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_c80384a9-167d-483b-9108-3eccbfc759ce
16732024-11-26T05:23:46.930ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e0bf1273-c01d-45a7-81e1-d34f6eb6d99b") failed: Property not found. retry in 687.450184ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e0bf1273-c01d-45a7-81e1-d34f6eb6d99b
16742024-11-26T05:23:47.119ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fd8c0b95-28ad-4b2a-97d9-6778a8a37605") failed: Property not found. retry in 916.666972ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fd8c0b95-28ad-4b2a-97d9-6778a8a37605
16752024-11-26T05:23:47.170ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f93cace-fd0a-439d-b070-fb3e7a93d785") failed: Property not found. retry in 1.403736034s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f93cace-fd0a-439d-b070-fb3e7a93d785
16762024-11-26T05:23:47.324ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8b990e0a-1c33-413f-8695-830485958f9e") failed: Property not found. retry in 1.17249935s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8b990e0a-1c33-413f-8695-830485958f9e
16772024-11-26T05:23:47.341ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_de715031-fa5a-4cf9-bf82-9cec9db59d81") failed: Property not found. retry in 1.307705069s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_de715031-fa5a-4cf9-bf82-9cec9db59d81
16782024-11-26T05:23:47.366ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a4232f21-0674-457e-97a4-41c6f360d0c1") failed: Property not found. retry in 851.029742ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a4232f21-0674-457e-97a4-41c6f360d0c1
16792024-11-26T05:23:47.538ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_50516551-aadd-4094-86ba-7d3c3018bfd8") failed: Property not found. retry in 1.310480681s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_50516551-aadd-4094-86ba-7d3c3018bfd8
16802024-11-26T05:23:47.557ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4e9fd39d-4113-4491-beca-e49e9a07f310") failed: Property not found. retry in 1.286484826s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4e9fd39d-4113-4491-beca-e49e9a07f310
16812024-11-26T05:23:47.610ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ccf769ca-e6aa-41c6-80d6-7f1cfa2a624a") failed: Property not found. retry in 1.129547969s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ccf769ca-e6aa-41c6-80d6-7f1cfa2a624a
16822024-11-26T05:23:47.642ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_90a408e9-936a-4920-ae45-8ca2dc33ed86") failed: Property not found. retry in 631.999527ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_90a408e9-936a-4920-ae45-8ca2dc33ed86
16832024-11-26T05:23:47.666ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e0bf1273-c01d-45a7-81e1-d34f6eb6d99b") failed: Property not found. retry in 1.134787294s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e0bf1273-c01d-45a7-81e1-d34f6eb6d99b
16842024-11-26T05:23:47.687ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7de56ef8-bdda-46b0-a9a9-fa5e97a778c5") failed: Property not found. retry in 1.316240948s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_7de56ef8-bdda-46b0-a9a9-fa5e97a778c5
16852024-11-26T05:23:47.711ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0cbd328d-2b71-482b-8212-63117b07c620") failed: Property not found. retry in 1.380864197s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0cbd328d-2b71-482b-8212-63117b07c620
16862024-11-26T05:23:47.731ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_c80384a9-167d-483b-9108-3eccbfc759ce") failed: Property not found. retry in 807.379751ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_c80384a9-167d-483b-9108-3eccbfc759ce
16872024-11-26T05:23:47.751ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_be1e42ff-fa98-49f3-a5ff-e865a51b0418") failed: Property not found. retry in 1.010771467s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_be1e42ff-fa98-49f3-a5ff-e865a51b0418
16882024-11-26T05:23:47.849ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_506e6a7b-f08a-43e3-ae23-7818916b2247") failed: Property not found. retry in 575.802433ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_506e6a7b-f08a-43e3-ae23-7818916b2247
16892024-11-26T05:23:47.867ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_bbffc850-2c64-4359-b922-de172ab3a4a1") failed: Property not found. retry in 778.495547ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_bbffc850-2c64-4359-b922-de172ab3a4a1
16902024-11-26T05:23:47.891ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b0f7327e-9818-4b74-82bf-6f6bf3231db9") failed: Property not found. retry in 1.254363609s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b0f7327e-9818-4b74-82bf-6f6bf3231db9
16912024-11-26T05:23:48.026ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7ea0f6a9-f6ea-4a00-8862-957ae8407d39") failed: Property not found. retry in 726.284224ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7ea0f6a9-f6ea-4a00-8862-957ae8407d39
16922024-11-26T05:23:48.050ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fd8c0b95-28ad-4b2a-97d9-6778a8a37605") failed: Property not found. retry in 904.78392ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fd8c0b95-28ad-4b2a-97d9-6778a8a37605
16932024-11-26T05:23:48.086ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_eea1c48b-e597-47f2-a9c9-8bf328dab7cd") failed: Property not found. retry in 551.576703ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_eea1c48b-e597-47f2-a9c9-8bf328dab7cd
16942024-11-26T05:23:48.236ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a4232f21-0674-457e-97a4-41c6f360d0c1") failed: Property not found. retry in 1.07228733s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a4232f21-0674-457e-97a4-41c6f360d0c1
16952024-11-26T05:23:48.289ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_90a408e9-936a-4920-ae45-8ca2dc33ed86") failed: Property not found. retry in 1.158390649s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_90a408e9-936a-4920-ae45-8ca2dc33ed86
16962024-11-26T05:23:48.439ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_506e6a7b-f08a-43e3-ae23-7818916b2247") failed: Property not found. retry in 815.079997ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_506e6a7b-f08a-43e3-ae23-7818916b2247
16972024-11-26T05:23:48.511ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8b990e0a-1c33-413f-8695-830485958f9e") failed: Property not found. retry in 749.100357ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8b990e0a-1c33-413f-8695-830485958f9e
16982024-11-26T05:23:48.552ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_c80384a9-167d-483b-9108-3eccbfc759ce") failed: Property not found. retry in 674.9147ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_c80384a9-167d-483b-9108-3eccbfc759ce
16992024-11-26T05:23:48.587ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f93cace-fd0a-439d-b070-fb3e7a93d785") failed: Property not found. retry in 930.07086ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f93cace-fd0a-439d-b070-fb3e7a93d785
17002024-11-26T05:23:48.648ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_eea1c48b-e597-47f2-a9c9-8bf328dab7cd") failed: Property not found. retry in 1.024479292s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_eea1c48b-e597-47f2-a9c9-8bf328dab7cd
17012024-11-26T05:23:48.658ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_bbffc850-2c64-4359-b922-de172ab3a4a1") failed: Property not found. retry in 1.383441189s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_bbffc850-2c64-4359-b922-de172ab3a4a1
17022024-11-26T05:23:48.669ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_de715031-fa5a-4cf9-bf82-9cec9db59d81") failed: Property not found. retry in 1.499230134s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_de715031-fa5a-4cf9-bf82-9cec9db59d81
17032024-11-26T05:23:48.752ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ccf769ca-e6aa-41c6-80d6-7f1cfa2a624a") failed: Property not found. retry in 972.142288ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ccf769ca-e6aa-41c6-80d6-7f1cfa2a624a
17042024-11-26T05:23:48.762ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7ea0f6a9-f6ea-4a00-8862-957ae8407d39") failed: Property not found. retry in 586.496415ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7ea0f6a9-f6ea-4a00-8862-957ae8407d39
17052024-11-26T05:23:48.772ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_be1e42ff-fa98-49f3-a5ff-e865a51b0418") failed: Property not found. retry in 834.068668ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_be1e42ff-fa98-49f3-a5ff-e865a51b0418
17062024-11-26T05:23:48.811ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e0bf1273-c01d-45a7-81e1-d34f6eb6d99b") failed: Property not found. retry in 936.44834ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e0bf1273-c01d-45a7-81e1-d34f6eb6d99b
17072024-11-26T05:23:48.854ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4e9fd39d-4113-4491-beca-e49e9a07f310") failed: Property not found. retry in 1.320926389s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4e9fd39d-4113-4491-beca-e49e9a07f310
17082024-11-26T05:23:48.864ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_50516551-aadd-4094-86ba-7d3c3018bfd8") failed: Property not found. retry in 980.106434ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_50516551-aadd-4094-86ba-7d3c3018bfd8
17092024-11-26T05:23:48.968ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fd8c0b95-28ad-4b2a-97d9-6778a8a37605") failed: Property not found. retry in 1.360767171s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fd8c0b95-28ad-4b2a-97d9-6778a8a37605
17102024-11-26T05:23:49.016ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7de56ef8-bdda-46b0-a9a9-fa5e97a778c5") failed: Property not found. retry in 1.27073445s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_7de56ef8-bdda-46b0-a9a9-fa5e97a778c5
17112024-11-26T05:23:49.104ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0cbd328d-2b71-482b-8212-63117b07c620") failed: Property not found. retry in 1.117482287s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0cbd328d-2b71-482b-8212-63117b07c620
17122024-11-26T05:23:49.156ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b0f7327e-9818-4b74-82bf-6f6bf3231db9") failed: Property not found. retry in 1.190237526s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b0f7327e-9818-4b74-82bf-6f6bf3231db9
17132024-11-26T05:23:49.237ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_c80384a9-167d-483b-9108-3eccbfc759ce") failed: Property not found. retry in 1.363729955s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_c80384a9-167d-483b-9108-3eccbfc759ce
17142024-11-26T05:23:49.263ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_506e6a7b-f08a-43e3-ae23-7818916b2247") failed: Property not found. retry in 1.487837197s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_506e6a7b-f08a-43e3-ae23-7818916b2247
17152024-11-26T05:23:49.274ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8b990e0a-1c33-413f-8695-830485958f9e") failed: Property not found. retry in 1.206249561s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8b990e0a-1c33-413f-8695-830485958f9e
17162024-11-26T05:23:49.321ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a4232f21-0674-457e-97a4-41c6f360d0c1") failed: Property not found. retry in 1.475965015s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a4232f21-0674-457e-97a4-41c6f360d0c1
17172024-11-26T05:23:49.361ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7ea0f6a9-f6ea-4a00-8862-957ae8407d39") failed: Property not found. retry in 570.355099ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7ea0f6a9-f6ea-4a00-8862-957ae8407d39
17182024-11-26T05:23:49.459ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_90a408e9-936a-4920-ae45-8ca2dc33ed86") failed: Property not found. retry in 864.250211ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_90a408e9-936a-4920-ae45-8ca2dc33ed86
17192024-11-26T05:23:49.529ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f93cace-fd0a-439d-b070-fb3e7a93d785") failed: Property not found. retry in 929.385659ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f93cace-fd0a-439d-b070-fb3e7a93d785
17202024-11-26T05:23:49.619ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_be1e42ff-fa98-49f3-a5ff-e865a51b0418") failed: Property not found. retry in 1.043339357s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_be1e42ff-fa98-49f3-a5ff-e865a51b0418
17212024-11-26T05:23:49.686ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_eea1c48b-e597-47f2-a9c9-8bf328dab7cd") failed: Property not found. retry in 1.446270549s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_eea1c48b-e597-47f2-a9c9-8bf328dab7cd
17222024-11-26T05:23:49.738ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ccf769ca-e6aa-41c6-80d6-7f1cfa2a624a") failed: Property not found. retry in 616.678039ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ccf769ca-e6aa-41c6-80d6-7f1cfa2a624a
17232024-11-26T05:23:49.762ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e0bf1273-c01d-45a7-81e1-d34f6eb6d99b") failed: Property not found. retry in 564.700975ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e0bf1273-c01d-45a7-81e1-d34f6eb6d99b
17242024-11-26T05:23:49.857ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_50516551-aadd-4094-86ba-7d3c3018bfd8") failed: Property not found. retry in 949.737818ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_50516551-aadd-4094-86ba-7d3c3018bfd8
17252024-11-26T05:23:49.943ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7ea0f6a9-f6ea-4a00-8862-957ae8407d39") failed: Property not found. retry in 827.435426ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7ea0f6a9-f6ea-4a00-8862-957ae8407d39
17262024-11-26T05:23:50.059ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_bbffc850-2c64-4359-b922-de172ab3a4a1") failed: Property not found. retry in 737.508376ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_bbffc850-2c64-4359-b922-de172ab3a4a1
17272024-11-26T05:23:50.184ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_de715031-fa5a-4cf9-bf82-9cec9db59d81") failed: Property not found. retry in 505.25369ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_de715031-fa5a-4cf9-bf82-9cec9db59d81
17282024-11-26T05:23:50.198ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4e9fd39d-4113-4491-beca-e49e9a07f310") failed: Property not found. retry in 1.082132681s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4e9fd39d-4113-4491-beca-e49e9a07f310
17292024-11-26T05:23:50.235ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0cbd328d-2b71-482b-8212-63117b07c620") failed: Property not found. retry in 1.007530511s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0cbd328d-2b71-482b-8212-63117b07c620
17302024-11-26T05:23:50.299ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7de56ef8-bdda-46b0-a9a9-fa5e97a778c5") failed: Property not found. retry in 1.32457354s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_7de56ef8-bdda-46b0-a9a9-fa5e97a778c5
17312024-11-26T05:23:50.334ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_90a408e9-936a-4920-ae45-8ca2dc33ed86") failed: Property not found. retry in 1.418616857s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_90a408e9-936a-4920-ae45-8ca2dc33ed86
17322024-11-26T05:23:50.345ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e0bf1273-c01d-45a7-81e1-d34f6eb6d99b") failed: Property not found. retry in 1.202623515s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e0bf1273-c01d-45a7-81e1-d34f6eb6d99b
17332024-11-26T05:23:50.355ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fd8c0b95-28ad-4b2a-97d9-6778a8a37605") failed: Property not found. retry in 1.445650056s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fd8c0b95-28ad-4b2a-97d9-6778a8a37605
17342024-11-26T05:23:50.366ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b0f7327e-9818-4b74-82bf-6f6bf3231db9") failed: Property not found. retry in 1.438588166s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b0f7327e-9818-4b74-82bf-6f6bf3231db9
17352024-11-26T05:23:50.379ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ccf769ca-e6aa-41c6-80d6-7f1cfa2a624a") failed: Property not found. retry in 791.032418ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ccf769ca-e6aa-41c6-80d6-7f1cfa2a624a
17362024-11-26T05:23:50.471ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f93cace-fd0a-439d-b070-fb3e7a93d785") failed: Property not found. retry in 692.044183ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f93cace-fd0a-439d-b070-fb3e7a93d785
17372024-11-26T05:23:50.498ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8b990e0a-1c33-413f-8695-830485958f9e") failed: Property not found. retry in 1.087939307s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8b990e0a-1c33-413f-8695-830485958f9e
17382024-11-26T05:23:50.615ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_c80384a9-167d-483b-9108-3eccbfc759ce") failed: Property not found. retry in 1.458697057s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_c80384a9-167d-483b-9108-3eccbfc759ce
17392024-11-26T05:23:50.678ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_be1e42ff-fa98-49f3-a5ff-e865a51b0418") failed: Property not found. retry in 613.175358ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_be1e42ff-fa98-49f3-a5ff-e865a51b0418
17402024-11-26T05:23:50.701ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_de715031-fa5a-4cf9-bf82-9cec9db59d81") failed: Property not found. retry in 1.339601166s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_de715031-fa5a-4cf9-bf82-9cec9db59d81
17412024-11-26T05:23:50.765ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_506e6a7b-f08a-43e3-ae23-7818916b2247") failed: Property not found. retry in 1.186079127s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_506e6a7b-f08a-43e3-ae23-7818916b2247
17422024-11-26T05:23:50.784ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7ea0f6a9-f6ea-4a00-8862-957ae8407d39") failed: Property not found. retry in 1.318298778s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7ea0f6a9-f6ea-4a00-8862-957ae8407d39
17432024-11-26T05:23:50.808ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_bbffc850-2c64-4359-b922-de172ab3a4a1") failed: Property not found. retry in 702.434199ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_bbffc850-2c64-4359-b922-de172ab3a4a1
17442024-11-26T05:23:50.823ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a4232f21-0674-457e-97a4-41c6f360d0c1") failed: Property not found. retry in 1.465152216s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a4232f21-0674-457e-97a4-41c6f360d0c1
17452024-11-26T05:23:50.835ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_50516551-aadd-4094-86ba-7d3c3018bfd8") failed: Property not found. retry in 594.834034ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_50516551-aadd-4094-86ba-7d3c3018bfd8
17462024-11-26T05:23:51.150ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_eea1c48b-e597-47f2-a9c9-8bf328dab7cd") failed: Property not found. retry in 908.324007ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_eea1c48b-e597-47f2-a9c9-8bf328dab7cd
17472024-11-26T05:23:51.183ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f93cace-fd0a-439d-b070-fb3e7a93d785") failed: Property not found. retry in 1.432164296s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f93cace-fd0a-439d-b070-fb3e7a93d785
17482024-11-26T05:23:51.197ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ccf769ca-e6aa-41c6-80d6-7f1cfa2a624a") failed: Property not found. retry in 869.61157ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ccf769ca-e6aa-41c6-80d6-7f1cfa2a624a
17492024-11-26T05:23:51.258ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0cbd328d-2b71-482b-8212-63117b07c620") failed: Property not found. retry in 1.485197529s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0cbd328d-2b71-482b-8212-63117b07c620
17502024-11-26T05:23:51.294ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4e9fd39d-4113-4491-beca-e49e9a07f310") failed: Property not found. retry in 1.03076599s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4e9fd39d-4113-4491-beca-e49e9a07f310
17512024-11-26T05:23:51.309ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_be1e42ff-fa98-49f3-a5ff-e865a51b0418") failed: Property not found. retry in 1.395874831s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_be1e42ff-fa98-49f3-a5ff-e865a51b0418
17522024-11-26T05:23:51.448ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_50516551-aadd-4094-86ba-7d3c3018bfd8") failed: Property not found. retry in 697.791289ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_50516551-aadd-4094-86ba-7d3c3018bfd8
17532024-11-26T05:23:51.524ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_bbffc850-2c64-4359-b922-de172ab3a4a1") failed: Property not found. retry in 774.355866ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_bbffc850-2c64-4359-b922-de172ab3a4a1
17542024-11-26T05:23:51.571ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e0bf1273-c01d-45a7-81e1-d34f6eb6d99b") failed: Property not found. retry in 1.151035093s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e0bf1273-c01d-45a7-81e1-d34f6eb6d99b
17552024-11-26T05:23:51.604ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8b990e0a-1c33-413f-8695-830485958f9e") failed: Property not found. retry in 942.064895ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8b990e0a-1c33-413f-8695-830485958f9e
17562024-11-26T05:23:51.639ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7de56ef8-bdda-46b0-a9a9-fa5e97a778c5") failed: Property not found. retry in 719.799603ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_7de56ef8-bdda-46b0-a9a9-fa5e97a778c5
17572024-11-26T05:23:51.779ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 74.773506594s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
17582024-11-26T05:23:51.820ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fd8c0b95-28ad-4b2a-97d9-6778a8a37605") failed: Property not found. retry in 1.477792151s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fd8c0b95-28ad-4b2a-97d9-6778a8a37605
17592024-11-26T05:23:51.964ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_506e6a7b-f08a-43e3-ae23-7818916b2247") failed: Property not found. retry in 1.241448351s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_506e6a7b-f08a-43e3-ae23-7818916b2247
17602024-11-26T05:23:52.054ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_de715031-fa5a-4cf9-bf82-9cec9db59d81") failed: Property not found. retry in 1.256224871s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_de715031-fa5a-4cf9-bf82-9cec9db59d81
17612024-11-26T05:23:52.069ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_eea1c48b-e597-47f2-a9c9-8bf328dab7cd") failed: Property not found. retry in 1.201341854s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_eea1c48b-e597-47f2-a9c9-8bf328dab7cd
17622024-11-26T05:23:52.085ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ccf769ca-e6aa-41c6-80d6-7f1cfa2a624a") failed: Property not found. retry in 592.973316ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ccf769ca-e6aa-41c6-80d6-7f1cfa2a624a
17632024-11-26T05:23:52.098ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_c80384a9-167d-483b-9108-3eccbfc759ce") failed: Property not found. retry in 1.249167518s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_c80384a9-167d-483b-9108-3eccbfc759ce
17642024-11-26T05:23:52.157ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_50516551-aadd-4094-86ba-7d3c3018bfd8") failed: Property not found. retry in 636.05978ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_50516551-aadd-4094-86ba-7d3c3018bfd8
17652024-11-26T05:23:52.299ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a4232f21-0674-457e-97a4-41c6f360d0c1") failed: Property not found. retry in 783.632964ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a4232f21-0674-457e-97a4-41c6f360d0c1
17662024-11-26T05:23:52.308ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_bbffc850-2c64-4359-b922-de172ab3a4a1") failed: Property not found. retry in 801.931165ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_bbffc850-2c64-4359-b922-de172ab3a4a1
17672024-11-26T05:23:52.335ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4e9fd39d-4113-4491-beca-e49e9a07f310") failed: Property not found. retry in 1.130470699s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4e9fd39d-4113-4491-beca-e49e9a07f310
17682024-11-26T05:23:52.368ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7de56ef8-bdda-46b0-a9a9-fa5e97a778c5") failed: Property not found. retry in 1.374631745s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_7de56ef8-bdda-46b0-a9a9-fa5e97a778c5
17692024-11-26T05:23:52.560ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8b990e0a-1c33-413f-8695-830485958f9e") failed: Property not found. retry in 1.124093882s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8b990e0a-1c33-413f-8695-830485958f9e
17702024-11-26T05:23:52.626ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f93cace-fd0a-439d-b070-fb3e7a93d785") failed: Property not found. retry in 1.099162416s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f93cace-fd0a-439d-b070-fb3e7a93d785
17712024-11-26T05:23:52.691ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ccf769ca-e6aa-41c6-80d6-7f1cfa2a624a") failed: Property not found. retry in 645.513669ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ccf769ca-e6aa-41c6-80d6-7f1cfa2a624a
17722024-11-26T05:23:52.720ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_be1e42ff-fa98-49f3-a5ff-e865a51b0418") failed: Property not found. retry in 655.224164ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_be1e42ff-fa98-49f3-a5ff-e865a51b0418
17732024-11-26T05:23:52.739ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e0bf1273-c01d-45a7-81e1-d34f6eb6d99b") failed: Property not found. retry in 1.147309203s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e0bf1273-c01d-45a7-81e1-d34f6eb6d99b
17742024-11-26T05:23:52.810ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_50516551-aadd-4094-86ba-7d3c3018bfd8") failed: Property not found. retry in 1.09501104s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_50516551-aadd-4094-86ba-7d3c3018bfd8
17752024-11-26T05:23:53.363ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ccf769ca-e6aa-41c6-80d6-7f1cfa2a624a") failed: Property not found. retry in 1.310791819s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ccf769ca-e6aa-41c6-80d6-7f1cfa2a624a
17762024-11-26T05:23:53.481ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_c80384a9-167d-483b-9108-3eccbfc759ce") failed: Property not found. retry in 767.031428ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_c80384a9-167d-483b-9108-3eccbfc759ce
17772024-11-26T05:23:54.271ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_c80384a9-167d-483b-9108-3eccbfc759ce") failed: Property not found. retry in 1.447611692s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_c80384a9-167d-483b-9108-3eccbfc759ce
17782024-11-26T05:23:55.762ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3311 zone = oxz_crucible_pantry_7ea0f6a9-f6ea-4a00-8862-957ae8407d39
17792024-11-26T05:23:55.762ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3311 zone = oxz_crucible_6f93cace-fd0a-439d-b070-fb3e7a93d785
17802024-11-26T05:23:55.762ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3311 zone = oxz_crucible_506e6a7b-f08a-43e3-ae23-7818916b2247
17812024-11-26T05:23:55.762ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3311 zone = oxz_external_dns_4e9fd39d-4113-4491-beca-e49e9a07f310
17822024-11-26T05:23:55.762ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3311 zone = oxz_crucible_pantry_bbffc850-2c64-4359-b922-de172ab3a4a1
17832024-11-26T05:23:55.762ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3311 zone = oxz_crucible_8b990e0a-1c33-413f-8695-830485958f9e
17842024-11-26T05:23:55.762ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3311 zone = oxz_oximeter_a4232f21-0674-457e-97a4-41c6f360d0c1
17852024-11-26T05:23:55.762ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3311 zone = oxz_crucible_e0bf1273-c01d-45a7-81e1-d34f6eb6d99b
17862024-11-26T05:23:55.762ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3311 zone = oxz_crucible_0cbd328d-2b71-482b-8212-63117b07c620
17872024-11-26T05:23:55.762ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3311 zone = oxz_crucible_be1e42ff-fa98-49f3-a5ff-e865a51b0418
17882024-11-26T05:23:55.762ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3311 zone = oxz_crucible_fd8c0b95-28ad-4b2a-97d9-6778a8a37605
17892024-11-26T05:23:55.762ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3311 zone = oxz_nexus_eea1c48b-e597-47f2-a9c9-8bf328dab7cd
17902024-11-26T05:23:55.762ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3311 zone = oxz_clickhouse_c80384a9-167d-483b-9108-3eccbfc759ce
17912024-11-26T05:23:55.762ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3311 zone = oxz_crucible_90a408e9-936a-4920-ae45-8ca2dc33ed86
17922024-11-26T05:23:55.762ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3311 zone = oxz_crucible_pantry_b0f7327e-9818-4b74-82bf-6f6bf3231db9
17932024-11-26T05:23:55.762ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3311 zone = oxz_crucible_50516551-aadd-4094-86ba-7d3c3018bfd8
17942024-11-26T05:23:55.762ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3311 zone = oxz_external_dns_7de56ef8-bdda-46b0-a9a9-fa5e97a778c5
17952024-11-26T05:23:55.762ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3311 zone = oxz_nexus_ccf769ca-e6aa-41c6-80d6-7f1cfa2a624a
17962024-11-26T05:23:55.762ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3311 zone = oxz_nexus_de715031-fa5a-4cf9-bf82-9cec9db59d81
17972024-11-26T05:23:55.763ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/8488adc3-a35c-4d33-bd61-39dfc8c64c55/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
17982024-11-26T05:23:55.767ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/e4c38366-5212-46e4-b3d0-f797c1f6a6ba/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
17992024-11-26T05:23:55.770ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44678796 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:33774 req_id = f9b7e849-4708-4f67-8cb8-b17c068f8fb1 response_code = 204 uri = /omicron-zones
18002024-11-26T05:23:55.778ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1448
18012024-11-26T05:23:55.779ZINFOSledAgent (RSS): Writing ledger to /pool/int/8488adc3-a35c-4d33-bd61-39dfc8c64c55/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
18022024-11-26T05:23:55.779ZINFOSledAgent (RSS): Writing ledger to /pool/int/e4c38366-5212-46e4-b3d0-f797c1f6a6ba/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
18032024-11-26T05:23:55.917ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:787
18042024-11-26T05:23:55.922ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::a]:12221 file = sled-agent/src/rack_setup/service.rs:799
18052024-11-26T05:23:55.962ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, rib_priority: None, vlan_id: None, }, ], switch: Switch0, tx_eq: None, uplink_port_fec: Some( None, ), uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:1013
18062024-11-26T05:23:56.069ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8) file = sled-agent/src/probe_manager.rs:231 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
18072024-11-26T05:23:56.069ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8) file = sled-agent/src/nexus.rs:527 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
18082024-11-26T05:23:56.161ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/265eda97-f99d-4cd1-9b37-bd40395069c1/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
18092024-11-26T05:23:56.230ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/265eda97-f99d-4cd1-9b37-bd40395069c1/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
18102024-11-26T05:23:56.390ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/265eda97-f99d-4cd1-9b37-bd40395069c1/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
18112024-11-26T05:23:56.581ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/265eda97-f99d-4cd1-9b37-bd40395069c1/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
18122024-11-26T05:23:56.804ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/265eda97-f99d-4cd1-9b37-bd40395069c1/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
18132024-11-26T05:23:56.842ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8) file = sled-agent/src/nexus.rs:527 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
18142024-11-26T05:23:57.072ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8) file = sled-agent/src/probe_manager.rs:231 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
18152024-11-26T05:23:57.084ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/265eda97-f99d-4cd1-9b37-bd40395069c1/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
18162024-11-26T05:23:57.423ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/265eda97-f99d-4cd1-9b37-bd40395069c1/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
18172024-11-26T05:23:57.639ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/265eda97-f99d-4cd1-9b37-bd40395069c1/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
18182024-11-26T05:23:57.981ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/265eda97-f99d-4cd1-9b37-bd40395069c1/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
18192024-11-26T05:23:58.074ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8) file = sled-agent/src/probe_manager.rs:231 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
18202024-11-26T05:23:58.482ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/265eda97-f99d-4cd1-9b37-bd40395069c1/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
18212024-11-26T05:23:58.837ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8) file = sled-agent/src/nexus.rs:527 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
18222024-11-26T05:23:59.075ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8) file = sled-agent/src/probe_manager.rs:231 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
18232024-11-26T05:23:59.247ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/265eda97-f99d-4cd1-9b37-bd40395069c1/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
18242024-11-26T05:23:59.680ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/265eda97-f99d-4cd1-9b37-bd40395069c1/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
18252024-11-26T05:24:01.235ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "5e3f095c-8a65-49bd-b3b5-bfe9132b9787", "content-length": "173", "date": "Tue, 26 Nov 2024 05:24:00 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"265eda97-f99d-4cd1-9b37-bd40395069c1\"", request_id: "5e3f095c-8a65-49bd-b3b5-bfe9132b9787" } file = sled-agent/src/rack_setup/service.rs:1075
18262024-11-26T05:24:02.542ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "3f8404c5-38b3-46dd-9bf7-0f975d12c2f3", "content-length": "173", "date": "Tue, 26 Nov 2024 05:24:02 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"265eda97-f99d-4cd1-9b37-bd40395069c1\"", request_id: "3f8404c5-38b3-46dd-9bf7-0f975d12c2f3" } file = sled-agent/src/rack_setup/service.rs:1075
18272024-11-26T05:24:03.019ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:500 new_generation = 1 old_generation = 1 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
18282024-11-26T05:24:03.135ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35440
18292024-11-26T05:24:03.138ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2185 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35440 req_id = debd70d3-3943-4bf2-8844-a14e8bbf4aae response_code = 200 uri = /vpc-routes
18302024-11-26T05:24:03.144ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56973
18312024-11-26T05:24:03.146ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
18322024-11-26T05:24:03.146ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
18332024-11-26T05:24:03.147ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8488adc3-a35c-4d33-bd61-39dfc8c64c55/config/omicron-zones.json file = common/src/ledger.rs:177
18342024-11-26T05:24:03.148ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/e4c38366-5212-46e4-b3d0-f797c1f6a6ba/config/omicron-zones.json file = common/src/ledger.rs:177
18352024-11-26T05:24:03.168ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1b72df9a-7b76-458e-9ee3-3ca99732ea65 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18362024-11-26T05:24:03.168ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_1b72df9a-7b76-458e-9ee3-3ca99732ea65
18372024-11-26T05:24:03.200ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 13de655b-3793-4d59-8bc1-22889b3fb01b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18382024-11-26T05:24:03.200ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_13de655b-3793-4d59-8bc1-22889b3fb01b
18392024-11-26T05:24:03.203ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36158
18402024-11-26T05:24:03.204ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48610
18412024-11-26T05:24:03.204ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36158 req_id = 8ec3f3fb-0926-412c-90a9-0bea3b208a2d response_code = 200 uri = /vpc-routes
18422024-11-26T05:24:03.215ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
18432024-11-26T05:24:03.215ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
18442024-11-26T05:24:03.215ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8488adc3-a35c-4d33-bd61-39dfc8c64c55/config/omicron-zones.json file = common/src/ledger.rs:177
18452024-11-26T05:24:03.220ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/e4c38366-5212-46e4-b3d0-f797c1f6a6ba/config/omicron-zones.json file = common/src/ledger.rs:177
18462024-11-26T05:24:03.229ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 06ee1c63-02b8-46d6-96ed-aa8ab7a8d522 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18472024-11-26T05:24:03.229ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_06ee1c63-02b8-46d6-96ed-aa8ab7a8d522
18482024-11-26T05:24:03.242ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42804
18492024-11-26T05:24:03.247ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1b72df9a-7b76-458e-9ee3-3ca99732ea65 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18502024-11-26T05:24:03.247ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_1b72df9a-7b76-458e-9ee3-3ca99732ea65
18512024-11-26T05:24:03.265ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
18522024-11-26T05:24:03.265ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
18532024-11-26T05:24:03.265ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8488adc3-a35c-4d33-bd61-39dfc8c64c55/config/omicron-zones.json file = common/src/ledger.rs:177
18542024-11-26T05:24:03.270ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65218
18552024-11-26T05:24:03.276ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/e4c38366-5212-46e4-b3d0-f797c1f6a6ba/config/omicron-zones.json file = common/src/ledger.rs:177
18562024-11-26T05:24:03.277ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6291 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65218 req_id = ce9e611a-1dc8-4edb-9d77-e030de3dc831 response_code = 200 uri = /v2p
18572024-11-26T05:24:03.277ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8 values = ExternalIpGatewayMap { mappings: {} }
18582024-11-26T05:24:03.277ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6618 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35440 req_id = 17cd7294-417d-44dc-b672-d54d93562748 response_code = 204 uri = /eip-gateways
18592024-11-26T05:24:03.279ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4fe72516-6144-43ef-96ee-e7fbaeb34f42 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18602024-11-26T05:24:03.279ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_4fe72516-6144-43ef-96ee-e7fbaeb34f42
18612024-11-26T05:24:03.292ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8 values = ExternalIpGatewayMap { mappings: {} }
18622024-11-26T05:24:03.292ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 367 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36158 req_id = 635a7949-1bef-4ebd-9cfa-d8fbff1f460b response_code = 204 uri = /eip-gateways
18632024-11-26T05:24:03.297ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 13de655b-3793-4d59-8bc1-22889b3fb01b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18642024-11-26T05:24:03.297ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_13de655b-3793-4d59-8bc1-22889b3fb01b
18652024-11-26T05:24:03.315ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1b72df9a-7b76-458e-9ee3-3ca99732ea65 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18662024-11-26T05:24:03.315ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_1b72df9a-7b76-458e-9ee3-3ca99732ea65
18672024-11-26T05:24:03.336ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 580c5897-a97f-4c76-9a8f-bf80d62b760e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18682024-11-26T05:24:03.336ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_580c5897-a97f-4c76-9a8f-bf80d62b760e
18692024-11-26T05:24:03.355ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 06ee1c63-02b8-46d6-96ed-aa8ab7a8d522 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18702024-11-26T05:24:03.355ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_06ee1c63-02b8-46d6-96ed-aa8ab7a8d522
18712024-11-26T05:24:03.375ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 62fc8f20-7ce8-489b-a022-013df6640479 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18722024-11-26T05:24:03.375ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_62fc8f20-7ce8-489b-a022-013df6640479
18732024-11-26T05:24:03.390ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 13de655b-3793-4d59-8bc1-22889b3fb01b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18742024-11-26T05:24:03.390ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_13de655b-3793-4d59-8bc1-22889b3fb01b
18752024-11-26T05:24:03.401ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7890 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35440 req_id = d3ee4ee0-d3b8-4eae-9a31-0ca9721c8f4c response_code = 204 uri = /vpc-routes
18762024-11-26T05:24:03.408ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4fe72516-6144-43ef-96ee-e7fbaeb34f42 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18772024-11-26T05:24:03.408ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_4fe72516-6144-43ef-96ee-e7fbaeb34f42
18782024-11-26T05:24:03.419ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53863
18792024-11-26T05:24:03.419ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53863 req_id = 56377c0c-69e9-4dd5-8933-88e9ae77f2d3 response_code = 200 uri = /v2p
18802024-11-26T05:24:03.428ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 06ee1c63-02b8-46d6-96ed-aa8ab7a8d522 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18812024-11-26T05:24:03.428ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_06ee1c63-02b8-46d6-96ed-aa8ab7a8d522
18822024-11-26T05:24:03.445ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: af39775d-5158-4242-88aa-5dd2d3c14817 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18832024-11-26T05:24:03.445ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_af39775d-5158-4242-88aa-5dd2d3c14817
18842024-11-26T05:24:03.462ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 580c5897-a97f-4c76-9a8f-bf80d62b760e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18852024-11-26T05:24:03.462ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_580c5897-a97f-4c76-9a8f-bf80d62b760e
18862024-11-26T05:24:03.481ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9bc99efb-91b7-405a-b8dd-0949d11c1f4a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18872024-11-26T05:24:03.481ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_9bc99efb-91b7-405a-b8dd-0949d11c1f4a
18882024-11-26T05:24:03.491ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:469 new_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 4 } old_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 4 } subnet = RouterId { vni: Vni(100), kind: System }
18892024-11-26T05:24:03.491ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 326 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36158 req_id = 711e69c5-efba-4962-ba95-5f3b9aa31708 response_code = 204 uri = /vpc-routes
18902024-11-26T05:24:03.492ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4fe72516-6144-43ef-96ee-e7fbaeb34f42 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18912024-11-26T05:24:03.492ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_4fe72516-6144-43ef-96ee-e7fbaeb34f42
18922024-11-26T05:24:03.509ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 62fc8f20-7ce8-489b-a022-013df6640479 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18932024-11-26T05:24:03.510ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_62fc8f20-7ce8-489b-a022-013df6640479
18942024-11-26T05:24:03.527ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 580c5897-a97f-4c76-9a8f-bf80d62b760e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18952024-11-26T05:24:03.527ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_580c5897-a97f-4c76-9a8f-bf80d62b760e
18962024-11-26T05:24:03.539ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: da133136-28dd-4eff-a3ed-9f84ec495a60 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18972024-11-26T05:24:03.539ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_da133136-28dd-4eff-a3ed-9f84ec495a60
18982024-11-26T05:24:03.555ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: af39775d-5158-4242-88aa-5dd2d3c14817 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18992024-11-26T05:24:03.556ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_af39775d-5158-4242-88aa-5dd2d3c14817
19002024-11-26T05:24:03.561ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 416452 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56973 req_id = d949bbf7-c81d-48e4-a93d-7b6e1d5bafd5 response_code = 200 uri = /inventory
19012024-11-26T05:24:03.569ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 62fc8f20-7ce8-489b-a022-013df6640479 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19022024-11-26T05:24:03.569ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_62fc8f20-7ce8-489b-a022-013df6640479
19032024-11-26T05:24:03.591ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: af39775d-5158-4242-88aa-5dd2d3c14817 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19042024-11-26T05:24:03.591ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_af39775d-5158-4242-88aa-5dd2d3c14817
19052024-11-26T05:24:03.603ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9bc99efb-91b7-405a-b8dd-0949d11c1f4a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19062024-11-26T05:24:03.603ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_9bc99efb-91b7-405a-b8dd-0949d11c1f4a
19072024-11-26T05:24:03.617ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9bc99efb-91b7-405a-b8dd-0949d11c1f4a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19082024-11-26T05:24:03.618ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_9bc99efb-91b7-405a-b8dd-0949d11c1f4a
19092024-11-26T05:24:03.632ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: da133136-28dd-4eff-a3ed-9f84ec495a60 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19102024-11-26T05:24:03.632ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_da133136-28dd-4eff-a3ed-9f84ec495a60
19112024-11-26T05:24:03.648ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 444043 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48610 req_id = 8938f180-3e94-4dc7-8eaf-61e638461cd0 response_code = 200 uri = /inventory
19122024-11-26T05:24:03.652ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: da133136-28dd-4eff-a3ed-9f84ec495a60 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19132024-11-26T05:24:03.652ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_da133136-28dd-4eff-a3ed-9f84ec495a60
19142024-11-26T05:24:03.666ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 423909 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42804 req_id = 819814c8-4aa3-482a-ad80-adc84df1ed79 response_code = 200 uri = /inventory
19152024-11-26T05:24:05.785ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43903
19162024-11-26T05:24:05.790ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1dbf9b5b-ede3-4cf4-b0d0-091aa188969a, kind: Service { id: 4e9fd39d-4113-4491-beca-e49e9a07f310 }, name: Name("external-dns-4e9fd39d-4113-4491-beca-e49e9a07f310"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 201, 3])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 2f3ae2da-b0e7-4755-a7ae-d54ffe51eccc, kind: Service { id: 7de56ef8-bdda-46b0-a9a9-fa5e97a778c5 }, name: Name("external-dns-7de56ef8-bdda-46b0-a9a9-fa5e97a778c5"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 146])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: afc30658-25b2-44db-9d11-ba075ebc447b, kind: Service { id: de715031-fa5a-4cf9-bf82-9cec9db59d81 }, name: Name("nexus-de715031-fa5a-4cf9-bf82-9cec9db59d81"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 180, 14])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e7b24131-9921-4152-b1bb-f948db445563, kind: Service { id: ccf769ca-e6aa-41c6-80d6-7f1cfa2a624a }, name: Name("nexus-ccf769ca-e6aa-41c6-80d6-7f1cfa2a624a"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 212, 242])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f88dd6c2-772e-44fb-bf3f-d4557d3228a8, kind: Service { id: eea1c48b-e597-47f2-a9c9-8bf328dab7cd }, name: Name("nexus-eea1c48b-e597-47f2-a9c9-8bf328dab7cd"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 159, 25])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
19172024-11-26T05:24:05.790ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19182024-11-26T05:24:05.790ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19192024-11-26T05:24:05.790ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19202024-11-26T05:24:05.790ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19212024-11-26T05:24:05.790ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
19222024-11-26T05:24:05.790ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19232024-11-26T05:24:05.790ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1610 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43903 req_id = a4e90861-97b9-4285-b3a0-6dfbb900e5bd response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
19242024-11-26T05:24:05.791ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:1085
19252024-11-26T05:24:06.069ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49191
19262024-11-26T05:24:06.069ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1dbf9b5b-ede3-4cf4-b0d0-091aa188969a, kind: Service { id: 4e9fd39d-4113-4491-beca-e49e9a07f310 }, name: Name("external-dns-4e9fd39d-4113-4491-beca-e49e9a07f310"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 201, 3])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 2f3ae2da-b0e7-4755-a7ae-d54ffe51eccc, kind: Service { id: 7de56ef8-bdda-46b0-a9a9-fa5e97a778c5 }, name: Name("external-dns-7de56ef8-bdda-46b0-a9a9-fa5e97a778c5"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 146])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: afc30658-25b2-44db-9d11-ba075ebc447b, kind: Service { id: de715031-fa5a-4cf9-bf82-9cec9db59d81 }, name: Name("nexus-de715031-fa5a-4cf9-bf82-9cec9db59d81"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 180, 14])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e7b24131-9921-4152-b1bb-f948db445563, kind: Service { id: ccf769ca-e6aa-41c6-80d6-7f1cfa2a624a }, name: Name("nexus-ccf769ca-e6aa-41c6-80d6-7f1cfa2a624a"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 212, 242])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f88dd6c2-772e-44fb-bf3f-d4557d3228a8, kind: Service { id: eea1c48b-e597-47f2-a9c9-8bf328dab7cd }, name: Name("nexus-eea1c48b-e597-47f2-a9c9-8bf328dab7cd"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 159, 25])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
19272024-11-26T05:24:06.069ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19282024-11-26T05:24:06.069ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19292024-11-26T05:24:06.069ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19302024-11-26T05:24:06.069ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19312024-11-26T05:24:06.069ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
19322024-11-26T05:24:06.069ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19332024-11-26T05:24:06.069ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 247 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49191 req_id = b9574bc8-9ddc-4e6b-b3f5-96136e5d81f2 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
19342024-11-26T05:24:06.194ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55526
19352024-11-26T05:24:06.194ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1dbf9b5b-ede3-4cf4-b0d0-091aa188969a, kind: Service { id: 4e9fd39d-4113-4491-beca-e49e9a07f310 }, name: Name("external-dns-4e9fd39d-4113-4491-beca-e49e9a07f310"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 201, 3])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 2f3ae2da-b0e7-4755-a7ae-d54ffe51eccc, kind: Service { id: 7de56ef8-bdda-46b0-a9a9-fa5e97a778c5 }, name: Name("external-dns-7de56ef8-bdda-46b0-a9a9-fa5e97a778c5"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 146])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: afc30658-25b2-44db-9d11-ba075ebc447b, kind: Service { id: de715031-fa5a-4cf9-bf82-9cec9db59d81 }, name: Name("nexus-de715031-fa5a-4cf9-bf82-9cec9db59d81"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 180, 14])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e7b24131-9921-4152-b1bb-f948db445563, kind: Service { id: ccf769ca-e6aa-41c6-80d6-7f1cfa2a624a }, name: Name("nexus-ccf769ca-e6aa-41c6-80d6-7f1cfa2a624a"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 212, 242])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f88dd6c2-772e-44fb-bf3f-d4557d3228a8, kind: Service { id: eea1c48b-e597-47f2-a9c9-8bf328dab7cd }, name: Name("nexus-eea1c48b-e597-47f2-a9c9-8bf328dab7cd"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 159, 25])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
19362024-11-26T05:24:06.194ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19372024-11-26T05:24:06.194ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19382024-11-26T05:24:06.194ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19392024-11-26T05:24:06.194ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19402024-11-26T05:24:06.194ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
19412024-11-26T05:24:06.194ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19422024-11-26T05:24:06.194ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 224 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55526 req_id = 2c540ad9-7207-43d1-9c04-6e734ced0bdf response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
19432024-11-26T05:24:06.294ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33543
19442024-11-26T05:24:06.294ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
19452024-11-26T05:24:06.294ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
19462024-11-26T05:24:06.294ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8488adc3-a35c-4d33-bd61-39dfc8c64c55/config/omicron-zones.json file = common/src/ledger.rs:177
19472024-11-26T05:24:06.294ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/e4c38366-5212-46e4-b3d0-f797c1f6a6ba/config/omicron-zones.json file = common/src/ledger.rs:177
19482024-11-26T05:24:06.307ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1b72df9a-7b76-458e-9ee3-3ca99732ea65 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19492024-11-26T05:24:06.307ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_1b72df9a-7b76-458e-9ee3-3ca99732ea65
19502024-11-26T05:24:06.332ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 13de655b-3793-4d59-8bc1-22889b3fb01b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19512024-11-26T05:24:06.332ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_13de655b-3793-4d59-8bc1-22889b3fb01b
19522024-11-26T05:24:06.356ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 06ee1c63-02b8-46d6-96ed-aa8ab7a8d522 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19532024-11-26T05:24:06.356ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_06ee1c63-02b8-46d6-96ed-aa8ab7a8d522
19542024-11-26T05:24:06.378ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4fe72516-6144-43ef-96ee-e7fbaeb34f42 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19552024-11-26T05:24:06.378ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_4fe72516-6144-43ef-96ee-e7fbaeb34f42
19562024-11-26T05:24:06.399ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 580c5897-a97f-4c76-9a8f-bf80d62b760e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19572024-11-26T05:24:06.400ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_580c5897-a97f-4c76-9a8f-bf80d62b760e
19582024-11-26T05:24:06.420ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 62fc8f20-7ce8-489b-a022-013df6640479 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19592024-11-26T05:24:06.420ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_62fc8f20-7ce8-489b-a022-013df6640479
19602024-11-26T05:24:06.439ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: af39775d-5158-4242-88aa-5dd2d3c14817 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19612024-11-26T05:24:06.439ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_af39775d-5158-4242-88aa-5dd2d3c14817
19622024-11-26T05:24:06.459ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9bc99efb-91b7-405a-b8dd-0949d11c1f4a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19632024-11-26T05:24:06.460ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_9bc99efb-91b7-405a-b8dd-0949d11c1f4a
19642024-11-26T05:24:06.481ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: da133136-28dd-4eff-a3ed-9f84ec495a60 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19652024-11-26T05:24:06.481ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_da133136-28dd-4eff-a3ed-9f84ec495a60
19662024-11-26T05:24:06.492ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 197798 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33543 req_id = 46ae4932-a605-434d-b8b0-f14279194f57 response_code = 200 uri = /inventory
19672024-11-26T05:24:06.609ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65068
19682024-11-26T05:24:06.609ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1dbf9b5b-ede3-4cf4-b0d0-091aa188969a, kind: Service { id: 4e9fd39d-4113-4491-beca-e49e9a07f310 }, name: Name("external-dns-4e9fd39d-4113-4491-beca-e49e9a07f310"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 201, 3])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 2f3ae2da-b0e7-4755-a7ae-d54ffe51eccc, kind: Service { id: 7de56ef8-bdda-46b0-a9a9-fa5e97a778c5 }, name: Name("external-dns-7de56ef8-bdda-46b0-a9a9-fa5e97a778c5"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 146])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: afc30658-25b2-44db-9d11-ba075ebc447b, kind: Service { id: de715031-fa5a-4cf9-bf82-9cec9db59d81 }, name: Name("nexus-de715031-fa5a-4cf9-bf82-9cec9db59d81"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 180, 14])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e7b24131-9921-4152-b1bb-f948db445563, kind: Service { id: ccf769ca-e6aa-41c6-80d6-7f1cfa2a624a }, name: Name("nexus-ccf769ca-e6aa-41c6-80d6-7f1cfa2a624a"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 212, 242])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f88dd6c2-772e-44fb-bf3f-d4557d3228a8, kind: Service { id: eea1c48b-e597-47f2-a9c9-8bf328dab7cd }, name: Name("nexus-eea1c48b-e597-47f2-a9c9-8bf328dab7cd"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 159, 25])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
19692024-11-26T05:24:06.609ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19702024-11-26T05:24:06.609ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19712024-11-26T05:24:06.609ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19722024-11-26T05:24:06.609ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19732024-11-26T05:24:06.609ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
19742024-11-26T05:24:06.609ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19752024-11-26T05:24:06.609ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 386 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65068 req_id = a32406b9-c0d7-4cdf-aab6-3227ca067746 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
19762024-11-26T05:24:12.470ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:45445
19772024-11-26T05:24:12.470ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:45445 req_id = b347e655-54dc-4659-998b-a65a34650c97 response_code = 200 uri = /baseboard
19782024-11-26T05:24:13.545ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54030
19792024-11-26T05:24:13.545ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54030 req_id = a06d51d1-8d90-4e99-8ad6-0a097fad4612 response_code = 200 uri = /vpc-routes
19802024-11-26T05:24:13.590ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8 values = ExternalIpGatewayMap { mappings: {} }
19812024-11-26T05:24:13.590ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54030 req_id = c6907e43-e3a0-46f3-8797-6ac84a9393cb response_code = 204 uri = /eip-gateways
19822024-11-26T05:24:13.599ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54030 req_id = ffd0ede6-894b-44d5-89da-ff64eb6b3522 response_code = 204 uri = /vpc-routes
19832024-11-26T05:24:32.165ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49884
19842024-11-26T05:24:32.167ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49884 req_id = 5a27897f-9d13-4084-a9da-63c2f65be8ee response_code = 200 uri = /vpc-routes
19852024-11-26T05:24:32.185ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39610
19862024-11-26T05:24:32.186ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39610 req_id = 0ab83f45-d563-4480-ac81-450962e0a7e0 response_code = 200 uri = /v2p
19872024-11-26T05:24:32.229ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8 values = ExternalIpGatewayMap { mappings: {} }
19882024-11-26T05:24:32.229ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49884 req_id = d2fd0735-7cb7-4ac7-a38b-7217df532190 response_code = 204 uri = /eip-gateways
19892024-11-26T05:24:32.240ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49884 req_id = 7bb490c2-2fe3-4830-a20a-f9687ad95c69 response_code = 204 uri = /vpc-routes
19902024-11-26T05:24:32.382ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60771
19912024-11-26T05:24:32.382ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4120
19922024-11-26T05:24:32.474ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4144
19932024-11-26T05:24:32.542ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 159809 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:60771 req_id = 69afd374-b994-4199-b2c3-805754a5de1a response_code = 204 uri = /switch-ports
19942024-11-26T05:24:32.545ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3067 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60771 req_id = 64e88324-814b-4a67-9224-ffc6632c8d4e response_code = 200 uri = /network-bootstore-config
19952024-11-26T05:24:32.572ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
19962024-11-26T05:24:32.572ZINFOSledAgent (bootstore): Writing ledger to /pool/int/8488adc3-a35c-4d33-bd61-39dfc8c64c55/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
19972024-11-26T05:24:32.573ZINFOSledAgent (bootstore): Writing ledger to /pool/int/e4c38366-5212-46e4-b3d0-f797c1f6a6ba/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
19982024-11-26T05:24:32.574ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
19992024-11-26T05:24:32.574ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3721 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60771 req_id = cc2aaad5-a737-4550-afa9-84ece028ad92 response_code = 204 uri = /network-bootstore-config
20002024-11-26T05:24:32.956ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58861
20012024-11-26T05:24:32.956ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58861 req_id = 9a3d4d0e-1968-4435-919a-2dc5b4101396 response_code = 200 uri = /vpc-routes
20022024-11-26T05:24:33.047ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8 values = ExternalIpGatewayMap { mappings: {} }
20032024-11-26T05:24:33.047ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58861 req_id = e88eae66-1327-4914-814b-a41dcaa3961a response_code = 204 uri = /eip-gateways
20042024-11-26T05:24:33.093ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52684
20052024-11-26T05:24:33.093ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52684 req_id = f8a53fa5-1cd6-47e4-ba81-b76b09149d11 response_code = 200 uri = /v2p
20062024-11-26T05:24:33.101ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58861 req_id = 66b6f020-4b18-4a61-854d-81ad72b4fb5a response_code = 204 uri = /vpc-routes
20072024-11-26T05:24:33.189ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60931
20082024-11-26T05:24:33.189ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4120
20092024-11-26T05:24:33.225ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4144
20102024-11-26T05:24:33.279ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90302 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:60931 req_id = 6c0f813d-330e-40f7-95e7-e1d68be0be71 response_code = 204 uri = /switch-ports
20112024-11-26T05:24:33.280ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43356
20122024-11-26T05:24:33.280ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43356 req_id = dbc70f82-5327-4a2b-bbf4-bd30c48c2873 response_code = 200 uri = /vpc-routes
20132024-11-26T05:24:33.280ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60931 req_id = 8847a9be-9e43-4714-ad8b-de85b1e3876d response_code = 200 uri = /network-bootstore-config
20142024-11-26T05:24:33.335ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8 values = ExternalIpGatewayMap { mappings: {} }
20152024-11-26T05:24:33.335ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43356 req_id = a2ff8280-a23f-4ae2-a7cf-3665cd6bb0f8 response_code = 204 uri = /eip-gateways
20162024-11-26T05:24:33.348ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58009
20172024-11-26T05:24:33.348ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4120
20182024-11-26T05:24:33.389ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4144
20192024-11-26T05:24:33.441ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92840 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:58009 req_id = ed1709be-22e7-4e30-a482-92e4957a0c4e response_code = 204 uri = /switch-ports
20202024-11-26T05:24:33.441ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 235 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58009 req_id = 1de5d16a-3309-4a8f-ab08-d966bf04e202 response_code = 200 uri = /network-bootstore-config
20212024-11-26T05:24:33.441ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 274 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43356 req_id = a276e28a-97a1-48d2-a7b2-e40907c03065 response_code = 204 uri = /vpc-routes
20222024-11-26T05:24:33.497ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36766
20232024-11-26T05:24:33.498ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 207 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36766 req_id = 248e4a0c-2879-4cfe-8f6a-96ebae52387c response_code = 200 uri = /v2p
20242024-11-26T05:24:42.517ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:42443
20252024-11-26T05:24:42.518ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:42443 req_id = f6b87ac8-48b1-48b5-8b88-9fb2f58ed399 response_code = 200 uri = /baseboard
20262024-11-26T05:25:02.259ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58206
20272024-11-26T05:25:02.259ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58206 req_id = 751f6deb-ee16-4d91-ae68-0f67f9ffef13 response_code = 200 uri = /vpc-routes
20282024-11-26T05:25:02.291ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8 values = ExternalIpGatewayMap { mappings: {} }
20292024-11-26T05:25:02.291ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58206 req_id = 660f6452-5cd3-4517-b336-32972e58e095 response_code = 204 uri = /eip-gateways
20302024-11-26T05:25:02.301ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 199 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58206 req_id = 574ad0f5-45a3-49fd-9b7c-09af3e1d6014 response_code = 204 uri = /vpc-routes
20312024-11-26T05:25:02.427ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35880
20322024-11-26T05:25:02.427ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35880 req_id = 9fae7c57-58ce-4fc3-8231-a18eea69b6d8 response_code = 200 uri = /v2p
20332024-11-26T05:25:02.525ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40972
20342024-11-26T05:25:02.525ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4120
20352024-11-26T05:25:02.562ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4144
20362024-11-26T05:25:02.613ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87872 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:40972 req_id = b3890e0b-753c-4d3d-9fba-8b79b05ceb98 response_code = 204 uri = /switch-ports
20372024-11-26T05:25:02.613ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40972 req_id = 97a4bc53-6963-4fc6-bdf8-f07449f7545d response_code = 200 uri = /network-bootstore-config
20382024-11-26T05:25:03.063ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49319
20392024-11-26T05:25:03.064ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49319 req_id = d5ea8de6-7663-4627-af9a-3103912e7f82 response_code = 200 uri = /vpc-routes
20402024-11-26T05:25:03.084ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8 values = ExternalIpGatewayMap { mappings: {} }
20412024-11-26T05:25:03.084ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49319 req_id = bf692d1f-05fa-4543-a2d4-a2bae1b8f547 response_code = 204 uri = /eip-gateways
20422024-11-26T05:25:03.096ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 271 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49319 req_id = 409d51b1-b49e-4a28-8083-cc683cb3d544 response_code = 204 uri = /vpc-routes
20432024-11-26T05:25:03.374ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41325
20442024-11-26T05:25:03.374ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41325 req_id = 4d76c669-7f20-4148-af47-d2d393f96ba4 response_code = 200 uri = /vpc-routes
20452024-11-26T05:25:03.424ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8 values = ExternalIpGatewayMap { mappings: {} }
20462024-11-26T05:25:03.424ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41325 req_id = 2660e21b-8baa-41e4-92b1-4250c4e53a7a response_code = 204 uri = /eip-gateways
20472024-11-26T05:25:03.430ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38590
20482024-11-26T05:25:03.431ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38590 req_id = 9e26a8fb-4b40-4959-bc58-13b651c1c026 response_code = 200 uri = /v2p
20492024-11-26T05:25:03.469ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42397
20502024-11-26T05:25:03.469ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42397 req_id = ff98c1e3-8590-42aa-8dd2-cf5cb92af70a response_code = 200 uri = /v2p
20512024-11-26T05:25:03.477ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41325 req_id = 7121354c-e6a9-419d-b923-1742fabddd16 response_code = 204 uri = /vpc-routes
20522024-11-26T05:25:03.550ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47392
20532024-11-26T05:25:03.550ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4120
20542024-11-26T05:25:03.591ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4144
20552024-11-26T05:25:03.651ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101379 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:47392 req_id = 73f6df61-6300-4d23-8c23-414762d4b153 response_code = 204 uri = /switch-ports
20562024-11-26T05:25:03.652ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38542
20572024-11-26T05:25:03.652ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4120
20582024-11-26T05:25:03.652ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47392 req_id = 4c0dccc5-2a30-43e3-931f-2f502575e8b2 response_code = 200 uri = /network-bootstore-config
20592024-11-26T05:25:03.688ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4144
20602024-11-26T05:25:03.741ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89048 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:38542 req_id = 19b2e2b8-cc9e-49e2-9ea3-73c380d9f012 response_code = 204 uri = /switch-ports
20612024-11-26T05:25:03.741ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38542 req_id = b8c0dc5f-48bd-43f0-be9c-71faca471657 response_code = 200 uri = /network-bootstore-config
20622024-11-26T05:25:05.732ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
20632024-11-26T05:25:12.552ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:50888
20642024-11-26T05:25:12.552ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:50888 req_id = 85bbb09c-96a3-4abf-9e7c-865892675abb response_code = 200 uri = /baseboard
20652024-11-26T05:25:32.216ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64895
20662024-11-26T05:25:32.216ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64895 req_id = 124c2581-5a8b-4096-a0a6-d5e026b25ff2 response_code = 200 uri = /vpc-routes
20672024-11-26T05:25:32.237ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8 values = ExternalIpGatewayMap { mappings: {} }
20682024-11-26T05:25:32.237ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64895 req_id = d8eb69f4-5515-49cd-a101-8bb70f2a49af response_code = 204 uri = /eip-gateways
20692024-11-26T05:25:32.247ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 230 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64895 req_id = 1a3e006e-c36a-4f59-8cec-d16494bb1b95 response_code = 204 uri = /vpc-routes
20702024-11-26T05:25:32.305ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41177
20712024-11-26T05:25:32.305ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4120
20722024-11-26T05:25:32.348ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4144
20732024-11-26T05:25:32.404ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98898 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:41177 req_id = 73277ebe-54d8-4941-9119-e571a55f2c08 response_code = 204 uri = /switch-ports
20742024-11-26T05:25:32.404ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36807
20752024-11-26T05:25:32.404ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 225 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41177 req_id = 44630379-58ec-4299-a42b-8f2cc24edec0 response_code = 200 uri = /network-bootstore-config
20762024-11-26T05:25:32.404ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 226 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36807 req_id = db20027e-f1e3-4216-98cd-c7d35f559fbd response_code = 200 uri = /v2p
20772024-11-26T05:25:33.025ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51080
20782024-11-26T05:25:33.025ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51080 req_id = 93165ecc-fa2e-405a-baff-d7b39fed738f response_code = 200 uri = /vpc-routes
20792024-11-26T05:25:33.051ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8 values = ExternalIpGatewayMap { mappings: {} }
20802024-11-26T05:25:33.051ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51080 req_id = d2ddb994-1856-4c89-8c00-3cade9b514c9 response_code = 204 uri = /eip-gateways
20812024-11-26T05:25:33.094ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54435
20822024-11-26T05:25:33.094ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54435 req_id = 45b63759-191d-4b6f-aac3-18b826f2507a response_code = 200 uri = /v2p
20832024-11-26T05:25:33.100ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 203 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51080 req_id = f993498d-bd1a-4356-91e2-2fb96fd7a1c2 response_code = 204 uri = /vpc-routes
20842024-11-26T05:25:33.140ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59597
20852024-11-26T05:25:33.140ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4120
20862024-11-26T05:25:33.179ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4144
20872024-11-26T05:25:33.236ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95739 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:59597 req_id = 61769f85-c694-45aa-9148-e608aff66510 response_code = 204 uri = /switch-ports
20882024-11-26T05:25:33.236ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57021
20892024-11-26T05:25:33.237ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 200 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57021 req_id = 88fdc6e5-fb05-420e-93e8-6a0bc83f2fff response_code = 200 uri = /vpc-routes
20902024-11-26T05:25:33.237ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 311 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59597 req_id = 01be7673-1f09-45af-851c-2df9030f5d75 response_code = 200 uri = /network-bootstore-config
20912024-11-26T05:25:33.281ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8 values = ExternalIpGatewayMap { mappings: {} }
20922024-11-26T05:25:33.281ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57021 req_id = 8e04525b-9f0a-48f9-90e5-eb3916007621 response_code = 204 uri = /eip-gateways
20932024-11-26T05:25:33.290ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52621
20942024-11-26T05:25:33.290ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52621 req_id = cba74e9f-b7d1-47c1-be1f-47ad7277836c response_code = 200 uri = /v2p
20952024-11-26T05:25:33.296ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57021 req_id = 7e6ddd2c-457a-4e9f-8992-94606a177e3b response_code = 204 uri = /vpc-routes
20962024-11-26T05:25:33.345ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55468
20972024-11-26T05:25:33.345ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4120
20982024-11-26T05:25:33.383ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4144
20992024-11-26T05:25:33.436ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90663 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:55468 req_id = b53096d3-b9af-43eb-ac55-493e3a0c43bb response_code = 204 uri = /switch-ports
21002024-11-26T05:25:33.436ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55468 req_id = 053deecb-e9d4-4be1-a537-ea99bed5978f response_code = 200 uri = /network-bootstore-config
21012024-11-26T05:25:42.589ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:38153
21022024-11-26T05:25:42.589ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:38153 req_id = 5fc3a1e8-11fe-4438-a964-398351f4b916 response_code = 200 uri = /baseboard
21032024-11-26T05:26:02.283ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60109
21042024-11-26T05:26:02.284ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60109 req_id = ef69152b-c1a5-4eed-bcbc-d661b2d53843 response_code = 200 uri = /vpc-routes
21052024-11-26T05:26:02.333ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8 values = ExternalIpGatewayMap { mappings: {} }
21062024-11-26T05:26:02.333ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60109 req_id = bb681301-75c6-4ab0-8339-5a8faa183ffd response_code = 204 uri = /eip-gateways
21072024-11-26T05:26:02.342ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 180 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60109 req_id = c9b2b6c1-fbd1-4781-bf38-e4cab45209f0 response_code = 204 uri = /vpc-routes
21082024-11-26T05:26:02.431ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44252
21092024-11-26T05:26:02.431ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44252 req_id = d33b3ad9-bb13-419f-8c1f-b82f43248fb1 response_code = 200 uri = /v2p
21102024-11-26T05:26:02.463ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47275
21112024-11-26T05:26:02.463ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4120
21122024-11-26T05:26:02.502ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4144
21132024-11-26T05:26:02.557ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93889 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:47275 req_id = fb212305-e9c1-4acc-9a28-81e58c9d40f4 response_code = 204 uri = /switch-ports
21142024-11-26T05:26:02.557ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47275 req_id = d85e0dbd-a9b8-4e47-a141-749e59de1e10 response_code = 200 uri = /network-bootstore-config
21152024-11-26T05:26:03.096ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48376
21162024-11-26T05:26:03.096ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 170 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48376 req_id = 3024e9eb-6fab-44ba-855b-18433fff9d97 response_code = 200 uri = /v2p
21172024-11-26T05:26:03.138ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:32876
21182024-11-26T05:26:03.138ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:32876 req_id = 4867d85d-cb3d-4f08-9ddf-1fb3b2b8d41f response_code = 200 uri = /vpc-routes
21192024-11-26T05:26:03.189ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8 values = ExternalIpGatewayMap { mappings: {} }
21202024-11-26T05:26:03.189ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:32876 req_id = 7d39cc6b-6724-4076-9835-d97e55123bc5 response_code = 204 uri = /eip-gateways
21212024-11-26T05:26:03.197ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:32876 req_id = caa39392-b4de-41ec-9790-950029412389 response_code = 204 uri = /vpc-routes
21222024-11-26T05:26:03.309ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35138
21232024-11-26T05:26:03.309ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35138 req_id = a75ba4dc-2e37-4d84-b236-5a58a393741d response_code = 200 uri = /vpc-routes
21242024-11-26T05:26:03.327ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45822
21252024-11-26T05:26:03.327ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4120
21262024-11-26T05:26:03.372ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4144
21272024-11-26T05:26:03.429ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102156 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:45822 req_id = da4e0b6f-ba51-4f9b-92e4-c4d5686e45ca response_code = 204 uri = /switch-ports
21282024-11-26T05:26:03.430ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8 values = ExternalIpGatewayMap { mappings: {} }
21292024-11-26T05:26:03.430ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35138 req_id = c70e20ef-5803-4485-9f3d-23e6ad36c32a response_code = 204 uri = /eip-gateways
21302024-11-26T05:26:03.430ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45822 req_id = a7f51f96-02cd-4a62-b198-4ad626663bc0 response_code = 200 uri = /network-bootstore-config
21312024-11-26T05:26:03.443ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:32914
21322024-11-26T05:26:03.444ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:32914 req_id = d527c4bd-dfae-4ea3-b129-dcbb8cc7b7ba response_code = 200 uri = /v2p
21332024-11-26T05:26:03.445ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64371
21342024-11-26T05:26:03.445ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4120
21352024-11-26T05:26:03.482ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4144
21362024-11-26T05:26:03.533ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87850 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:64371 req_id = e802d06c-f766-4e5b-8880-80cd42a247fe response_code = 204 uri = /switch-ports
21372024-11-26T05:26:03.534ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 248 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64371 req_id = 69306e8d-8445-4ed2-963e-f187ae05ae18 response_code = 200 uri = /network-bootstore-config
21382024-11-26T05:26:03.534ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 343 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35138 req_id = b0b6c283-3b4e-4e62-9da5-cb06f2bce6ae response_code = 204 uri = /vpc-routes
21392024-11-26T05:26:12.622ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:50876
21402024-11-26T05:26:12.622ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 30 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:50876 req_id = c3c542a4-2008-4eea-a8b3-be5bb5d804af response_code = 200 uri = /baseboard
21412024-11-26T05:26:32.196ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57239
21422024-11-26T05:26:32.196ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57239 req_id = a8468273-bb4d-4120-bfb3-2e3d991a4b77 response_code = 200 uri = /vpc-routes
21432024-11-26T05:26:32.224ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48363
21442024-11-26T05:26:32.224ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48363 req_id = de1f29bd-e9a1-45a5-a8cc-7982a8b393c1 response_code = 200 uri = /v2p
21452024-11-26T05:26:32.263ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8 values = ExternalIpGatewayMap { mappings: {} }
21462024-11-26T05:26:32.263ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57239 req_id = 632d233a-718e-4724-be93-e5893a19b637 response_code = 204 uri = /eip-gateways
21472024-11-26T05:26:32.272ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57239 req_id = 9806a514-c221-4024-8312-546a3b5335d2 response_code = 204 uri = /vpc-routes
21482024-11-26T05:26:32.284ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61131
21492024-11-26T05:26:32.284ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4120
21502024-11-26T05:26:32.320ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4144
21512024-11-26T05:26:32.374ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90764 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:61131 req_id = 4ebf0f6a-a848-4d4d-ad23-72a6c8b51a58 response_code = 204 uri = /switch-ports
21522024-11-26T05:26:32.375ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61131 req_id = 897a9e93-9b28-4b19-a572-666738b38e4a response_code = 200 uri = /network-bootstore-config
21532024-11-26T05:26:33.009ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42602
21542024-11-26T05:26:33.009ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42602 req_id = 398f5eba-3235-46b5-9ade-90bd12fe7cb2 response_code = 200 uri = /v2p
21552024-11-26T05:26:33.031ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57455
21562024-11-26T05:26:33.031ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57455 req_id = d08425ac-bbc2-44b6-b127-ec08a245e726 response_code = 200 uri = /vpc-routes
21572024-11-26T05:26:33.097ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8 values = ExternalIpGatewayMap { mappings: {} }
21582024-11-26T05:26:33.097ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57455 req_id = 33ffc077-4866-4ba8-9960-ed03cbdff6f1 response_code = 204 uri = /eip-gateways
21592024-11-26T05:26:33.107ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 167 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57455 req_id = 8f560fc5-4585-40c0-95af-71f8e939aaab response_code = 204 uri = /vpc-routes
21602024-11-26T05:26:33.126ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63053
21612024-11-26T05:26:33.126ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4120
21622024-11-26T05:26:33.167ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4144
21632024-11-26T05:26:33.222ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95390 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:63053 req_id = f321d62a-3f7c-4b36-8cdc-ac098f0e8462 response_code = 204 uri = /switch-ports
21642024-11-26T05:26:33.222ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63053 req_id = e6414529-fce0-405e-9dc7-ec509dc23fa4 response_code = 200 uri = /network-bootstore-config
21652024-11-26T05:26:33.242ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59314
21662024-11-26T05:26:33.242ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59314 req_id = 97e389e5-3463-4f84-a102-b075739c5e10 response_code = 200 uri = /vpc-routes
21672024-11-26T05:26:33.256ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8 values = ExternalIpGatewayMap { mappings: {} }
21682024-11-26T05:26:33.256ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59314 req_id = f5654c5a-88a7-4148-932f-dd8846ecb191 response_code = 204 uri = /eip-gateways
21692024-11-26T05:26:33.268ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 307 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59314 req_id = 5ee42568-a29a-4f34-882a-a70802eb14b4 response_code = 204 uri = /vpc-routes
21702024-11-26T05:26:33.316ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47644
21712024-11-26T05:26:33.317ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4120
21722024-11-26T05:26:33.357ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4144
21732024-11-26T05:26:33.415ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98814 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:47644 req_id = 0ab9e5c8-1480-4e21-82ca-aab1a8288548 response_code = 204 uri = /switch-ports
21742024-11-26T05:26:33.415ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65002
21752024-11-26T05:26:33.416ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65002 req_id = 3ed6afb6-f333-4fa7-a5cc-0e6708e87ccb response_code = 200 uri = /v2p
21762024-11-26T05:26:33.416ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 263 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47644 req_id = 83a28aa0-f7ab-48ad-868b-50579fb8a4a7 response_code = 200 uri = /network-bootstore-config
21772024-11-26T05:26:42.653ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:37642
21782024-11-26T05:26:42.653ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:37642 req_id = 107b40ba-8d99-4450-b546-5f5389d989bb response_code = 200 uri = /baseboard
21792024-11-26T05:27:02.321ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57504
21802024-11-26T05:27:02.321ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57504 req_id = c5951abf-93ef-4c64-9134-7ee4555e497e response_code = 200 uri = /vpc-routes
21812024-11-26T05:27:02.692ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33145
21822024-11-26T05:27:02.692ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4120
21832024-11-26T05:27:02.736ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4144
21842024-11-26T05:27:02.793ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101265 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:33145 req_id = c6329dd3-5736-41db-90ab-55e219457cb4 response_code = 204 uri = /switch-ports
21852024-11-26T05:27:02.793ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8 values = ExternalIpGatewayMap { mappings: {} }
21862024-11-26T05:27:02.793ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57504 req_id = 20e4dadb-58a0-4082-81fa-5a4366fdb96a response_code = 204 uri = /eip-gateways
21872024-11-26T05:27:02.793ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33145 req_id = 589e0cea-a844-42fc-9423-7becf405512d response_code = 200 uri = /network-bootstore-config
21882024-11-26T05:27:02.824ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61149
21892024-11-26T05:27:02.824ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 167 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61149 req_id = f51ff862-7709-446e-9cec-532944efdf96 response_code = 200 uri = /v2p
21902024-11-26T05:27:02.827ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 184 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57504 req_id = 6edb7f4e-e746-4016-beb7-20ed99bb8f70 response_code = 204 uri = /vpc-routes
21912024-11-26T05:27:03.101ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58756
21922024-11-26T05:27:03.101ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58756 req_id = 2251a765-0a64-411f-8bee-9757c200190b response_code = 200 uri = /vpc-routes
21932024-11-26T05:27:03.116ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8 values = ExternalIpGatewayMap { mappings: {} }
21942024-11-26T05:27:03.116ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58756 req_id = 8071584e-a71f-4ef1-b3c3-c17691b06164 response_code = 204 uri = /eip-gateways
21952024-11-26T05:27:03.128ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58756 req_id = 1ec565d9-23b7-424b-918e-82d75abb36f7 response_code = 204 uri = /vpc-routes
21962024-11-26T05:27:03.168ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55723
21972024-11-26T05:27:03.168ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55723 req_id = a1289904-1399-4823-a828-83262b625aad response_code = 200 uri = /vpc-routes
21982024-11-26T05:27:03.230ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8 values = ExternalIpGatewayMap { mappings: {} }
21992024-11-26T05:27:03.230ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55723 req_id = 95445527-30ca-4ea7-8abd-c405a8e57546 response_code = 204 uri = /eip-gateways
22002024-11-26T05:27:03.243ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 221 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55723 req_id = 4fddf45f-9ca1-4017-aafd-490a96e9c07d response_code = 204 uri = /vpc-routes
22012024-11-26T05:27:03.286ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61432
22022024-11-26T05:27:03.286ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61432 req_id = de87d8b4-0173-4a2b-a50e-dd0d20152ce8 response_code = 200 uri = /v2p
22032024-11-26T05:27:03.365ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45139
22042024-11-26T05:27:03.365ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4120
22052024-11-26T05:27:03.406ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4144
22062024-11-26T05:27:03.461ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95673 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:45139 req_id = 899e1314-ce11-483a-b1f8-e299b2e1225f response_code = 204 uri = /switch-ports
22072024-11-26T05:27:03.461ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 178 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45139 req_id = 02c11a2b-e9e2-468f-af20-45776fcb53c4 response_code = 200 uri = /network-bootstore-config
22082024-11-26T05:27:03.506ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39939
22092024-11-26T05:27:03.506ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39939 req_id = 6cbc9bae-4324-4d6c-9b0b-bb803c839753 response_code = 200 uri = /v2p
22102024-11-26T05:27:03.602ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37770
22112024-11-26T05:27:03.602ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4120
22122024-11-26T05:27:03.640ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4144
22132024-11-26T05:27:03.697ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94912 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:37770 req_id = b9a49536-c0e8-4e07-be0d-7667fd441d66 response_code = 204 uri = /switch-ports
22142024-11-26T05:27:03.697ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 218 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37770 req_id = 00e383ed-48b8-4fa2-b3ab-231ebb04a5f9 response_code = 200 uri = /network-bootstore-config
22152024-11-26T05:27:12.688ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:37232
22162024-11-26T05:27:12.688ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:37232 req_id = 958674d8-896a-414d-932c-09a796b157da response_code = 200 uri = /baseboard
22172024-11-26T05:27:32.239ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:32985
22182024-11-26T05:27:32.239ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:32985 req_id = 2e7a9d10-a72b-4266-b377-63074e4beb7d response_code = 200 uri = /vpc-routes
22192024-11-26T05:27:32.281ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8 values = ExternalIpGatewayMap { mappings: {} }
22202024-11-26T05:27:32.281ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:32985 req_id = 0efd925e-8d02-4c43-b52e-724606b03ee2 response_code = 204 uri = /eip-gateways
22212024-11-26T05:27:32.306ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39267
22222024-11-26T05:27:32.307ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39267 req_id = 7a1a5d64-21be-41a2-b2ee-290b7af0a6cf response_code = 200 uri = /v2p
22232024-11-26T05:27:32.316ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 268 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:32985 req_id = 51c2fd44-0c72-4338-8d54-223d5dd483cb response_code = 204 uri = /vpc-routes
22242024-11-26T05:27:32.334ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53690
22252024-11-26T05:27:32.334ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4120
22262024-11-26T05:27:32.371ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4144
22272024-11-26T05:27:32.426ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91766 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:53690 req_id = ea2ca70c-8b80-4fac-9aca-9a32a10bd939 response_code = 204 uri = /switch-ports
22282024-11-26T05:27:32.426ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53690 req_id = 8e807aeb-088b-4060-8978-1fc23820cc10 response_code = 200 uri = /network-bootstore-config
22292024-11-26T05:27:32.922ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39831
22302024-11-26T05:27:32.922ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39831 req_id = 1445be9a-7c4d-4710-a2ee-ae8194c82dfb response_code = 200 uri = /vpc-routes
22312024-11-26T05:27:32.939ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8 values = ExternalIpGatewayMap { mappings: {} }
22322024-11-26T05:27:32.939ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39831 req_id = a5dc01fe-0e86-49b2-a8ae-eb0ee13e537a response_code = 204 uri = /eip-gateways
22332024-11-26T05:27:32.947ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 228 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39831 req_id = 53352945-5918-4cea-81cc-08cc2cf01d8e response_code = 204 uri = /vpc-routes
22342024-11-26T05:27:33.062ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56042
22352024-11-26T05:27:33.062ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56042 req_id = 33a6795f-0d51-4c47-991c-66eb3300abae response_code = 200 uri = /v2p
22362024-11-26T05:27:33.091ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56313
22372024-11-26T05:27:33.091ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4120
22382024-11-26T05:27:33.132ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4144
22392024-11-26T05:27:33.189ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98006 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:56313 req_id = dd6070fc-e2cc-4b3b-b7f8-8eabab7fac05 response_code = 204 uri = /switch-ports
22402024-11-26T05:27:33.189ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56313 req_id = 25ba4f23-f9c9-42e0-b571-b5ab940bea19 response_code = 200 uri = /network-bootstore-config
22412024-11-26T05:27:33.298ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54001
22422024-11-26T05:27:33.298ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54001 req_id = 5bbec0ed-6fb3-4a95-a78b-2264910b3692 response_code = 200 uri = /v2p
22432024-11-26T05:27:33.444ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48884
22442024-11-26T05:27:33.444ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48884 req_id = 85657b85-5792-45bb-9444-1946f3223050 response_code = 200 uri = /vpc-routes
22452024-11-26T05:27:33.459ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8 values = ExternalIpGatewayMap { mappings: {} }
22462024-11-26T05:27:33.459ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48884 req_id = 9dad2a2f-f698-42a8-b1eb-ba7120ae2854 response_code = 204 uri = /eip-gateways
22472024-11-26T05:27:33.469ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48884 req_id = e7947f19-41b1-4649-826b-1a9a1e643bbc response_code = 204 uri = /vpc-routes
22482024-11-26T05:27:33.519ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57322
22492024-11-26T05:27:33.519ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4120
22502024-11-26T05:27:33.556ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4144
22512024-11-26T05:27:33.615ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95907 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:57322 req_id = 50762dbe-9c5d-4904-af57-f85d92030cbe response_code = 204 uri = /switch-ports
22522024-11-26T05:27:33.640ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57322 req_id = 8ecdf792-a8e1-44c2-a348-3ca6740f2153 response_code = 200 uri = /network-bootstore-config
22532024-11-26T05:27:42.721ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:65366
22542024-11-26T05:27:42.721ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:65366 req_id = 349f1f74-b991-4baf-856e-b0e447a7450a response_code = 200 uri = /baseboard
22552024-11-26T05:28:02.277ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48938
22562024-11-26T05:28:02.278ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48938 req_id = 2362786e-f467-4a3f-b178-8deb9bc5c390 response_code = 200 uri = /vpc-routes
22572024-11-26T05:28:02.322ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8 values = ExternalIpGatewayMap { mappings: {} }
22582024-11-26T05:28:02.322ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48938 req_id = ff7e1b3f-c3f4-41a3-a6d6-be6dd97f79bb response_code = 204 uri = /eip-gateways
22592024-11-26T05:28:02.330ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 160 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48938 req_id = 31f836cc-a333-442b-93aa-aa9c89b4e1f9 response_code = 204 uri = /vpc-routes
22602024-11-26T05:28:02.408ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39970
22612024-11-26T05:28:02.408ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39970 req_id = 30df0ce5-7a41-43ab-8fb7-b322ddf72abb response_code = 200 uri = /v2p
22622024-11-26T05:28:02.448ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55528
22632024-11-26T05:28:02.448ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4120
22642024-11-26T05:28:02.483ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4144
22652024-11-26T05:28:02.541ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93551 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:55528 req_id = 1a72039b-8595-4899-81dd-9dbd84997d49 response_code = 204 uri = /switch-ports
22662024-11-26T05:28:02.542ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55528 req_id = 521731bb-3a4d-41a6-9187-613ed2596edc response_code = 200 uri = /network-bootstore-config
22672024-11-26T05:28:03.134ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56491
22682024-11-26T05:28:03.134ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56491 req_id = 3d7d84df-7deb-464e-90ea-8d63ff3512e2 response_code = 200 uri = /vpc-routes
22692024-11-26T05:28:03.259ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55168
22702024-11-26T05:28:03.259ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 194 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55168 req_id = 2ab357f3-535a-40e6-b5f2-a53c0887fc3e response_code = 200 uri = /v2p
22712024-11-26T05:28:03.310ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8 values = ExternalIpGatewayMap { mappings: {} }
22722024-11-26T05:28:03.310ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56491 req_id = 9d330481-d25b-4933-a739-9cb9dfab8b40 response_code = 204 uri = /eip-gateways
22732024-11-26T05:28:03.321ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 194 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56491 req_id = 7f35682a-fdd1-4501-a4dd-c83218821bcf response_code = 204 uri = /vpc-routes
22742024-11-26T05:28:03.322ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58533
22752024-11-26T05:28:03.322ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58533 req_id = a8c9086f-1db6-4686-aa63-4d1db23f9a94 response_code = 200 uri = /vpc-routes
22762024-11-26T05:28:03.380ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8 values = ExternalIpGatewayMap { mappings: {} }
22772024-11-26T05:28:03.380ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58533 req_id = 2bfc72b3-01cc-44fa-aaf9-d6ed3cc3f974 response_code = 204 uri = /eip-gateways
22782024-11-26T05:28:03.389ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 195 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58533 req_id = 07e634e3-ec70-4f52-b190-ca288fc10ea6 response_code = 204 uri = /vpc-routes
22792024-11-26T05:28:03.490ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38522
22802024-11-26T05:28:03.490ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4120
22812024-11-26T05:28:03.530ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4144
22822024-11-26T05:28:03.584ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93617 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:38522 req_id = 2f325ffa-b315-4972-a3a7-1c4d5cea8f80 response_code = 204 uri = /switch-ports
22832024-11-26T05:28:03.584ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53564
22842024-11-26T05:28:03.584ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56825
22852024-11-26T05:28:03.585ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 235 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38522 req_id = c9da663c-bb26-4963-946d-4e18e2e92510 response_code = 200 uri = /network-bootstore-config
22862024-11-26T05:28:03.585ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 206 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56825 req_id = e5dd593c-a644-4ad1-8a76-5b16954b70e7 response_code = 200 uri = /v2p
22872024-11-26T05:28:03.585ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4120
22882024-11-26T05:28:03.622ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4144
22892024-11-26T05:28:03.674ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89670 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:53564 req_id = 21f52d4c-546e-4aaa-a9a4-afa06d04e772 response_code = 204 uri = /switch-ports
22902024-11-26T05:28:03.675ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53564 req_id = 65bc40f9-bcf6-4ef0-907c-557e0e9a74ee response_code = 200 uri = /network-bootstore-config
22912024-11-26T05:28:12.756ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:63744
22922024-11-26T05:28:12.757ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:63744 req_id = df12aa1a-6ee3-44da-b0ae-80ed1eef39c1 response_code = 200 uri = /baseboard
22932024-11-26T05:28:32.234ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41488
22942024-11-26T05:28:32.234ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41488 req_id = 6b1fa764-7944-4402-a2f1-8d5947d7b076 response_code = 200 uri = /vpc-routes
22952024-11-26T05:28:32.249ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8 values = ExternalIpGatewayMap { mappings: {} }
22962024-11-26T05:28:32.249ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41488 req_id = 7e4e5701-1f91-47e9-a165-4d01d9916c37 response_code = 204 uri = /eip-gateways
22972024-11-26T05:28:32.258ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41488 req_id = be1f0e5e-b127-4602-a312-8f25bb15eb71 response_code = 204 uri = /vpc-routes
22982024-11-26T05:28:32.329ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37259
22992024-11-26T05:28:32.329ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37259 req_id = 5cf8061c-e6f1-4b24-baba-0b1bf599e47d response_code = 200 uri = /v2p
23002024-11-26T05:28:32.332ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53187
23012024-11-26T05:28:32.332ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4120
23022024-11-26T05:28:32.374ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4144
23032024-11-26T05:28:32.435ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102493 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:53187 req_id = 0c686ee2-5229-4663-9637-f7b58da1a49e response_code = 204 uri = /switch-ports
23042024-11-26T05:28:32.435ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53187 req_id = 36aaa9e6-0db2-457a-b175-0b7c3ed37ca2 response_code = 200 uri = /network-bootstore-config
23052024-11-26T05:28:33.057ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59474
23062024-11-26T05:28:33.057ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59474 req_id = bb084cde-75a5-48f1-86d2-cbabb262c424 response_code = 200 uri = /vpc-routes
23072024-11-26T05:28:33.074ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8 values = ExternalIpGatewayMap { mappings: {} }
23082024-11-26T05:28:33.074ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59474 req_id = 172f3f60-f654-4f1a-8cf3-3ce2084419e9 response_code = 204 uri = /eip-gateways
23092024-11-26T05:28:33.084ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59474 req_id = 34e3f074-8ab4-431d-9370-972f01def7d4 response_code = 204 uri = /vpc-routes
23102024-11-26T05:28:33.144ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40458
23112024-11-26T05:28:33.144ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4120
23122024-11-26T05:28:33.185ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4144
23132024-11-26T05:28:33.243ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99357 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:40458 req_id = 0b25bf80-dce0-42ee-a12c-216a9551eb40 response_code = 204 uri = /switch-ports
23142024-11-26T05:28:33.243ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64579
23152024-11-26T05:28:33.244ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44055
23162024-11-26T05:28:33.244ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44330
23172024-11-26T05:28:33.244ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 277 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40458 req_id = 70a68b29-08a0-4c2b-a663-6d4e706b6711 response_code = 200 uri = /network-bootstore-config
23182024-11-26T05:28:33.244ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 183 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44330 req_id = 2ccef1ce-9492-4b6f-8fcd-49fd83baf8fc response_code = 200 uri = /v2p
23192024-11-26T05:28:33.244ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64579 req_id = 87dc6de2-9f75-4621-a6dc-d71aede84316 response_code = 200 uri = /vpc-routes
23202024-11-26T05:28:33.244ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 215 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44055 req_id = 973e8b11-33a9-459f-b011-482bbae93aac response_code = 200 uri = /v2p
23212024-11-26T05:28:33.271ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36314
23222024-11-26T05:28:33.271ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4120
23232024-11-26T05:28:33.313ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4144
23242024-11-26T05:28:33.369ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98150 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:36314 req_id = 4e299588-820b-4327-bf07-f6b7471c5b1b response_code = 204 uri = /switch-ports
23252024-11-26T05:28:33.369ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8 values = ExternalIpGatewayMap { mappings: {} }
23262024-11-26T05:28:33.369ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64579 req_id = 2d726494-f90a-4dee-8d1d-48d832c91238 response_code = 204 uri = /eip-gateways
23272024-11-26T05:28:33.370ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 240 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36314 req_id = cb3d26b4-9847-4318-876b-9d9280e4dc0d response_code = 200 uri = /network-bootstore-config
23282024-11-26T05:28:33.380ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 203 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64579 req_id = 310ec3f3-2e7b-4b7b-93c1-62ee2ef9bbbb response_code = 204 uri = /vpc-routes
23292024-11-26T05:28:42.789ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:36559
23302024-11-26T05:28:42.789ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 29 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:36559 req_id = c374524b-6c6f-40f5-8661-6071148c7343 response_code = 200 uri = /baseboard
23312024-11-26T05:29:02.180ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36012
23322024-11-26T05:29:02.180ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36012 req_id = a64deeae-5a21-4e46-96ad-5eb12768f448 response_code = 200 uri = /vpc-routes
23332024-11-26T05:29:02.244ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8 values = ExternalIpGatewayMap { mappings: {} }
23342024-11-26T05:29:02.244ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36012 req_id = 0c4965b8-0346-4fae-8fb0-b8d114b58507 response_code = 204 uri = /eip-gateways
23352024-11-26T05:29:02.262ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 251 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36012 req_id = 28ed782c-e191-42d9-9171-090a9ee52185 response_code = 204 uri = /vpc-routes
23362024-11-26T05:29:02.421ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54021
23372024-11-26T05:29:02.421ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54021 req_id = fcde16a0-6bd0-4dd9-bb98-6b96cda3417e response_code = 200 uri = /v2p
23382024-11-26T05:29:02.504ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64064
23392024-11-26T05:29:02.504ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4120
23402024-11-26T05:29:02.543ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4144
23412024-11-26T05:29:02.602ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98243 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:64064 req_id = 5a870a97-1daf-4e98-9639-e68bb7498a7a response_code = 204 uri = /switch-ports
23422024-11-26T05:29:02.602ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64064 req_id = 8f7303e5-f9be-4155-a7c4-3ed0cf6421df response_code = 200 uri = /network-bootstore-config
23432024-11-26T05:29:02.705ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35623
23442024-11-26T05:29:02.706ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1dbf9b5b-ede3-4cf4-b0d0-091aa188969a, kind: Service { id: 4e9fd39d-4113-4491-beca-e49e9a07f310 }, name: Name("external-dns-4e9fd39d-4113-4491-beca-e49e9a07f310"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 201, 3])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 2f3ae2da-b0e7-4755-a7ae-d54ffe51eccc, kind: Service { id: 7de56ef8-bdda-46b0-a9a9-fa5e97a778c5 }, name: Name("external-dns-7de56ef8-bdda-46b0-a9a9-fa5e97a778c5"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 146])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: afc30658-25b2-44db-9d11-ba075ebc447b, kind: Service { id: de715031-fa5a-4cf9-bf82-9cec9db59d81 }, name: Name("nexus-de715031-fa5a-4cf9-bf82-9cec9db59d81"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 180, 14])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e7b24131-9921-4152-b1bb-f948db445563, kind: Service { id: ccf769ca-e6aa-41c6-80d6-7f1cfa2a624a }, name: Name("nexus-ccf769ca-e6aa-41c6-80d6-7f1cfa2a624a"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 212, 242])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f88dd6c2-772e-44fb-bf3f-d4557d3228a8, kind: Service { id: eea1c48b-e597-47f2-a9c9-8bf328dab7cd }, name: Name("nexus-eea1c48b-e597-47f2-a9c9-8bf328dab7cd"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 159, 25])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
23452024-11-26T05:29:02.706ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23462024-11-26T05:29:02.706ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23472024-11-26T05:29:02.706ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23482024-11-26T05:29:02.706ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23492024-11-26T05:29:02.706ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
23502024-11-26T05:29:02.706ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23512024-11-26T05:29:02.706ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 382 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35623 req_id = 25e26728-9346-4be4-a760-43ca0e407f25 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
23522024-11-26T05:29:03.251ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41651
23532024-11-26T05:29:03.252ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41651 req_id = c2369cc9-9b92-4966-9967-741dc12414bd response_code = 200 uri = /vpc-routes
23542024-11-26T05:29:03.261ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41644
23552024-11-26T05:29:03.261ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 24 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41644 req_id = e4348f45-e7e2-4b30-b51a-27a52d4fd2f5 response_code = 200 uri = /vpc-routes
23562024-11-26T05:29:03.300ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8 values = ExternalIpGatewayMap { mappings: {} }
23572024-11-26T05:29:03.300ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41651 req_id = 31b1fae5-697c-470e-ae2e-b115eed01ec2 response_code = 204 uri = /eip-gateways
23582024-11-26T05:29:03.310ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 196 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41651 req_id = 41b71233-2d50-4d58-a180-c56c7ef7b85a response_code = 204 uri = /vpc-routes
23592024-11-26T05:29:03.320ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8 values = ExternalIpGatewayMap { mappings: {} }
23602024-11-26T05:29:03.320ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41644 req_id = 5aa4192e-1a6d-4479-9871-80c83f7a5ad6 response_code = 204 uri = /eip-gateways
23612024-11-26T05:29:03.332ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 178 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41644 req_id = 47311840-3256-4464-929e-feff5296d001 response_code = 204 uri = /vpc-routes
23622024-11-26T05:29:03.365ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37141
23632024-11-26T05:29:03.365ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4120
23642024-11-26T05:29:03.409ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4144
23652024-11-26T05:29:03.474ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108380 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:37141 req_id = c6730510-76c5-4855-9e66-6f811f0c8034 response_code = 204 uri = /switch-ports
23662024-11-26T05:29:03.477ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45979
23672024-11-26T05:29:03.477ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37141 req_id = 1b443b8c-b81a-49ee-8ee7-ba6471272272 response_code = 200 uri = /network-bootstore-config
23682024-11-26T05:29:03.477ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45979 req_id = a1683bbb-c57e-40d7-ae42-d6ba83896bd0 response_code = 200 uri = /v2p
23692024-11-26T05:29:03.491ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62546
23702024-11-26T05:29:03.492ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1dbf9b5b-ede3-4cf4-b0d0-091aa188969a, kind: Service { id: 4e9fd39d-4113-4491-beca-e49e9a07f310 }, name: Name("external-dns-4e9fd39d-4113-4491-beca-e49e9a07f310"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 201, 3])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 2f3ae2da-b0e7-4755-a7ae-d54ffe51eccc, kind: Service { id: 7de56ef8-bdda-46b0-a9a9-fa5e97a778c5 }, name: Name("external-dns-7de56ef8-bdda-46b0-a9a9-fa5e97a778c5"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 146])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: afc30658-25b2-44db-9d11-ba075ebc447b, kind: Service { id: de715031-fa5a-4cf9-bf82-9cec9db59d81 }, name: Name("nexus-de715031-fa5a-4cf9-bf82-9cec9db59d81"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 180, 14])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e7b24131-9921-4152-b1bb-f948db445563, kind: Service { id: ccf769ca-e6aa-41c6-80d6-7f1cfa2a624a }, name: Name("nexus-ccf769ca-e6aa-41c6-80d6-7f1cfa2a624a"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 212, 242])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f88dd6c2-772e-44fb-bf3f-d4557d3228a8, kind: Service { id: eea1c48b-e597-47f2-a9c9-8bf328dab7cd }, name: Name("nexus-eea1c48b-e597-47f2-a9c9-8bf328dab7cd"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 159, 25])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
23712024-11-26T05:29:03.492ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23722024-11-26T05:29:03.492ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23732024-11-26T05:29:03.492ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23742024-11-26T05:29:03.492ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23752024-11-26T05:29:03.492ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
23762024-11-26T05:29:03.492ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23772024-11-26T05:29:03.492ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 275 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62546 req_id = 2d5a67b3-08b8-4dc1-afbb-dd68457ce9ca response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
23782024-11-26T05:29:03.506ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45009
23792024-11-26T05:29:03.506ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45009 req_id = c0f97a94-bd14-41e1-9e5e-70251ed066d3 response_code = 200 uri = /v2p
23802024-11-26T05:29:03.537ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41655
23812024-11-26T05:29:03.537ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4120
23822024-11-26T05:29:03.578ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4144
23832024-11-26T05:29:03.639ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101781 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:41655 req_id = 45d953f9-2818-436e-ab27-d9b0adb25287 response_code = 204 uri = /switch-ports
23842024-11-26T05:29:03.643ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 190 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41655 req_id = 1bcb4709-e0e6-47ad-bbc9-dde9eb649299 response_code = 200 uri = /network-bootstore-config
23852024-11-26T05:29:03.660ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64027
23862024-11-26T05:29:03.660ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1dbf9b5b-ede3-4cf4-b0d0-091aa188969a, kind: Service { id: 4e9fd39d-4113-4491-beca-e49e9a07f310 }, name: Name("external-dns-4e9fd39d-4113-4491-beca-e49e9a07f310"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 201, 3])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 2f3ae2da-b0e7-4755-a7ae-d54ffe51eccc, kind: Service { id: 7de56ef8-bdda-46b0-a9a9-fa5e97a778c5 }, name: Name("external-dns-7de56ef8-bdda-46b0-a9a9-fa5e97a778c5"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 146])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: afc30658-25b2-44db-9d11-ba075ebc447b, kind: Service { id: de715031-fa5a-4cf9-bf82-9cec9db59d81 }, name: Name("nexus-de715031-fa5a-4cf9-bf82-9cec9db59d81"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 180, 14])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e7b24131-9921-4152-b1bb-f948db445563, kind: Service { id: ccf769ca-e6aa-41c6-80d6-7f1cfa2a624a }, name: Name("nexus-ccf769ca-e6aa-41c6-80d6-7f1cfa2a624a"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 212, 242])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f88dd6c2-772e-44fb-bf3f-d4557d3228a8, kind: Service { id: eea1c48b-e597-47f2-a9c9-8bf328dab7cd }, name: Name("nexus-eea1c48b-e597-47f2-a9c9-8bf328dab7cd"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 159, 25])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
23872024-11-26T05:29:03.660ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23882024-11-26T05:29:03.660ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23892024-11-26T05:29:03.660ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23902024-11-26T05:29:03.660ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23912024-11-26T05:29:03.660ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
23922024-11-26T05:29:03.660ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23932024-11-26T05:29:03.660ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 332 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64027 req_id = 832d737a-38e9-490f-b9e1-82da47cc3d5b response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
23942024-11-26T05:29:12.823ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:63728
23952024-11-26T05:29:12.823ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:63728 req_id = a1de0aba-c14d-4a61-b8ea-b6eb61d8138f response_code = 200 uri = /baseboard
23962024-11-26T05:29:32.166ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37196
23972024-11-26T05:29:32.166ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37196 req_id = 4f3b2567-90b2-4e2b-873c-260c50d3fe97 response_code = 200 uri = /vpc-routes
23982024-11-26T05:29:32.213ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8 values = ExternalIpGatewayMap { mappings: {} }
23992024-11-26T05:29:32.213ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37196 req_id = 10d2e51c-fa3e-4130-8940-06276d0245a6 response_code = 204 uri = /eip-gateways
24002024-11-26T05:29:32.344ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45689
24012024-11-26T05:29:32.344ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45689 req_id = c2011789-88e9-4cfc-a0eb-aa7ef2064eaa response_code = 200 uri = /v2p
24022024-11-26T05:29:32.353ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37196 req_id = 4d6988a0-85f8-4b48-badf-7c68f4aa267d response_code = 204 uri = /vpc-routes
24032024-11-26T05:29:32.387ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44572
24042024-11-26T05:29:32.387ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4120
24052024-11-26T05:29:32.427ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4144
24062024-11-26T05:29:32.486ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98753 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:44572 req_id = b5584ddb-fcf4-454f-a9b3-7db27625f701 response_code = 204 uri = /switch-ports
24072024-11-26T05:29:32.486ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44572 req_id = aa6905f9-4eb6-4fda-a015-a41868470e2d response_code = 200 uri = /network-bootstore-config
24082024-11-26T05:29:33.071ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48876
24092024-11-26T05:29:33.072ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 189 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48876 req_id = 5833f82f-9a07-4717-b46e-e19460de7afd response_code = 200 uri = /v2p
24102024-11-26T05:29:33.091ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44236
24112024-11-26T05:29:33.091ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44236 req_id = 865263a6-a60a-4c1c-8425-8e6794b19575 response_code = 200 uri = /vpc-routes
24122024-11-26T05:29:33.098ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43005
24132024-11-26T05:29:33.098ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43005 req_id = 6b1caec3-6c1a-462a-a637-36d95f9b03a3 response_code = 200 uri = /vpc-routes
24142024-11-26T05:29:33.152ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8 values = ExternalIpGatewayMap { mappings: {} }
24152024-11-26T05:29:33.152ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44236 req_id = b51441a8-068d-422f-8073-f8e468cca291 response_code = 204 uri = /eip-gateways
24162024-11-26T05:29:33.156ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8 values = ExternalIpGatewayMap { mappings: {} }
24172024-11-26T05:29:33.156ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43005 req_id = 19dc9904-2894-455b-adb0-6c30eb574eed response_code = 204 uri = /eip-gateways
24182024-11-26T05:29:33.161ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 235 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44236 req_id = e9d60e76-e185-4ea1-99f2-a9b07d42f497 response_code = 204 uri = /vpc-routes
24192024-11-26T05:29:33.166ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43005 req_id = 8e385fd7-85d5-4d4e-b6aa-ede25b3d2baf response_code = 204 uri = /vpc-routes
24202024-11-26T05:29:33.189ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37861
24212024-11-26T05:29:33.189ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4120
24222024-11-26T05:29:33.234ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4144
24232024-11-26T05:29:33.296ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107136 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:37861 req_id = 9c0a2a2b-e957-4373-b40b-472403ad680b response_code = 204 uri = /switch-ports
24242024-11-26T05:29:33.296ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59156
24252024-11-26T05:29:33.296ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4120
24262024-11-26T05:29:33.300ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4001 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37861 req_id = 4a3c70e9-eef3-4b76-a1c0-f653b89e1d8b response_code = 200 uri = /network-bootstore-config
24272024-11-26T05:29:33.335ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4144
24282024-11-26T05:29:33.352ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52684
24292024-11-26T05:29:33.352ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 171 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52684 req_id = 4ce0423d-57b7-4e4d-b8c7-2be4604b1f77 response_code = 200 uri = /v2p
24302024-11-26T05:29:33.392ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95547 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:59156 req_id = a0bc8c56-c5e0-4345-b4c6-0e7026c22236 response_code = 204 uri = /switch-ports
24312024-11-26T05:29:33.392ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59156 req_id = 2e9dfb2c-ac61-447d-9092-7d90532d769f response_code = 200 uri = /network-bootstore-config
24322024-11-26T05:29:42.856ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:58096
24332024-11-26T05:29:42.857ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:58096 req_id = b4232a0a-db86-4135-af58-e5abc416a53d response_code = 200 uri = /baseboard
24342024-11-26T05:29:49.429ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
24352024-11-26T05:29:49.430ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
24362024-11-26T05:29:51.722ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:197
24372024-11-26T05:29:51.722ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
24382024-11-26T05:29:51.756ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 3557, tv_nsec: 159061857 } time_to_next_cleanup = 599.99999784s
24392024-11-26T05:29:59.430ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
24402024-11-26T05:29:59.431ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
24412024-11-26T05:29:59.433ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
24422024-11-26T05:29:59.434ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
24432024-11-26T05:30:02.399ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38095
24442024-11-26T05:30:02.399ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38095 req_id = 3ac0971b-0422-478c-bd88-c440c508a833 response_code = 200 uri = /vpc-routes
24452024-11-26T05:30:02.414ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8 values = ExternalIpGatewayMap { mappings: {} }
24462024-11-26T05:30:02.414ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38095 req_id = 5c9208c6-8915-4022-9bbb-e1724ae5c016 response_code = 204 uri = /eip-gateways
24472024-11-26T05:30:02.498ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55872
24482024-11-26T05:30:02.498ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55872 req_id = 8d7e9995-d8a5-4b9d-8c2c-02b8213ef064 response_code = 200 uri = /v2p
24492024-11-26T05:30:02.507ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38095 req_id = fd2db906-0285-4716-a85c-7ce5ad10e7d4 response_code = 204 uri = /vpc-routes
24502024-11-26T05:30:02.542ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45427
24512024-11-26T05:30:02.543ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4120
24522024-11-26T05:30:02.583ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4144
24532024-11-26T05:30:02.644ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101126 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:45427 req_id = ab8d97f9-2f0f-4c3d-92b5-3217d105756d response_code = 204 uri = /switch-ports
24542024-11-26T05:30:02.644ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 190 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45427 req_id = f9936a80-5280-4db7-b3b7-7502aa3da471 response_code = 200 uri = /network-bootstore-config
24552024-11-26T05:30:03.023ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42257
24562024-11-26T05:30:03.023ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42257 req_id = 15f10e5c-0c62-4d5d-8484-5ecdaf67c025 response_code = 200 uri = /vpc-routes
24572024-11-26T05:30:03.109ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8 values = ExternalIpGatewayMap { mappings: {} }
24582024-11-26T05:30:03.109ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42257 req_id = aaf73ffd-4756-40aa-91b9-99fd10a2853c response_code = 204 uri = /eip-gateways
24592024-11-26T05:30:03.203ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63098
24602024-11-26T05:30:03.203ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63098 req_id = b8ca5b7c-3ed8-4dce-9676-1e882442ad99 response_code = 200 uri = /v2p
24612024-11-26T05:30:03.213ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42257 req_id = 1eb2ad31-ff18-4d7f-96c9-290a395a0977 response_code = 204 uri = /vpc-routes
24622024-11-26T05:30:03.298ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52199
24632024-11-26T05:30:03.298ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4120
24642024-11-26T05:30:03.342ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4144
24652024-11-26T05:30:03.403ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104502 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:52199 req_id = aa5d46c9-a5d2-4b5e-a157-70d2c348dfae response_code = 204 uri = /switch-ports
24662024-11-26T05:30:03.403ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52199 req_id = 5b3f2871-0f8d-47d5-abe0-a6a7910db47c response_code = 200 uri = /network-bootstore-config
24672024-11-26T05:30:03.422ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60163
24682024-11-26T05:30:03.422ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60163 req_id = d3772888-8f30-4f84-bce2-34274a05ff08 response_code = 200 uri = /vpc-routes
24692024-11-26T05:30:03.438ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8 values = ExternalIpGatewayMap { mappings: {} }
24702024-11-26T05:30:03.438ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60163 req_id = 0da2a77f-d0e5-4fb0-8ce0-ef7f49dd00b6 response_code = 204 uri = /eip-gateways
24712024-11-26T05:30:03.446ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 212 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60163 req_id = 00618756-016d-429c-a7b1-bf455632bc1e response_code = 204 uri = /vpc-routes
24722024-11-26T05:30:03.500ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41911
24732024-11-26T05:30:03.500ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4120
24742024-11-26T05:30:03.539ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4144
24752024-11-26T05:30:03.597ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97204 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:41911 req_id = 6089f2f0-0419-4236-81f3-ae6840858493 response_code = 204 uri = /switch-ports
24762024-11-26T05:30:03.597ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63549
24772024-11-26T05:30:03.597ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 172 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63549 req_id = cb7733bc-6258-43b6-a6c6-0437bd8220a9 response_code = 200 uri = /v2p
24782024-11-26T05:30:03.598ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 205 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41911 req_id = 664c28da-b804-4588-b016-5558b81df481 response_code = 200 uri = /network-bootstore-config
24792024-11-26T05:30:05.734ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
24802024-11-26T05:30:09.434ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
24812024-11-26T05:30:09.435ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
24822024-11-26T05:30:09.437ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
24832024-11-26T05:30:09.439ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
24842024-11-26T05:30:12.889ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:44737
24852024-11-26T05:30:12.889ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:44737 req_id = 8bb3950e-4d31-4f5f-970b-638457ea550c response_code = 200 uri = /baseboard
24862024-11-26T05:30:19.438ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
24872024-11-26T05:30:19.439ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
24882024-11-26T05:30:19.441ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
24892024-11-26T05:30:19.443ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
24902024-11-26T05:30:29.444ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
24912024-11-26T05:30:29.445ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
24922024-11-26T05:30:29.447ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
24932024-11-26T05:30:29.448ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
24942024-11-26T05:30:32.173ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59133
24952024-11-26T05:30:32.173ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59133 req_id = 4da12a65-741e-46a3-98e7-cc13ccb3c41b response_code = 200 uri = /vpc-routes
24962024-11-26T05:30:32.194ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8 values = ExternalIpGatewayMap { mappings: {} }
24972024-11-26T05:30:32.194ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59133 req_id = 422a7a9c-9a84-45a5-b2d1-f6054b6594ae response_code = 204 uri = /eip-gateways
24982024-11-26T05:30:32.243ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54057
24992024-11-26T05:30:32.243ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54057 req_id = dc14b659-68ec-4d7c-8662-644138c67422 response_code = 200 uri = /v2p
25002024-11-26T05:30:32.250ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 208 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59133 req_id = b56c6bc3-c69f-4651-a26e-e300ae58dc78 response_code = 204 uri = /vpc-routes
25012024-11-26T05:30:32.288ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43551
25022024-11-26T05:30:32.289ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4120
25032024-11-26T05:30:32.330ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4144
25042024-11-26T05:30:32.391ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102339 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:43551 req_id = 871b5773-0f10-413b-88c4-51add72293ca response_code = 204 uri = /switch-ports
25052024-11-26T05:30:32.391ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43551 req_id = 2c7fe707-0673-4afc-b7dc-0de4fe23d985 response_code = 200 uri = /network-bootstore-config
25062024-11-26T05:30:33.060ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46858
25072024-11-26T05:30:33.061ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46858 req_id = 2959cf81-bdf3-422d-826f-cfc3bb625132 response_code = 200 uri = /vpc-routes
25082024-11-26T05:30:33.077ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8 values = ExternalIpGatewayMap { mappings: {} }
25092024-11-26T05:30:33.077ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46858 req_id = 856edc00-1bee-4263-98f3-fd1b3d2c1fb6 response_code = 204 uri = /eip-gateways
25102024-11-26T05:30:33.087ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 196 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46858 req_id = e0e0d82c-a7d7-42a2-a26c-2be5f4f23599 response_code = 204 uri = /vpc-routes
25112024-11-26T05:30:33.122ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61260
25122024-11-26T05:30:33.122ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61260 req_id = b655f641-8105-4b46-9cc9-1efcf0b89f65 response_code = 200 uri = /vpc-routes
25132024-11-26T05:30:33.167ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39980
25142024-11-26T05:30:33.167ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39980 req_id = 51d822ce-086d-4ba5-b0fb-2ca2e0abb70f response_code = 200 uri = /v2p
25152024-11-26T05:30:33.185ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38507
25162024-11-26T05:30:33.185ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4120
25172024-11-26T05:30:33.231ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4144
25182024-11-26T05:30:33.296ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111098 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:38507 req_id = 7c75bad1-c6ab-48df-a613-5251dcecf10c response_code = 204 uri = /switch-ports
25192024-11-26T05:30:33.297ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41248
25202024-11-26T05:30:33.297ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8 values = ExternalIpGatewayMap { mappings: {} }
25212024-11-26T05:30:33.297ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61260 req_id = 1fcef2cc-5c25-43ed-9d74-e002c3aa0aa2 response_code = 204 uri = /eip-gateways
25222024-11-26T05:30:33.297ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 237 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38507 req_id = 94877a20-fa09-43bf-a81c-0af534cb8c51 response_code = 200 uri = /network-bootstore-config
25232024-11-26T05:30:33.297ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 205 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41248 req_id = 6783bb34-99f0-4849-9bcb-db2905740ac5 response_code = 200 uri = /v2p
25242024-11-26T05:30:33.306ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 213 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61260 req_id = dc575970-8a3c-4bef-8e60-4f85354348cf response_code = 204 uri = /vpc-routes
25252024-11-26T05:30:33.308ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57101
25262024-11-26T05:30:33.308ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4120
25272024-11-26T05:30:33.348ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4144
25282024-11-26T05:30:33.406ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98131 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:57101 req_id = b7ef5b4d-0fd7-4b63-bba7-84267ee84765 response_code = 204 uri = /switch-ports
25292024-11-26T05:30:33.406ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57101 req_id = 96e4d9b6-901f-4aa6-9a61-e65c794c796d response_code = 200 uri = /network-bootstore-config
25302024-11-26T05:30:39.449ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
25312024-11-26T05:30:39.449ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
25322024-11-26T05:30:39.451ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
25332024-11-26T05:30:39.452ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
25342024-11-26T05:30:42.922ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:47748
25352024-11-26T05:30:42.922ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 30 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:47748 req_id = 9f26db1e-628d-4e94-83b2-ad9e43ece301 response_code = 200 uri = /baseboard
25362024-11-26T05:30:49.454ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
25372024-11-26T05:30:49.455ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
25382024-11-26T05:30:49.457ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
25392024-11-26T05:30:49.458ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
25402024-11-26T05:30:59.458ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
25412024-11-26T05:30:59.459ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
25422024-11-26T05:30:59.461ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
25432024-11-26T05:30:59.462ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
25442024-11-26T05:31:02.252ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52500
25452024-11-26T05:31:02.252ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 185 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52500 req_id = 7844cc37-2f5d-4075-ad53-c66432887b1b response_code = 200 uri = /v2p
25462024-11-26T05:31:02.307ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51626
25472024-11-26T05:31:02.307ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51626 req_id = 5fc430f8-cf0a-470d-a3bd-cd0258f4d9d4 response_code = 200 uri = /vpc-routes
25482024-11-26T05:31:02.354ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8 values = ExternalIpGatewayMap { mappings: {} }
25492024-11-26T05:31:02.354ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51626 req_id = 84b045b3-6525-4479-a489-165eee16add0 response_code = 204 uri = /eip-gateways
25502024-11-26T05:31:02.364ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 176 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51626 req_id = 50011f7d-ddb1-4ded-a81e-679c8d520d19 response_code = 204 uri = /vpc-routes
25512024-11-26T05:31:02.425ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55008
25522024-11-26T05:31:02.425ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4120
25532024-11-26T05:31:02.466ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4144
25542024-11-26T05:31:02.521ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95693 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:55008 req_id = 0dc42dd0-3155-4108-ba7b-e03925e59d0e response_code = 204 uri = /switch-ports
25552024-11-26T05:31:02.521ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55008 req_id = 4d38384e-b20a-48d2-b58f-8cd4889710b4 response_code = 200 uri = /network-bootstore-config
25562024-11-26T05:31:03.034ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58340
25572024-11-26T05:31:03.035ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58340 req_id = e19aa42e-81c1-4b35-8c44-d96743423c0a response_code = 200 uri = /vpc-routes
25582024-11-26T05:31:03.119ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8 values = ExternalIpGatewayMap { mappings: {} }
25592024-11-26T05:31:03.119ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58340 req_id = 4e7ae615-f161-48fe-944d-7f69ae03e029 response_code = 204 uri = /eip-gateways
25602024-11-26T05:31:03.131ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 261 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58340 req_id = f463a79f-1c5d-4855-98a3-168a9d1c190d response_code = 204 uri = /vpc-routes
25612024-11-26T05:31:03.263ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39130
25622024-11-26T05:31:03.263ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39130 req_id = 8c29da40-df4c-4375-ada0-23726641de02 response_code = 200 uri = /v2p
25632024-11-26T05:31:03.318ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58523
25642024-11-26T05:31:03.318ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4120
25652024-11-26T05:31:03.363ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4144
25662024-11-26T05:31:03.423ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105515 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:58523 req_id = 4b4fa371-e72c-40b3-a8f3-f18416b23c65 response_code = 204 uri = /switch-ports
25672024-11-26T05:31:03.424ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58523 req_id = 5ee9de3f-b439-4550-8cf2-eeea42695ba2 response_code = 200 uri = /network-bootstore-config
25682024-11-26T05:31:03.458ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63561
25692024-11-26T05:31:03.458ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63561 req_id = 41860dba-b5c8-45cf-b280-1671e4568875 response_code = 200 uri = /vpc-routes
25702024-11-26T05:31:03.473ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8 values = ExternalIpGatewayMap { mappings: {} }
25712024-11-26T05:31:03.473ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63561 req_id = 2df2ed62-c230-4a27-8a00-579edae4b08d response_code = 204 uri = /eip-gateways
25722024-11-26T05:31:03.484ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63561 req_id = 8c5ccfdd-a99e-4a67-a4d5-0adb1cedf760 response_code = 204 uri = /vpc-routes
25732024-11-26T05:31:03.569ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38805
25742024-11-26T05:31:03.569ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38805 req_id = 76cf34a0-4d63-495a-bff9-74a14c1d0770 response_code = 200 uri = /v2p
25752024-11-26T05:31:03.575ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56817
25762024-11-26T05:31:03.576ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4120
25772024-11-26T05:31:03.617ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4144
25782024-11-26T05:31:03.677ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101393 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:56817 req_id = 7c8d54c1-9e6b-4d25-918a-bf774c70e420 response_code = 204 uri = /switch-ports
25792024-11-26T05:31:03.677ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56817 req_id = 6d73d7a7-9c69-4888-8304-29b2b282d4cb response_code = 200 uri = /network-bootstore-config
25802024-11-26T05:31:09.463ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
25812024-11-26T05:31:09.464ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
25822024-11-26T05:31:09.466ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
25832024-11-26T05:31:09.467ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
25842024-11-26T05:31:12.954ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:46320
25852024-11-26T05:31:12.955ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 28 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:46320 req_id = a899b1a2-0d70-4c48-9f7b-34f367c50811 response_code = 200 uri = /baseboard
25862024-11-26T05:31:19.468ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
25872024-11-26T05:31:19.468ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
25882024-11-26T05:31:19.470ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
25892024-11-26T05:31:19.471ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
25902024-11-26T05:31:29.471ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
25912024-11-26T05:31:29.471ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
25922024-11-26T05:31:29.473ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
25932024-11-26T05:31:29.474ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
25942024-11-26T05:31:32.210ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36226
25952024-11-26T05:31:32.210ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36226 req_id = eedb56cb-0494-4b66-9cdf-bb89c6607a4a response_code = 200 uri = /vpc-routes
25962024-11-26T05:31:32.259ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8 values = ExternalIpGatewayMap { mappings: {} }
25972024-11-26T05:31:32.259ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36226 req_id = 244b5c3a-b89c-48e0-8409-f8eca6e06c60 response_code = 204 uri = /eip-gateways
25982024-11-26T05:31:32.268ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 196 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36226 req_id = ed2357f8-2d5b-4288-b11e-8f2c105db322 response_code = 204 uri = /vpc-routes
25992024-11-26T05:31:32.327ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48045
26002024-11-26T05:31:32.327ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48045 req_id = 22e433c4-2c9d-4a7a-adf8-c189bee58852 response_code = 200 uri = /v2p
26012024-11-26T05:31:32.341ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38490
26022024-11-26T05:31:32.341ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4120
26032024-11-26T05:31:32.383ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4144
26042024-11-26T05:31:32.443ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102383 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:38490 req_id = 861340c3-f6c6-4fd2-b8a1-91ecae013882 response_code = 204 uri = /switch-ports
26052024-11-26T05:31:32.443ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38490 req_id = 0b1142bb-1acb-4fae-b736-863bbcb97ed1 response_code = 200 uri = /network-bootstore-config
26062024-11-26T05:31:33.040ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58902
26072024-11-26T05:31:33.040ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58902 req_id = 6c145955-065f-4705-8914-bdf40c35d9d5 response_code = 200 uri = /vpc-routes
26082024-11-26T05:31:33.056ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8 values = ExternalIpGatewayMap { mappings: {} }
26092024-11-26T05:31:33.056ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58902 req_id = 4d095690-82be-4244-933a-97ed3d4d90ab response_code = 204 uri = /eip-gateways
26102024-11-26T05:31:33.065ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58902 req_id = 695f2c76-e491-443e-8e61-1bceb8b6a92a response_code = 204 uri = /vpc-routes
26112024-11-26T05:31:33.113ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52080
26122024-11-26T05:31:33.113ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52080 req_id = 83a68ca2-967d-483c-9945-94486b3883a8 response_code = 200 uri = /v2p
26132024-11-26T05:31:33.118ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44617
26142024-11-26T05:31:33.118ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4120
26152024-11-26T05:31:33.164ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4144
26162024-11-26T05:31:33.224ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105911 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:44617 req_id = 78192fd1-dd3d-4b69-bf5e-c29b719ac082 response_code = 204 uri = /switch-ports
26172024-11-26T05:31:33.225ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42940
26182024-11-26T05:31:33.225ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44617 req_id = ed0d13cb-6dd7-40ee-a2f2-c01e107c3371 response_code = 200 uri = /network-bootstore-config
26192024-11-26T05:31:33.225ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42940 req_id = dc904a1c-2ae7-4ca5-87bd-76c491a001af response_code = 200 uri = /vpc-routes
26202024-11-26T05:31:33.259ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50503
26212024-11-26T05:31:33.259ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4120
26222024-11-26T05:31:33.300ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4144
26232024-11-26T05:31:33.357ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98726 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:50503 req_id = b411aac3-29ee-4f75-be61-2311334b2517 response_code = 204 uri = /switch-ports
26242024-11-26T05:31:33.358ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8 values = ExternalIpGatewayMap { mappings: {} }
26252024-11-26T05:31:33.358ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61990
26262024-11-26T05:31:33.358ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42940 req_id = ebf11a54-d4d3-413a-a57a-e6d8fdbb1be2 response_code = 204 uri = /eip-gateways
26272024-11-26T05:31:33.358ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 255 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50503 req_id = 4c200584-29d3-4d4a-8451-34f19615d03a response_code = 200 uri = /network-bootstore-config
26282024-11-26T05:31:33.358ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 235 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61990 req_id = 08750b31-e944-4ec0-a19a-4b0e46b3734f response_code = 200 uri = /v2p
26292024-11-26T05:31:33.368ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42940 req_id = 92802a29-13de-4c26-8d08-c96cc06e5d38 response_code = 204 uri = /vpc-routes
26302024-11-26T05:31:39.475ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
26312024-11-26T05:31:39.476ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
26322024-11-26T05:31:39.478ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
26332024-11-26T05:31:39.479ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
26342024-11-26T05:31:42.989ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:33072
26352024-11-26T05:31:42.989ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:33072 req_id = 2fdb66a9-c798-4615-9a9f-d7086b2a3b53 response_code = 200 uri = /baseboard
26362024-11-26T05:31:49.479ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
26372024-11-26T05:31:49.479ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
26382024-11-26T05:31:49.481ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
26392024-11-26T05:31:49.482ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
26402024-11-26T05:31:59.484ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
26412024-11-26T05:31:59.484ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
26422024-11-26T05:31:59.486ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
26432024-11-26T05:31:59.487ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
26442024-11-26T05:32:02.427ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57359
26452024-11-26T05:32:02.427ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57359 req_id = efafcdda-fd28-4d69-916d-4ac2376750cc response_code = 200 uri = /vpc-routes
26462024-11-26T05:32:02.487ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8 values = ExternalIpGatewayMap { mappings: {} }
26472024-11-26T05:32:02.487ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57359 req_id = 8ab99bb5-805f-459b-b7e7-7bb131026b14 response_code = 204 uri = /eip-gateways
26482024-11-26T05:32:02.497ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 207 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57359 req_id = 13d83534-3cfb-472e-bc8f-61be9c33f3f7 response_code = 204 uri = /vpc-routes
26492024-11-26T05:32:02.556ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50998
26502024-11-26T05:32:02.556ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50998 req_id = 4141061b-cbef-4df4-8a91-8ea11ff44b55 response_code = 200 uri = /v2p
26512024-11-26T05:32:02.585ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46025
26522024-11-26T05:32:02.585ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4120
26532024-11-26T05:32:02.627ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4144
26542024-11-26T05:32:02.687ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101890 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:46025 req_id = 2ac3a57d-21e2-438b-ac2e-c238e981b11c response_code = 204 uri = /switch-ports
26552024-11-26T05:32:02.687ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46025 req_id = 3a8408e8-6712-432c-a370-6be9b97fd6fc response_code = 200 uri = /network-bootstore-config
26562024-11-26T05:32:03.101ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55043
26572024-11-26T05:32:03.101ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55043 req_id = 6e9ace3b-c2f5-4a79-8c0e-74e9501ad398 response_code = 200 uri = /vpc-routes
26582024-11-26T05:32:03.126ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8 values = ExternalIpGatewayMap { mappings: {} }
26592024-11-26T05:32:03.126ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55043 req_id = 2a10838a-9e36-47f7-a89c-7bbd399dec90 response_code = 204 uri = /eip-gateways
26602024-11-26T05:32:03.137ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 233 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55043 req_id = ae05967b-ae0c-4093-baae-b90c60ec0c98 response_code = 204 uri = /vpc-routes
26612024-11-26T05:32:03.287ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33904
26622024-11-26T05:32:03.287ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33904 req_id = b41b6200-0ef9-410d-a3be-38651c7c7487 response_code = 200 uri = /v2p
26632024-11-26T05:32:03.333ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48073
26642024-11-26T05:32:03.333ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48073 req_id = 8efa2889-9531-425f-a29b-bf78ac80f593 response_code = 200 uri = /vpc-routes
26652024-11-26T05:32:03.384ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61706
26662024-11-26T05:32:03.384ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61706 req_id = 88aa9fc5-3106-468c-9204-c933d4693bb7 response_code = 200 uri = /v2p
26672024-11-26T05:32:03.394ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60898
26682024-11-26T05:32:03.394ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4120
26692024-11-26T05:32:03.435ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4144
26702024-11-26T05:32:03.496ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101637 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:60898 req_id = ff5f40be-bf5c-482f-9dcf-bbb9d436fefb response_code = 204 uri = /switch-ports
26712024-11-26T05:32:03.496ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8 values = ExternalIpGatewayMap { mappings: {} }
26722024-11-26T05:32:03.496ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48073 req_id = 24db95c3-c523-4ed2-90c9-10c47beeb269 response_code = 204 uri = /eip-gateways
26732024-11-26T05:32:03.496ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 231 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60898 req_id = 19f1916f-33d3-4284-aca3-1507e565b32f response_code = 200 uri = /network-bootstore-config
26742024-11-26T05:32:03.507ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 290 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48073 req_id = af4f019f-ff3e-40b2-a7a1-8dcd7ea2a8f4 response_code = 204 uri = /vpc-routes
26752024-11-26T05:32:03.533ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64370
26762024-11-26T05:32:03.533ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4120
26772024-11-26T05:32:03.574ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4144
26782024-11-26T05:32:03.634ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100563 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:64370 req_id = ecde0042-8358-450a-95ca-29ec977a4ccc response_code = 204 uri = /switch-ports
26792024-11-26T05:32:03.637ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64370 req_id = 69b1a5e6-9253-4dd0-ac3f-663623fb2152 response_code = 200 uri = /network-bootstore-config
26802024-11-26T05:32:09.488ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
26812024-11-26T05:32:09.489ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
26822024-11-26T05:32:09.491ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
26832024-11-26T05:32:09.492ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
26842024-11-26T05:32:13.023ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:39400
26852024-11-26T05:32:13.023ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:39400 req_id = 446a3aff-7614-4a85-8d8d-844c245b235e response_code = 200 uri = /baseboard
26862024-11-26T05:32:19.492ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
26872024-11-26T05:32:19.493ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
26882024-11-26T05:32:19.495ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
26892024-11-26T05:32:19.496ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
26902024-11-26T05:32:29.497ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
26912024-11-26T05:32:29.498ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
26922024-11-26T05:32:29.500ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
26932024-11-26T05:32:29.501ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
26942024-11-26T05:32:32.200ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44319
26952024-11-26T05:32:32.200ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44319 req_id = 0ef4b290-eafd-4928-81a6-093266205bfe response_code = 200 uri = /vpc-routes
26962024-11-26T05:32:32.259ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8 values = ExternalIpGatewayMap { mappings: {} }
26972024-11-26T05:32:32.259ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44319 req_id = 71feabbe-8599-4c18-80e6-f6b529dad1bb response_code = 204 uri = /eip-gateways
26982024-11-26T05:32:32.268ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44319 req_id = 0a01984a-58e0-4667-a033-1e4a1823c076 response_code = 204 uri = /vpc-routes
26992024-11-26T05:32:32.301ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58861
27002024-11-26T05:32:32.301ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4120
27012024-11-26T05:32:32.343ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4144
27022024-11-26T05:32:32.401ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100072 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:58861 req_id = 4ceb69d7-4439-4594-9150-955cdbedd0b4 response_code = 204 uri = /switch-ports
27032024-11-26T05:32:32.401ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65436
27042024-11-26T05:32:32.402ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 245 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58861 req_id = 7446ac9f-cf9e-485d-8860-8dbc7c03c9ae response_code = 200 uri = /network-bootstore-config
27052024-11-26T05:32:32.402ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 269 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65436 req_id = 333f903d-66c8-4236-b32f-7882a834c122 response_code = 200 uri = /v2p
27062024-11-26T05:32:32.960ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34884
27072024-11-26T05:32:32.960ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34884 req_id = 72ce3e3b-2be1-4a0c-b55e-ece5e63e4b41 response_code = 200 uri = /vpc-routes
27082024-11-26T05:32:32.978ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8 values = ExternalIpGatewayMap { mappings: {} }
27092024-11-26T05:32:32.978ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34884 req_id = d92cbb9f-7374-46ab-b44d-b4d2ce176409 response_code = 204 uri = /eip-gateways
27102024-11-26T05:32:32.997ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 238 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34884 req_id = eaa949cd-34dc-490b-a2f5-afd795f11f45 response_code = 204 uri = /vpc-routes
27112024-11-26T05:32:33.047ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44920
27122024-11-26T05:32:33.048ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44920 req_id = c097ec25-a4fe-4548-b1af-caabd25ede50 response_code = 200 uri = /v2p
27132024-11-26T05:32:33.104ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40763
27142024-11-26T05:32:33.104ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4120
27152024-11-26T05:32:33.152ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4144
27162024-11-26T05:32:33.222ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117630 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:40763 req_id = 77c5e559-f415-469a-9520-25d258c405d9 response_code = 204 uri = /switch-ports
27172024-11-26T05:32:33.222ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44610
27182024-11-26T05:32:33.222ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44610 req_id = b472b155-4391-46bf-8462-54240be634fc response_code = 200 uri = /vpc-routes
27192024-11-26T05:32:33.222ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40763 req_id = 64051a7d-2bef-479a-81e6-6d093f407c1a response_code = 200 uri = /network-bootstore-config
27202024-11-26T05:32:33.245ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8 values = ExternalIpGatewayMap { mappings: {} }
27212024-11-26T05:32:33.245ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44610 req_id = 1d04bd00-7e4c-4053-ab3b-5d62c8a318d8 response_code = 204 uri = /eip-gateways
27222024-11-26T05:32:33.250ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60355
27232024-11-26T05:32:33.251ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 209 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60355 req_id = 14a39d35-b783-4a36-84ec-261fbfb413a6 response_code = 200 uri = /v2p
27242024-11-26T05:32:33.256ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58083
27252024-11-26T05:32:33.256ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4120
27262024-11-26T05:32:33.301ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4144
27272024-11-26T05:32:33.372ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115845 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:58083 req_id = 671a776e-4ac8-49a2-a671-44d99d1d06d5 response_code = 204 uri = /switch-ports
27282024-11-26T05:32:33.372ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 260 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58083 req_id = 5a95db43-f04f-4c8e-9d41-ec5259c1033f response_code = 200 uri = /network-bootstore-config
27292024-11-26T05:32:33.373ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 338 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44610 req_id = 400f547b-13dd-4c51-a172-a34261c285da response_code = 204 uri = /vpc-routes
27302024-11-26T05:32:39.504ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
27312024-11-26T05:32:39.505ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
27322024-11-26T05:32:39.507ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
27332024-11-26T05:32:39.507ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
27342024-11-26T05:32:43.055ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:56476
27352024-11-26T05:32:43.055ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:56476 req_id = 220dbee3-2f1a-4c85-a95a-4b533122074f response_code = 200 uri = /baseboard
27362024-11-26T05:32:49.507ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
27372024-11-26T05:32:49.508ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
27382024-11-26T05:32:49.510ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
27392024-11-26T05:32:49.511ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
27402024-11-26T05:32:59.512ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
27412024-11-26T05:32:59.512ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
27422024-11-26T05:32:59.516ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
27432024-11-26T05:32:59.518ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
27442024-11-26T05:33:02.460ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34768
27452024-11-26T05:33:02.460ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34768 req_id = 4d4e26ae-2343-4d18-af3c-bd275f0e24c9 response_code = 200 uri = /vpc-routes
27462024-11-26T05:33:02.482ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8 values = ExternalIpGatewayMap { mappings: {} }
27472024-11-26T05:33:02.482ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34768 req_id = e7ab867a-c64d-4f41-ab53-0c674525a0ee response_code = 204 uri = /eip-gateways
27482024-11-26T05:33:02.492ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 230 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34768 req_id = a298b2c1-1b23-45a0-b71a-38f1dc1fb4ad response_code = 204 uri = /vpc-routes
27492024-11-26T05:33:02.562ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44552
27502024-11-26T05:33:02.562ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44552 req_id = 2862cc19-24af-4b00-bd1d-00cfe2c93a3a response_code = 200 uri = /v2p
27512024-11-26T05:33:02.574ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64315
27522024-11-26T05:33:02.574ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4120
27532024-11-26T05:33:02.616ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4144
27542024-11-26T05:33:02.675ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100796 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:64315 req_id = adb341ed-3bac-4f36-bc29-89a3a324ba9b response_code = 204 uri = /switch-ports
27552024-11-26T05:33:02.675ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64315 req_id = dd8cb247-3a98-4597-b49f-ca588396d6b5 response_code = 200 uri = /network-bootstore-config
27562024-11-26T05:33:03.077ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62702
27572024-11-26T05:33:03.077ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62702 req_id = 515bace4-7af3-4acb-8559-a844fbbc6106 response_code = 200 uri = /vpc-routes
27582024-11-26T05:33:03.092ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8 values = ExternalIpGatewayMap { mappings: {} }
27592024-11-26T05:33:03.092ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62702 req_id = ea109324-8739-4d47-b1e6-b5519a50c8f2 response_code = 204 uri = /eip-gateways
27602024-11-26T05:33:03.114ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62702 req_id = f66d6c79-9ad5-427b-96b3-77b0c2445141 response_code = 204 uri = /vpc-routes
27612024-11-26T05:33:03.167ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61604
27622024-11-26T05:33:03.167ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 200 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61604 req_id = 85c4ff87-0837-4004-85b5-bf8e0ff1eb39 response_code = 200 uri = /v2p
27632024-11-26T05:33:03.225ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46589
27642024-11-26T05:33:03.225ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4120
27652024-11-26T05:33:03.263ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4144
27662024-11-26T05:33:03.315ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90603 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:46589 req_id = d7764722-3d69-48de-9810-1f0280aa60fe response_code = 204 uri = /switch-ports
27672024-11-26T05:33:03.316ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46589 req_id = 74b33374-bdba-4233-85a3-0bcd90d1acd6 response_code = 200 uri = /network-bootstore-config
27682024-11-26T05:33:03.474ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64104
27692024-11-26T05:33:03.474ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64104 req_id = 089ab6c8-93fc-4e2a-8f11-57a598777a70 response_code = 200 uri = /vpc-routes
27702024-11-26T05:33:03.490ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8 values = ExternalIpGatewayMap { mappings: {} }
27712024-11-26T05:33:03.490ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64104 req_id = 1f564c54-8e20-4eff-b769-3118e78078ce response_code = 204 uri = /eip-gateways
27722024-11-26T05:33:03.580ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49442
27732024-11-26T05:33:03.580ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49442 req_id = b7dc6d63-e872-4c70-a9fc-4c6c2094bd50 response_code = 200 uri = /v2p
27742024-11-26T05:33:03.584ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64104 req_id = def57f16-fdb6-4969-b792-3baf247e5761 response_code = 204 uri = /vpc-routes
27752024-11-26T05:33:03.595ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51638
27762024-11-26T05:33:03.595ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4120
27772024-11-26T05:33:03.638ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4144
27782024-11-26T05:33:03.695ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99635 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:51638 req_id = fb123a17-4407-4d0a-a4cf-eed4f9ca413c response_code = 204 uri = /switch-ports
27792024-11-26T05:33:03.698ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51638 req_id = 7490be71-cc58-413e-a62c-b7592dc017f5 response_code = 200 uri = /network-bootstore-config
27802024-11-26T05:33:09.516ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
27812024-11-26T05:33:09.517ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
27822024-11-26T05:33:09.519ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
27832024-11-26T05:33:09.520ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
27842024-11-26T05:33:13.088ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:56068
27852024-11-26T05:33:13.088ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:56068 req_id = 0ab483ec-1b1b-4ea4-9e05-e8b832520f13 response_code = 200 uri = /baseboard
27862024-11-26T05:33:19.520ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
27872024-11-26T05:33:19.521ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
27882024-11-26T05:33:19.522ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
27892024-11-26T05:33:19.523ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
27902024-11-26T05:33:29.524ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
27912024-11-26T05:33:29.525ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
27922024-11-26T05:33:29.527ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
27932024-11-26T05:33:29.528ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
27942024-11-26T05:33:32.265ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63640
27952024-11-26T05:33:32.265ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63640 req_id = 5850b5ad-6514-41dc-829d-380e32353836 response_code = 200 uri = /vpc-routes
27962024-11-26T05:33:32.319ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8 values = ExternalIpGatewayMap { mappings: {} }
27972024-11-26T05:33:32.319ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63640 req_id = c227ae4e-2951-4f14-bf25-ac739da4b08f response_code = 204 uri = /eip-gateways
27982024-11-26T05:33:32.326ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35111
27992024-11-26T05:33:32.326ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4120
28002024-11-26T05:33:32.376ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4144
28012024-11-26T05:33:32.449ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122113 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:35111 req_id = 6d78170d-61fa-49f6-8850-8823a09c76f6 response_code = 204 uri = /switch-ports
28022024-11-26T05:33:32.449ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57292
28032024-11-26T05:33:32.449ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 356 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35111 req_id = 5003b885-7838-4362-802f-94c60d5b6461 response_code = 200 uri = /network-bootstore-config
28042024-11-26T05:33:32.449ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 461 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63640 req_id = b6a6fabd-2fcb-4a97-a23a-9694ba8aeba0 response_code = 204 uri = /vpc-routes
28052024-11-26T05:33:32.449ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 331 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57292 req_id = 268d9134-49fc-48ad-9016-1487b5663c46 response_code = 200 uri = /v2p
28062024-11-26T05:33:32.905ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33240
28072024-11-26T05:33:32.905ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33240 req_id = b32650fa-23d2-4ef3-a403-5f02aafca3e0 response_code = 200 uri = /vpc-routes
28082024-11-26T05:33:32.948ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8 values = ExternalIpGatewayMap { mappings: {} }
28092024-11-26T05:33:32.948ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33240 req_id = 94d60c5d-971a-44f3-befa-75d0e36ee573 response_code = 204 uri = /eip-gateways
28102024-11-26T05:33:33.015ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54496
28112024-11-26T05:33:33.015ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54496 req_id = d381a477-b764-478f-a50b-2b3f57debdfb response_code = 200 uri = /v2p
28122024-11-26T05:33:33.018ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 160 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33240 req_id = b4036fdd-6f19-4631-8f6a-8e0e5873be98 response_code = 204 uri = /vpc-routes
28132024-11-26T05:33:33.093ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47802
28142024-11-26T05:33:33.093ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4120
28152024-11-26T05:33:33.135ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4144
28162024-11-26T05:33:33.204ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111747 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:47802 req_id = 080015ba-bafb-4af9-94d4-1b9fa282d311 response_code = 204 uri = /switch-ports
28172024-11-26T05:33:33.205ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58894
28182024-11-26T05:33:33.205ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58894 req_id = 4124e161-4f51-4e70-b39a-55b15c98c51d response_code = 200 uri = /vpc-routes
28192024-11-26T05:33:33.205ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47802 req_id = 6f87ca1e-843a-4c00-90a5-2cac32be4285 response_code = 200 uri = /network-bootstore-config
28202024-11-26T05:33:33.252ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8 values = ExternalIpGatewayMap { mappings: {} }
28212024-11-26T05:33:33.252ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58894 req_id = cfe0ec0f-c083-4485-94e4-221744bc81b1 response_code = 204 uri = /eip-gateways
28222024-11-26T05:33:33.261ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 228 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58894 req_id = db89aef7-3322-4835-8cc0-150272bfbf85 response_code = 204 uri = /vpc-routes
28232024-11-26T05:33:33.308ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44739
28242024-11-26T05:33:33.309ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44739 req_id = 870758d6-d51c-4ce9-8e9d-148676a4398b response_code = 200 uri = /v2p
28252024-11-26T05:33:33.310ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47822
28262024-11-26T05:33:33.311ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4120
28272024-11-26T05:33:33.355ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4144
28282024-11-26T05:33:33.417ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106314 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:47822 req_id = a4a58971-9c60-477c-9355-970390a479d9 response_code = 204 uri = /switch-ports
28292024-11-26T05:33:33.417ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47822 req_id = 3ffd3379-f019-419e-96d5-f4230d9f2bb3 response_code = 200 uri = /network-bootstore-config
28302024-11-26T05:33:39.529ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
28312024-11-26T05:33:39.530ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
28322024-11-26T05:33:39.533ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
28332024-11-26T05:33:39.534ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
28342024-11-26T05:33:43.121ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:51121
28352024-11-26T05:33:43.122ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:51121 req_id = 4a30103f-723e-40b8-892b-be983e545d8d response_code = 200 uri = /baseboard
28362024-11-26T05:33:49.533ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
28372024-11-26T05:33:49.534ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
28382024-11-26T05:33:49.536ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
28392024-11-26T05:33:49.537ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
28402024-11-26T05:33:59.537ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
28412024-11-26T05:33:59.538ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
28422024-11-26T05:33:59.540ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
28432024-11-26T05:33:59.541ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
28442024-11-26T05:34:02.433ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36403
28452024-11-26T05:34:02.434ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36403 req_id = 72cfa779-af64-45b1-9e33-426389050594 response_code = 200 uri = /vpc-routes
28462024-11-26T05:34:02.466ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39232
28472024-11-26T05:34:02.467ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39232 req_id = 7f7b3c94-0cd6-48c8-8ff3-f89a7c6e6050 response_code = 200 uri = /v2p
28482024-11-26T05:34:02.482ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38579
28492024-11-26T05:34:02.483ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1dbf9b5b-ede3-4cf4-b0d0-091aa188969a, kind: Service { id: 4e9fd39d-4113-4491-beca-e49e9a07f310 }, name: Name("external-dns-4e9fd39d-4113-4491-beca-e49e9a07f310"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 201, 3])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 2f3ae2da-b0e7-4755-a7ae-d54ffe51eccc, kind: Service { id: 7de56ef8-bdda-46b0-a9a9-fa5e97a778c5 }, name: Name("external-dns-7de56ef8-bdda-46b0-a9a9-fa5e97a778c5"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 146])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: afc30658-25b2-44db-9d11-ba075ebc447b, kind: Service { id: de715031-fa5a-4cf9-bf82-9cec9db59d81 }, name: Name("nexus-de715031-fa5a-4cf9-bf82-9cec9db59d81"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 180, 14])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e7b24131-9921-4152-b1bb-f948db445563, kind: Service { id: ccf769ca-e6aa-41c6-80d6-7f1cfa2a624a }, name: Name("nexus-ccf769ca-e6aa-41c6-80d6-7f1cfa2a624a"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 212, 242])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f88dd6c2-772e-44fb-bf3f-d4557d3228a8, kind: Service { id: eea1c48b-e597-47f2-a9c9-8bf328dab7cd }, name: Name("nexus-eea1c48b-e597-47f2-a9c9-8bf328dab7cd"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 159, 25])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
28502024-11-26T05:34:02.483ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28512024-11-26T05:34:02.483ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28522024-11-26T05:34:02.483ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28532024-11-26T05:34:02.483ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28542024-11-26T05:34:02.483ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
28552024-11-26T05:34:02.483ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28562024-11-26T05:34:02.483ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 406 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38579 req_id = 9e345b45-1b6c-43d5-9819-f61c1fec87eb response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
28572024-11-26T05:34:02.509ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8 values = ExternalIpGatewayMap { mappings: {} }
28582024-11-26T05:34:02.509ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36403 req_id = 9aeeef8c-03d0-44d0-abfb-315495263ec9 response_code = 204 uri = /eip-gateways
28592024-11-26T05:34:02.545ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43880
28602024-11-26T05:34:02.545ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
28612024-11-26T05:34:02.545ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
28622024-11-26T05:34:02.545ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8488adc3-a35c-4d33-bd61-39dfc8c64c55/config/omicron-zones.json file = common/src/ledger.rs:177
28632024-11-26T05:34:02.545ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/e4c38366-5212-46e4-b3d0-f797c1f6a6ba/config/omicron-zones.json file = common/src/ledger.rs:177
28642024-11-26T05:34:02.552ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 819 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36403 req_id = 2d3753fa-f200-477e-998f-e3a1ed2434ca response_code = 204 uri = /vpc-routes
28652024-11-26T05:34:02.559ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53818
28662024-11-26T05:34:02.559ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4120
28672024-11-26T05:34:02.563ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1b72df9a-7b76-458e-9ee3-3ca99732ea65 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28682024-11-26T05:34:02.564ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_1b72df9a-7b76-458e-9ee3-3ca99732ea65
28692024-11-26T05:34:02.592ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 13de655b-3793-4d59-8bc1-22889b3fb01b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28702024-11-26T05:34:02.593ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_13de655b-3793-4d59-8bc1-22889b3fb01b
28712024-11-26T05:34:02.600ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4144
28722024-11-26T05:34:02.617ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 06ee1c63-02b8-46d6-96ed-aa8ab7a8d522 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28732024-11-26T05:34:02.620ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_06ee1c63-02b8-46d6-96ed-aa8ab7a8d522
28742024-11-26T05:34:02.643ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4fe72516-6144-43ef-96ee-e7fbaeb34f42 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28752024-11-26T05:34:02.643ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_4fe72516-6144-43ef-96ee-e7fbaeb34f42
28762024-11-26T05:34:02.663ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104342 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:53818 req_id = e136efe5-676e-4a44-ac50-7ec7bb28217f response_code = 204 uri = /switch-ports
28772024-11-26T05:34:02.664ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53818 req_id = ac04e9db-568d-44ae-9b7a-87ba5ab6345f response_code = 200 uri = /network-bootstore-config
28782024-11-26T05:34:02.669ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 580c5897-a97f-4c76-9a8f-bf80d62b760e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28792024-11-26T05:34:02.669ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_580c5897-a97f-4c76-9a8f-bf80d62b760e
28802024-11-26T05:34:02.696ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 62fc8f20-7ce8-489b-a022-013df6640479 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28812024-11-26T05:34:02.696ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_62fc8f20-7ce8-489b-a022-013df6640479
28822024-11-26T05:34:02.719ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: af39775d-5158-4242-88aa-5dd2d3c14817 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28832024-11-26T05:34:02.719ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_af39775d-5158-4242-88aa-5dd2d3c14817
28842024-11-26T05:34:02.741ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9bc99efb-91b7-405a-b8dd-0949d11c1f4a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28852024-11-26T05:34:02.741ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_9bc99efb-91b7-405a-b8dd-0949d11c1f4a
28862024-11-26T05:34:02.764ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: da133136-28dd-4eff-a3ed-9f84ec495a60 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28872024-11-26T05:34:02.764ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_da133136-28dd-4eff-a3ed-9f84ec495a60
28882024-11-26T05:34:02.774ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 229623 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43880 req_id = 9bc46c85-f777-44ba-ba86-c059028e0d3b response_code = 200 uri = /inventory
28892024-11-26T05:34:03.144ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54602
28902024-11-26T05:34:03.144ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54602 req_id = 826c905a-20d6-4da9-a92c-c6f41efd94cf response_code = 200 uri = /vpc-routes
28912024-11-26T05:34:03.194ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57363
28922024-11-26T05:34:03.195ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57363 req_id = d7a5def4-a473-4111-9eb6-874cd81c8d9a response_code = 200 uri = /vpc-routes
28932024-11-26T05:34:03.199ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8 values = ExternalIpGatewayMap { mappings: {} }
28942024-11-26T05:34:03.199ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54602 req_id = 1e5b62af-9fdc-4b38-a688-48348d7c43bc response_code = 204 uri = /eip-gateways
28952024-11-26T05:34:03.213ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 216 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54602 req_id = 9ce91989-107d-4cd0-bac6-5ea8f1549907 response_code = 204 uri = /vpc-routes
28962024-11-26T05:34:03.254ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8 values = ExternalIpGatewayMap { mappings: {} }
28972024-11-26T05:34:03.254ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57363 req_id = 6fc74d57-db69-4e5f-bf61-fbf33696d22f response_code = 204 uri = /eip-gateways
28982024-11-26T05:34:03.288ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36892
28992024-11-26T05:34:03.289ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36892 req_id = 095aa1fe-d735-4441-90db-423a6f1e30e5 response_code = 200 uri = /v2p
29002024-11-26T05:34:03.318ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60879
29012024-11-26T05:34:03.318ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4120
29022024-11-26T05:34:03.366ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4144
29032024-11-26T05:34:03.441ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123411 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:60879 req_id = 12f35924-7628-44b6-baf8-d486e5596784 response_code = 204 uri = /switch-ports
29042024-11-26T05:34:03.442ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60879 req_id = 4995a729-0dd7-407c-8d79-6b891de34ac5 response_code = 200 uri = /network-bootstore-config
29052024-11-26T05:34:03.447ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37607
29062024-11-26T05:34:03.447ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
29072024-11-26T05:34:03.447ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
29082024-11-26T05:34:03.447ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8488adc3-a35c-4d33-bd61-39dfc8c64c55/config/omicron-zones.json file = common/src/ledger.rs:177
29092024-11-26T05:34:03.447ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/e4c38366-5212-46e4-b3d0-f797c1f6a6ba/config/omicron-zones.json file = common/src/ledger.rs:177
29102024-11-26T05:34:03.458ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46788
29112024-11-26T05:34:03.458ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46788 req_id = a809f138-918c-4a32-a143-9ab6d4eab0ea response_code = 200 uri = /v2p
29122024-11-26T05:34:03.461ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1b72df9a-7b76-458e-9ee3-3ca99732ea65 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29132024-11-26T05:34:03.461ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_1b72df9a-7b76-458e-9ee3-3ca99732ea65
29142024-11-26T05:34:03.468ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 226 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57363 req_id = 5f9136d4-f184-40ef-a21d-86330a7f7528 response_code = 204 uri = /vpc-routes
29152024-11-26T05:34:03.489ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 13de655b-3793-4d59-8bc1-22889b3fb01b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29162024-11-26T05:34:03.489ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_13de655b-3793-4d59-8bc1-22889b3fb01b
29172024-11-26T05:34:03.515ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54414
29182024-11-26T05:34:03.515ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4120
29192024-11-26T05:34:03.522ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 06ee1c63-02b8-46d6-96ed-aa8ab7a8d522 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29202024-11-26T05:34:03.523ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_06ee1c63-02b8-46d6-96ed-aa8ab7a8d522
29212024-11-26T05:34:03.534ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37791
29222024-11-26T05:34:03.534ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1dbf9b5b-ede3-4cf4-b0d0-091aa188969a, kind: Service { id: 4e9fd39d-4113-4491-beca-e49e9a07f310 }, name: Name("external-dns-4e9fd39d-4113-4491-beca-e49e9a07f310"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 201, 3])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 2f3ae2da-b0e7-4755-a7ae-d54ffe51eccc, kind: Service { id: 7de56ef8-bdda-46b0-a9a9-fa5e97a778c5 }, name: Name("external-dns-7de56ef8-bdda-46b0-a9a9-fa5e97a778c5"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 146])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: afc30658-25b2-44db-9d11-ba075ebc447b, kind: Service { id: de715031-fa5a-4cf9-bf82-9cec9db59d81 }, name: Name("nexus-de715031-fa5a-4cf9-bf82-9cec9db59d81"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 180, 14])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e7b24131-9921-4152-b1bb-f948db445563, kind: Service { id: ccf769ca-e6aa-41c6-80d6-7f1cfa2a624a }, name: Name("nexus-ccf769ca-e6aa-41c6-80d6-7f1cfa2a624a"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 212, 242])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f88dd6c2-772e-44fb-bf3f-d4557d3228a8, kind: Service { id: eea1c48b-e597-47f2-a9c9-8bf328dab7cd }, name: Name("nexus-eea1c48b-e597-47f2-a9c9-8bf328dab7cd"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 159, 25])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
29232024-11-26T05:34:03.535ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
29242024-11-26T05:34:03.535ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
29252024-11-26T05:34:03.535ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
29262024-11-26T05:34:03.535ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
29272024-11-26T05:34:03.535ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
29282024-11-26T05:34:03.535ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
29292024-11-26T05:34:03.535ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 647 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37791 req_id = d60e3a55-1789-4944-ab99-12aab643f3a5 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
29302024-11-26T05:34:03.549ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4fe72516-6144-43ef-96ee-e7fbaeb34f42 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29312024-11-26T05:34:03.550ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_4fe72516-6144-43ef-96ee-e7fbaeb34f42
29322024-11-26T05:34:03.555ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4144
29332024-11-26T05:34:03.575ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 580c5897-a97f-4c76-9a8f-bf80d62b760e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29342024-11-26T05:34:03.576ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_580c5897-a97f-4c76-9a8f-bf80d62b760e
29352024-11-26T05:34:03.604ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 62fc8f20-7ce8-489b-a022-013df6640479 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29362024-11-26T05:34:03.604ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_62fc8f20-7ce8-489b-a022-013df6640479
29372024-11-26T05:34:03.628ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113232 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:54414 req_id = 8eccfe43-8c73-498c-b81d-63e87f94a6cd response_code = 204 uri = /switch-ports
29382024-11-26T05:34:03.628ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54414 req_id = 07fd5ea0-cb9e-4981-89b1-621cafd0f3c1 response_code = 200 uri = /network-bootstore-config
29392024-11-26T05:34:03.635ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: af39775d-5158-4242-88aa-5dd2d3c14817 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29402024-11-26T05:34:03.635ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_af39775d-5158-4242-88aa-5dd2d3c14817
29412024-11-26T05:34:03.647ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50823
29422024-11-26T05:34:03.651ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
29432024-11-26T05:34:03.651ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
29442024-11-26T05:34:03.651ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8488adc3-a35c-4d33-bd61-39dfc8c64c55/config/omicron-zones.json file = common/src/ledger.rs:177
29452024-11-26T05:34:03.657ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/e4c38366-5212-46e4-b3d0-f797c1f6a6ba/config/omicron-zones.json file = common/src/ledger.rs:177
29462024-11-26T05:34:03.664ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9bc99efb-91b7-405a-b8dd-0949d11c1f4a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29472024-11-26T05:34:03.664ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_9bc99efb-91b7-405a-b8dd-0949d11c1f4a
29482024-11-26T05:34:03.678ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1b72df9a-7b76-458e-9ee3-3ca99732ea65 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29492024-11-26T05:34:03.678ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_1b72df9a-7b76-458e-9ee3-3ca99732ea65
29502024-11-26T05:34:03.704ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 13de655b-3793-4d59-8bc1-22889b3fb01b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29512024-11-26T05:34:03.704ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_13de655b-3793-4d59-8bc1-22889b3fb01b
29522024-11-26T05:34:03.708ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51679
29532024-11-26T05:34:03.709ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1dbf9b5b-ede3-4cf4-b0d0-091aa188969a, kind: Service { id: 4e9fd39d-4113-4491-beca-e49e9a07f310 }, name: Name("external-dns-4e9fd39d-4113-4491-beca-e49e9a07f310"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 201, 3])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 2f3ae2da-b0e7-4755-a7ae-d54ffe51eccc, kind: Service { id: 7de56ef8-bdda-46b0-a9a9-fa5e97a778c5 }, name: Name("external-dns-7de56ef8-bdda-46b0-a9a9-fa5e97a778c5"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 146])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: afc30658-25b2-44db-9d11-ba075ebc447b, kind: Service { id: de715031-fa5a-4cf9-bf82-9cec9db59d81 }, name: Name("nexus-de715031-fa5a-4cf9-bf82-9cec9db59d81"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 180, 14])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e7b24131-9921-4152-b1bb-f948db445563, kind: Service { id: ccf769ca-e6aa-41c6-80d6-7f1cfa2a624a }, name: Name("nexus-ccf769ca-e6aa-41c6-80d6-7f1cfa2a624a"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 212, 242])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f88dd6c2-772e-44fb-bf3f-d4557d3228a8, kind: Service { id: eea1c48b-e597-47f2-a9c9-8bf328dab7cd }, name: Name("nexus-eea1c48b-e597-47f2-a9c9-8bf328dab7cd"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 159, 25])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
29542024-11-26T05:34:03.709ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
29552024-11-26T05:34:03.709ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
29562024-11-26T05:34:03.709ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
29572024-11-26T05:34:03.709ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
29582024-11-26T05:34:03.709ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
29592024-11-26T05:34:03.709ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
29602024-11-26T05:34:03.709ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 546 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51679 req_id = ca27c4cc-cc4f-49c6-bcbc-40f83b756944 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
29612024-11-26T05:34:03.718ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: da133136-28dd-4eff-a3ed-9f84ec495a60 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29622024-11-26T05:34:03.718ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_da133136-28dd-4eff-a3ed-9f84ec495a60
29632024-11-26T05:34:03.732ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 285457 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37607 req_id = 6dbb59c0-fba5-452e-8b05-4216e329dcf2 response_code = 200 uri = /inventory
29642024-11-26T05:34:03.735ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 06ee1c63-02b8-46d6-96ed-aa8ab7a8d522 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29652024-11-26T05:34:03.735ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_06ee1c63-02b8-46d6-96ed-aa8ab7a8d522
29662024-11-26T05:34:03.760ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4fe72516-6144-43ef-96ee-e7fbaeb34f42 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29672024-11-26T05:34:03.760ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_4fe72516-6144-43ef-96ee-e7fbaeb34f42
29682024-11-26T05:34:03.783ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 580c5897-a97f-4c76-9a8f-bf80d62b760e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29692024-11-26T05:34:03.783ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_580c5897-a97f-4c76-9a8f-bf80d62b760e
29702024-11-26T05:34:03.806ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 62fc8f20-7ce8-489b-a022-013df6640479 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29712024-11-26T05:34:03.806ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_62fc8f20-7ce8-489b-a022-013df6640479
29722024-11-26T05:34:03.828ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: af39775d-5158-4242-88aa-5dd2d3c14817 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29732024-11-26T05:34:03.828ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_af39775d-5158-4242-88aa-5dd2d3c14817
29742024-11-26T05:34:03.851ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9bc99efb-91b7-405a-b8dd-0949d11c1f4a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29752024-11-26T05:34:03.851ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_9bc99efb-91b7-405a-b8dd-0949d11c1f4a
29762024-11-26T05:34:03.880ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: da133136-28dd-4eff-a3ed-9f84ec495a60 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29772024-11-26T05:34:03.880ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_da133136-28dd-4eff-a3ed-9f84ec495a60
29782024-11-26T05:34:03.894ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 246692 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50823 req_id = f91e64ae-a699-4905-a875-aff02b8e3e15 response_code = 200 uri = /inventory
29792024-11-26T05:34:09.541ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
29802024-11-26T05:34:09.541ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
29812024-11-26T05:34:09.543ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
29822024-11-26T05:34:09.544ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
29832024-11-26T05:34:13.155ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:43303
29842024-11-26T05:34:13.155ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:43303 req_id = 834a8ab5-5c9c-4537-8ed2-39a1e29f688e response_code = 200 uri = /baseboard
29852024-11-26T05:34:19.545ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
29862024-11-26T05:34:19.546ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
29872024-11-26T05:34:19.548ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
29882024-11-26T05:34:19.549ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
29892024-11-26T05:34:29.549ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
29902024-11-26T05:34:29.550ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
29912024-11-26T05:34:29.552ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
29922024-11-26T05:34:29.552ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
29932024-11-26T05:34:32.186ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57224
29942024-11-26T05:34:32.186ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57224 req_id = cb88a663-0666-4d12-af3a-1615f396c2b8 response_code = 200 uri = /vpc-routes
29952024-11-26T05:34:32.203ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8 values = ExternalIpGatewayMap { mappings: {} }
29962024-11-26T05:34:32.203ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57224 req_id = c521db4c-e6d1-4b18-a629-bb27177029a6 response_code = 204 uri = /eip-gateways
29972024-11-26T05:34:32.211ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57224 req_id = 6165dea1-3138-4b75-bfd0-d91f979847ef response_code = 204 uri = /vpc-routes
29982024-11-26T05:34:32.250ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59568
29992024-11-26T05:34:32.251ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4120
30002024-11-26T05:34:32.291ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4144
30012024-11-26T05:34:32.350ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99921 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:59568 req_id = e3ba4169-ba50-4f19-9bce-de452f7f9129 response_code = 204 uri = /switch-ports
30022024-11-26T05:34:32.351ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34010
30032024-11-26T05:34:32.351ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 170 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34010 req_id = e458c458-45a2-43cb-a877-928056bb1e50 response_code = 200 uri = /v2p
30042024-11-26T05:34:32.351ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 203 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59568 req_id = 8e79f65a-ffc9-423f-a4a4-cc7dfa616767 response_code = 200 uri = /network-bootstore-config
30052024-11-26T05:34:32.950ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46936
30062024-11-26T05:34:32.950ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46936 req_id = 8692724f-dd64-4f27-be2c-cd1c83700f0f response_code = 200 uri = /vpc-routes
30072024-11-26T05:34:33.025ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8 values = ExternalIpGatewayMap { mappings: {} }
30082024-11-26T05:34:33.025ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46936 req_id = e9c6a475-edfc-4e79-a024-9691b990b1c5 response_code = 204 uri = /eip-gateways
30092024-11-26T05:34:33.034ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46936 req_id = 5bc50d6b-3685-4917-bf0c-b5687ba71efc response_code = 204 uri = /vpc-routes
30102024-11-26T05:34:33.076ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34370
30112024-11-26T05:34:33.076ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4120
30122024-11-26T05:34:33.117ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4144
30132024-11-26T05:34:33.190ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113142 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:34370 req_id = b241f713-bbcb-4838-80be-2cbfaaf8c5f0 response_code = 204 uri = /switch-ports
30142024-11-26T05:34:33.190ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34251
30152024-11-26T05:34:33.190ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34251 req_id = 209cc36d-a125-43ba-95d5-ff808ca3658f response_code = 200 uri = /v2p
30162024-11-26T05:34:33.190ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34370 req_id = acc7abac-2c79-4df5-ad6c-dbe9cdf54c42 response_code = 200 uri = /network-bootstore-config
30172024-11-26T05:34:33.206ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36295
30182024-11-26T05:34:33.206ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 191 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36295 req_id = 68504bb8-7d69-4ef2-827c-a03a4fe6c824 response_code = 200 uri = /v2p
30192024-11-26T05:34:33.273ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41725
30202024-11-26T05:34:33.274ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41725 req_id = 8aadbe90-d3ff-4b8a-8645-4d3c8ce56550 response_code = 200 uri = /vpc-routes
30212024-11-26T05:34:33.293ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54969
30222024-11-26T05:34:33.293ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4120
30232024-11-26T05:34:33.335ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4144
30242024-11-26T05:34:33.398ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104773 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:54969 req_id = 0b77dcb5-3aaa-47b2-af76-9abe1bbad3e9 response_code = 204 uri = /switch-ports
30252024-11-26T05:34:33.398ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8 values = ExternalIpGatewayMap { mappings: {} }
30262024-11-26T05:34:33.398ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41725 req_id = f8405961-7725-4577-a135-7ba23d197f7d response_code = 204 uri = /eip-gateways
30272024-11-26T05:34:33.398ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54969 req_id = ed606a51-33ae-4ec2-82a1-e7d717a6ff12 response_code = 200 uri = /network-bootstore-config
30282024-11-26T05:34:33.409ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 220 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41725 req_id = e93811c7-bdd6-480e-919c-4bb13b65ff18 response_code = 204 uri = /vpc-routes
30292024-11-26T05:34:39.553ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
30302024-11-26T05:34:39.554ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
30312024-11-26T05:34:39.556ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
30322024-11-26T05:34:39.557ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
30332024-11-26T05:34:43.189ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:59584
30342024-11-26T05:34:43.189ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:59584 req_id = c5983b2d-be19-4c6a-afe5-e4eea759825f response_code = 200 uri = /baseboard
30352024-11-26T05:34:49.558ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
30362024-11-26T05:34:49.558ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
30372024-11-26T05:34:49.560ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
30382024-11-26T05:34:49.561ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
30392024-11-26T05:34:51.967ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41502
30402024-11-26T05:34:51.967ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41502 req_id = 5f424640-6878-4ff3-a1f6-8fc86ab73d1c response_code = 200 uri = /v2p
30412024-11-26T05:34:51.968ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:838 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(12480612) }
30422024-11-26T05:34:51.968ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 668 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41502 req_id = 706bc0ee-3846-4c30-a1ed-b5dc9b4fd514 response_code = 204 uri = /v2p
30432024-11-26T05:34:52.219ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45334
30442024-11-26T05:34:52.225ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:555 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: e3e68f4a-cacf-4205-872f-13df2c5d84f5, kind: Instance { id: 2a0063fb-163a-47be-951b-5ff819a91241 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(12480612), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: e3e68f4a-cacf-4205-872f-13df2c5d84f5, kind: Instance { id: 2a0063fb-163a-47be-951b-5ff819a91241 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(12480612), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: e3e68f4a-cacf-4205-872f-13df2c5d84f5, kind: Instance { id: 2a0063fb-163a-47be-951b-5ff819a91241 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(12480612), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(12480612))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: e3e68f4a-cacf-4205-872f-13df2c5d84f5, kind: Instance { id: 2a0063fb-163a-47be-951b-5ff819a91241 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(12480612), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-783dc4d5c16", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 08a74e0f-bb29-4d41-ae59-2f9f1bf6cb35, read_only_parent: Some(Volume { block_size: 512, id: 7ed9fa6f-faf9-4db0-828a-2363abb65f42, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: dab75580-38d5-460a-9a64-5e99d585befa, key: Some("HE62Yk6nvHd9TL2xbqzt3Q8C5JBFdbXcvf6XH0cPjQs="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::15]:19001", "[fd00:1122:3344:101::16]:19001", "[fd00:1122:3344:101::14]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 08a74e0f-bb29-4d41-ae59-2f9f1bf6cb35, key: Some("THDhta9oldYomX1gM5sv689g2mYfnjp833Qo7VZDYx0="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::19]:19001", "[fd00:1122:3344:101::16]:19002", "[fd00:1122:3344:101::17]:19000"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-783dc4d5c16" }] }), cloud_init_bytes: Some(..) } instance_id = 2a0063fb-163a-47be-951b-5ff819a91241 metadata = InstanceMetadata { silo_id: bbb0dd0e-24fe-4f48-9980-3607c8d4a485, project_id: abc14305-618e-4e0b-a048-f75cce54a9cc } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = 18c3679d-4ace-4a68-abd2-0ed1a1da0ede vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-11-26T05:34:52.218898814Z }
30452024-11-26T05:34:52.225ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:588 instance_id = 2a0063fb-163a-47be-951b-5ff819a91241 migration_id = None propolis_id = 18c3679d-4ace-4a68-abd2-0ed1a1da0ede
30462024-11-26T05:34:52.225ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1281 instance_id = 2a0063fb-163a-47be-951b-5ff819a91241 migration_id = None propolis_id = 18c3679d-4ace-4a68-abd2-0ed1a1da0ede state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: e3e68f4a-cacf-4205-872f-13df2c5d84f5, kind: Instance { id: 2a0063fb-163a-47be-951b-5ff819a91241 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(12480612), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: e3e68f4a-cacf-4205-872f-13df2c5d84f5, kind: Instance { id: 2a0063fb-163a-47be-951b-5ff819a91241 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(12480612), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: e3e68f4a-cacf-4205-872f-13df2c5d84f5, kind: Instance { id: 2a0063fb-163a-47be-951b-5ff819a91241 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(12480612), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(12480612))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: e3e68f4a-cacf-4205-872f-13df2c5d84f5, kind: Instance { id: 2a0063fb-163a-47be-951b-5ff819a91241 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(12480612), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-783dc4d5c16", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 08a74e0f-bb29-4d41-ae59-2f9f1bf6cb35, read_only_parent: Some(Volume { block_size: 512, id: 7ed9fa6f-faf9-4db0-828a-2363abb65f42, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: dab75580-38d5-460a-9a64-5e99d585befa, key: Some("HE62Yk6nvHd9TL2xbqzt3Q8C5JBFdbXcvf6XH0cPjQs="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::15]:19001", "[fd00:1122:3344:101::16]:19001", "[fd00:1122:3344:101::14]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 08a74e0f-bb29-4d41-ae59-2f9f1bf6cb35, key: Some("THDhta9oldYomX1gM5sv689g2mYfnjp833Qo7VZDYx0="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::19]:19001", "[fd00:1122:3344:101::16]:19002", "[fd00:1122:3344:101::17]:19000"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-783dc4d5c16" }] }), cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-11-26T05:34:52.218898814Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
30472024-11-26T05:34:52.227ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8177 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45334 req_id = 27e79c43-2a4e-4a14-a4a1-4f89b54d5d68 response_code = 200 uri = /vmms/18c3679d-4ace-4a68-abd2-0ed1a1da0ede
30482024-11-26T05:34:52.303ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46483
30492024-11-26T05:34:52.303ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 672 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46483 req_id = 1320e1aa-37c7-41cf-8c09-fd4cf0328839 response_code = 200 uri = /vmms/18c3679d-4ace-4a68-abd2-0ed1a1da0ede/state
30502024-11-26T05:34:52.305ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 12480612 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
30512024-11-26T05:34:52.305ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
30522024-11-26T05:34:52.348ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_18c3679d-4ace-4a68-abd2-0ed1a1da0ede file = illumos-utils/src/zone.rs:325 instance_id = 2a0063fb-163a-47be-951b-5ff819a91241 propolis_id = 18c3679d-4ace-4a68-abd2-0ed1a1da0ede
30532024-11-26T05:34:52.376ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_18c3679d-4ace-4a68-abd2-0ed1a1da0ede file = illumos-utils/src/zone.rs:363 instance_id = 2a0063fb-163a-47be-951b-5ff819a91241 propolis_id = 18c3679d-4ace-4a68-abd2-0ed1a1da0ede
30542024-11-26T05:34:52.442ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60360
30552024-11-26T05:34:52.442ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60360 req_id = fcb0ecc1-9966-46af-a57a-f907a5aea391 response_code = 200 uri = /vpc-routes
30562024-11-26T05:34:52.460ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8 values = ExternalIpGatewayMap { mappings: {e3e68f4a-cacf-4205-872f-13df2c5d84f5: {10.151.2.176: {9b633903-db75-4bec-90eb-8aff049b5285}, 10.151.2.175: {9b633903-db75-4bec-90eb-8aff049b5285}}} }
30572024-11-26T05:34:54.104ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_18c3679d-4ace-4a68-abd2-0ed1a1da0ede: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = 2a0063fb-163a-47be-951b-5ff819a91241 propolis_id = 18c3679d-4ace-4a68-abd2-0ed1a1da0ede
30582024-11-26T05:34:54.104ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_18c3679d-4ace-4a68-abd2-0ed1a1da0ede zone file = illumos-utils/src/running_zone.rs:488 instance_id = 2a0063fb-163a-47be-951b-5ff819a91241 propolis_id = 18c3679d-4ace-4a68-abd2-0ed1a1da0ede zone = oxz_propolis-server_18c3679d-4ace-4a68-abd2-0ed1a1da0ede
30592024-11-26T05:34:54.279ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_18c3679d-4ace-4a68-abd2-0ed1a1da0ede") failed: Property not found. retry in 28.404809ms file = illumos-utils/src/svc.rs:36 instance_id = 2a0063fb-163a-47be-951b-5ff819a91241 propolis_id = 18c3679d-4ace-4a68-abd2-0ed1a1da0ede zone = oxz_propolis-server_18c3679d-4ace-4a68-abd2-0ed1a1da0ede
30602024-11-26T05:34:54.320ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_18c3679d-4ace-4a68-abd2-0ed1a1da0ede") failed: Property not found. retry in 101.290733ms file = illumos-utils/src/svc.rs:36 instance_id = 2a0063fb-163a-47be-951b-5ff819a91241 propolis_id = 18c3679d-4ace-4a68-abd2-0ed1a1da0ede zone = oxz_propolis-server_18c3679d-4ace-4a68-abd2-0ed1a1da0ede
30612024-11-26T05:34:54.441ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_18c3679d-4ace-4a68-abd2-0ed1a1da0ede") failed: Property not found. retry in 121.636006ms file = illumos-utils/src/svc.rs:36 instance_id = 2a0063fb-163a-47be-951b-5ff819a91241 propolis_id = 18c3679d-4ace-4a68-abd2-0ed1a1da0ede zone = oxz_propolis-server_18c3679d-4ace-4a68-abd2-0ed1a1da0ede
30622024-11-26T05:34:54.585ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_18c3679d-4ace-4a68-abd2-0ed1a1da0ede") failed: Property not found. retry in 492.5213ms file = illumos-utils/src/svc.rs:36 instance_id = 2a0063fb-163a-47be-951b-5ff819a91241 propolis_id = 18c3679d-4ace-4a68-abd2-0ed1a1da0ede zone = oxz_propolis-server_18c3679d-4ace-4a68-abd2-0ed1a1da0ede
30632024-11-26T05:34:55.097ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_18c3679d-4ace-4a68-abd2-0ed1a1da0ede") failed: Property not found. retry in 663.934921ms file = illumos-utils/src/svc.rs:36 instance_id = 2a0063fb-163a-47be-951b-5ff819a91241 propolis_id = 18c3679d-4ace-4a68-abd2-0ed1a1da0ede zone = oxz_propolis-server_18c3679d-4ace-4a68-abd2-0ed1a1da0ede
30642024-11-26T05:34:55.774ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_18c3679d-4ace-4a68-abd2-0ed1a1da0ede") failed: Property not found. retry in 673.064562ms file = illumos-utils/src/svc.rs:36 instance_id = 2a0063fb-163a-47be-951b-5ff819a91241 propolis_id = 18c3679d-4ace-4a68-abd2-0ed1a1da0ede zone = oxz_propolis-server_18c3679d-4ace-4a68-abd2-0ed1a1da0ede
30652024-11-26T05:34:56.461ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_18c3679d-4ace-4a68-abd2-0ed1a1da0ede") failed: Property not found. retry in 996.515348ms file = illumos-utils/src/svc.rs:36 instance_id = 2a0063fb-163a-47be-951b-5ff819a91241 propolis_id = 18c3679d-4ace-4a68-abd2-0ed1a1da0ede zone = oxz_propolis-server_18c3679d-4ace-4a68-abd2-0ed1a1da0ede
30662024-11-26T05:34:57.470ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_18c3679d-4ace-4a68-abd2-0ed1a1da0ede") failed: Property not found. retry in 559.360713ms file = illumos-utils/src/svc.rs:36 instance_id = 2a0063fb-163a-47be-951b-5ff819a91241 propolis_id = 18c3679d-4ace-4a68-abd2-0ed1a1da0ede zone = oxz_propolis-server_18c3679d-4ace-4a68-abd2-0ed1a1da0ede
30672024-11-26T05:34:58.043ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_18c3679d-4ace-4a68-abd2-0ed1a1da0ede") failed: Property not found. retry in 993.416538ms file = illumos-utils/src/svc.rs:36 instance_id = 2a0063fb-163a-47be-951b-5ff819a91241 propolis_id = 18c3679d-4ace-4a68-abd2-0ed1a1da0ede zone = oxz_propolis-server_18c3679d-4ace-4a68-abd2-0ed1a1da0ede
30682024-11-26T05:34:59.071ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_18c3679d-4ace-4a68-abd2-0ed1a1da0ede file = sled-agent/src/instance.rs:1787 instance_id = 2a0063fb-163a-47be-951b-5ff819a91241 propolis_id = 18c3679d-4ace-4a68-abd2-0ed1a1da0ede
30692024-11-26T05:34:59.082ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_18c3679d-4ace-4a68-abd2-0ed1a1da0ede") failed: Property not found. retry in 31.258405ms file = illumos-utils/src/svc.rs:36 instance_id = 2a0063fb-163a-47be-951b-5ff819a91241 propolis_id = 18c3679d-4ace-4a68-abd2-0ed1a1da0ede
30702024-11-26T05:34:59.125ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_18c3679d-4ace-4a68-abd2-0ed1a1da0ede") failed: Property not found. retry in 120.954005ms file = illumos-utils/src/svc.rs:36 instance_id = 2a0063fb-163a-47be-951b-5ff819a91241 propolis_id = 18c3679d-4ace-4a68-abd2-0ed1a1da0ede
30712024-11-26T05:34:59.260ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_18c3679d-4ace-4a68-abd2-0ed1a1da0ede") failed: Property not found. retry in 290.97913ms file = illumos-utils/src/svc.rs:36 instance_id = 2a0063fb-163a-47be-951b-5ff819a91241 propolis_id = 18c3679d-4ace-4a68-abd2-0ed1a1da0ede
30722024-11-26T05:34:59.564ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_18c3679d-4ace-4a68-abd2-0ed1a1da0ede") failed: Property not found. retry in 435.267815ms file = illumos-utils/src/svc.rs:36 instance_id = 2a0063fb-163a-47be-951b-5ff819a91241 propolis_id = 18c3679d-4ace-4a68-abd2-0ed1a1da0ede
30732024-11-26T05:34:59.567ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
30742024-11-26T05:34:59.568ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
30752024-11-26T05:34:59.570ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
30762024-11-26T05:34:59.571ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
30772024-11-26T05:35:00.013ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:1796 instance_id = 2a0063fb-163a-47be-951b-5ff819a91241 propolis_id = 18c3679d-4ace-4a68-abd2-0ed1a1da0ede
30782024-11-26T05:35:00.050ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:1820 instance_id = 2a0063fb-163a-47be-951b-5ff819a91241 propolis_id = 18c3679d-4ace-4a68-abd2-0ed1a1da0ede
30792024-11-26T05:35:00.188ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:932 instance_id = 2a0063fb-163a-47be-951b-5ff819a91241 propolis_id = 18c3679d-4ace-4a68-abd2-0ed1a1da0ede
30802024-11-26T05:35:00.189ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1231 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
30812024-11-26T05:35:00.189ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7730041 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60360 req_id = dd615aeb-361e-480f-a063-9b93b51f98f0 response_code = 204 uri = /eip-gateways
30822024-11-26T05:35:00.189ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2024-11-26T05:35:00.189279368Z } file = sled-agent/src/instance.rs:780 instance_id = 2a0063fb-163a-47be-951b-5ff819a91241 propolis_id = 18c3679d-4ace-4a68-abd2-0ed1a1da0ede
30832024-11-26T05:35:00.189ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 2a0063fb-163a-47be-951b-5ff819a91241 new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-11-26T05:35:00.189279368Z } propolis_id = 18c3679d-4ace-4a68-abd2-0ed1a1da0ede
30842024-11-26T05:35:00.189ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 2a0063fb-163a-47be-951b-5ff819a91241 propolis_id = 18c3679d-4ace-4a68-abd2-0ed1a1da0ede state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-11-26T05:35:00.189279368Z }, migration_in: None, migration_out: None }
30852024-11-26T05:35:00.206ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2024-11-26T05:35:00.206468345Z } file = sled-agent/src/instance.rs:780 instance_id = 2a0063fb-163a-47be-951b-5ff819a91241 propolis_id = 18c3679d-4ace-4a68-abd2-0ed1a1da0ede
30862024-11-26T05:35:00.206ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 2a0063fb-163a-47be-951b-5ff819a91241 new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-26T05:35:00.206468345Z } propolis_id = 18c3679d-4ace-4a68-abd2-0ed1a1da0ede
30872024-11-26T05:35:00.206ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 2a0063fb-163a-47be-951b-5ff819a91241 propolis_id = 18c3679d-4ace-4a68-abd2-0ed1a1da0ede state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-26T05:35:00.206468345Z }, migration_in: None, migration_out: None }
30882024-11-26T05:35:00.269ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 380 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60360 req_id = 76c76f12-8b2a-4787-ad1b-d6b0645d63f6 response_code = 204 uri = /vpc-routes
30892024-11-26T05:35:02.256ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33639
30902024-11-26T05:35:02.256ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 280 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33639 req_id = e4ad3f77-5a6b-4f5e-90ac-f8a6af9dbe64 response_code = 200 uri = /vmms/18c3679d-4ace-4a68-abd2-0ed1a1da0ede/state
30912024-11-26T05:35:02.290ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60190
30922024-11-26T05:35:02.291ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60190 req_id = 1b3f8a4b-5033-4f46-bbb5-1d8100b80332 response_code = 200 uri = /vpc-routes
30932024-11-26T05:35:02.353ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8 values = ExternalIpGatewayMap { mappings: {e3e68f4a-cacf-4205-872f-13df2c5d84f5: {10.151.2.176: {9b633903-db75-4bec-90eb-8aff049b5285}, 10.151.2.175: {9b633903-db75-4bec-90eb-8aff049b5285}}} }
30942024-11-26T05:35:02.353ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60190 req_id = e118862e-0450-4af5-9a40-db43b58648ff response_code = 204 uri = /eip-gateways
30952024-11-26T05:35:02.380ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 265 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60190 req_id = 102fc4ba-a6d9-49f4-aff9-4fcebf153f21 response_code = 204 uri = /vpc-routes
30962024-11-26T05:35:02.478ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58832
30972024-11-26T05:35:02.478ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58832 req_id = da29af8a-4409-4149-b7af-00f9204af8e5 response_code = 200 uri = /v2p
30982024-11-26T05:35:02.540ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63211
30992024-11-26T05:35:02.541ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4120
31002024-11-26T05:35:02.603ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4144
31012024-11-26T05:35:02.689ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 149031 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:63211 req_id = 78fd74c5-96f4-41c7-88a2-61419241b9e5 response_code = 204 uri = /switch-ports
31022024-11-26T05:35:02.690ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63211 req_id = 7f130de1-2d12-4978-932f-03d6e0ee159d response_code = 200 uri = /network-bootstore-config
31032024-11-26T05:35:03.187ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61368
31042024-11-26T05:35:03.187ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61368 req_id = 23cab558-1d7a-4ca6-95bf-de922ccb75cc response_code = 200 uri = /vpc-routes
31052024-11-26T05:35:03.217ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39877
31062024-11-26T05:35:03.217ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39877 req_id = 897cbdd2-a3e7-4836-9b87-9a28da650a04 response_code = 200 uri = /vpc-routes
31072024-11-26T05:35:03.245ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62872
31082024-11-26T05:35:03.248ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62872 req_id = fc585172-09b0-4013-bfbd-a49c579abc3f response_code = 200 uri = /vmms/18c3679d-4ace-4a68-abd2-0ed1a1da0ede/state
31092024-11-26T05:35:03.268ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8 values = ExternalIpGatewayMap { mappings: {e3e68f4a-cacf-4205-872f-13df2c5d84f5: {10.151.2.176: {9b633903-db75-4bec-90eb-8aff049b5285}, 10.151.2.175: {9b633903-db75-4bec-90eb-8aff049b5285}}} }
31102024-11-26T05:35:03.268ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61368 req_id = a3c9e43b-e43a-4235-b18f-630c0bbe9700 response_code = 204 uri = /eip-gateways
31112024-11-26T05:35:03.303ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8 values = ExternalIpGatewayMap { mappings: {e3e68f4a-cacf-4205-872f-13df2c5d84f5: {10.151.2.176: {9b633903-db75-4bec-90eb-8aff049b5285}, 10.151.2.175: {9b633903-db75-4bec-90eb-8aff049b5285}}} }
31122024-11-26T05:35:03.303ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39877 req_id = 8328c32c-7e82-4b86-afe3-49d7186be30e response_code = 204 uri = /eip-gateways
31132024-11-26T05:35:03.329ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 251 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39877 req_id = d41faf60-c30b-4be7-8d9e-b098e88cd786 response_code = 204 uri = /vpc-routes
31142024-11-26T05:35:03.359ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34489
31152024-11-26T05:35:03.359ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4120
31162024-11-26T05:35:03.412ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4144
31172024-11-26T05:35:03.492ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 132857 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:34489 req_id = bc376086-e7ab-4c83-ab32-ce2e4ad124e3 response_code = 204 uri = /switch-ports
31182024-11-26T05:35:03.493ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36689
31192024-11-26T05:35:03.493ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63856
31202024-11-26T05:35:03.493ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 300 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63856 req_id = 344565e9-a290-4cfd-bfcf-d34f1eeb3211 response_code = 200 uri = /v2p
31212024-11-26T05:35:03.493ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 250 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36689 req_id = 618ba5f5-7f49-490f-b4bf-309198c2ceb1 response_code = 200 uri = /vmms/18c3679d-4ace-4a68-abd2-0ed1a1da0ede/state
31222024-11-26T05:35:03.493ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 398 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34489 req_id = e554b023-cc21-449c-9c0f-432c634dd8d0 response_code = 200 uri = /network-bootstore-config
31232024-11-26T05:35:03.493ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 481 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61368 req_id = 1a4f5cfc-9fae-4b94-8f62-586681794099 response_code = 204 uri = /vpc-routes
31242024-11-26T05:35:03.573ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57311
31252024-11-26T05:35:03.573ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 180 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57311 req_id = f4e6364b-ecd2-4d90-92c1-fdc8f6476062 response_code = 200 uri = /v2p
31262024-11-26T05:35:03.575ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62773
31272024-11-26T05:35:03.575ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4120
31282024-11-26T05:35:03.621ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4144
31292024-11-26T05:35:03.687ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111477 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:62773 req_id = 85942731-edff-445a-b6a4-671a3b30531b response_code = 204 uri = /switch-ports
31302024-11-26T05:35:03.687ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62773 req_id = f49c2b01-d325-4c3d-a3bc-484341a1c1e5 response_code = 200 uri = /network-bootstore-config
31312024-11-26T05:35:05.734ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
31322024-11-26T05:35:09.571ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
31332024-11-26T05:35:09.572ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
31342024-11-26T05:35:09.574ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
31352024-11-26T05:35:09.574ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
31362024-11-26T05:35:10.034ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48519
31372024-11-26T05:35:10.035ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 662 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48519 req_id = 6e4ef86c-46a8-45df-aba6-a5302ff97250 response_code = 200 uri = /vmms/18c3679d-4ace-4a68-abd2-0ed1a1da0ede/state
31382024-11-26T05:35:10.035ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2024-11-26T05:35:10.035389840Z } file = sled-agent/src/instance.rs:780 instance_id = 2a0063fb-163a-47be-951b-5ff819a91241 propolis_id = 18c3679d-4ace-4a68-abd2-0ed1a1da0ede
31392024-11-26T05:35:10.035ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 2a0063fb-163a-47be-951b-5ff819a91241 new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-11-26T05:35:10.035389840Z } propolis_id = 18c3679d-4ace-4a68-abd2-0ed1a1da0ede
31402024-11-26T05:35:10.035ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 2a0063fb-163a-47be-951b-5ff819a91241 propolis_id = 18c3679d-4ace-4a68-abd2-0ed1a1da0ede state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-11-26T05:35:10.035389840Z }, migration_in: None, migration_out: None }
31412024-11-26T05:35:10.085ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2024-11-26T05:35:10.085900829Z } file = sled-agent/src/instance.rs:780 instance_id = 2a0063fb-163a-47be-951b-5ff819a91241 propolis_id = 18c3679d-4ace-4a68-abd2-0ed1a1da0ede
31422024-11-26T05:35:10.085ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 2a0063fb-163a-47be-951b-5ff819a91241 new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-11-26T05:35:10.085900829Z } propolis_id = 18c3679d-4ace-4a68-abd2-0ed1a1da0ede
31432024-11-26T05:35:10.085ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:816 instance_id = 2a0063fb-163a-47be-951b-5ff819a91241 propolis_id = 18c3679d-4ace-4a68-abd2-0ed1a1da0ede
31442024-11-26T05:35:10.086ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
31452024-11-26T05:35:10.086ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 17199238122523551428 n_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
31462024-11-26T05:35:10.086ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
31472024-11-26T05:35:10.086ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/8488adc3-a35c-4d33-bd61-39dfc8c64c55/debug/bundle/zone", "/pool/int/e4c38366-5212-46e4-b3d0-f797c1f6a6ba/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/1b72df9a-7b76-458e-9ee3-3ca99732ea65/crypt/debug", "/pool/ext/13de655b-3793-4d59-8bc1-22889b3fb01b/crypt/debug", "/pool/ext/06ee1c63-02b8-46d6-96ed-aa8ab7a8d522/crypt/debug", "/pool/ext/4fe72516-6144-43ef-96ee-e7fbaeb34f42/crypt/debug", "/pool/ext/580c5897-a97f-4c76-9a8f-bf80d62b760e/crypt/debug", "/pool/ext/62fc8f20-7ce8-489b-a022-013df6640479/crypt/debug", "/pool/ext/af39775d-5158-4242-88aa-5dd2d3c14817/crypt/debug", "/pool/ext/9bc99efb-91b7-405a-b8dd-0949d11c1f4a/crypt/debug", "/pool/ext/da133136-28dd-4eff-a3ed-9f84ec495a60/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_18c3679d-4ace-4a68-abd2-0ed1a1da0ede
31482024-11-26T05:35:10.086ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 10980807510931325213 n_samples = 6 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
31492024-11-26T05:35:10.759ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1142 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_18c3679d-4ace-4a68-abd2-0ed1a1da0ede", bundle_id: b69b9d8a-7898-4cd4-b8a6-d2d3f59d59c9 }, time_created: 2024-11-26T05:35:10.086792417Z, version: 0, cause: TerminatedInstance }
31502024-11-26T05:35:10.759ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_18c3679d-4ace-4a68-abd2-0ed1a1da0ede file = sled-agent/src/instance.rs:1032 instance_id = 2a0063fb-163a-47be-951b-5ff819a91241 propolis_id = 18c3679d-4ace-4a68-abd2-0ed1a1da0ede
31512024-11-26T05:35:12.538ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:279 instance_id = 2a0063fb-163a-47be-951b-5ff819a91241 propolis_id = 18c3679d-4ace-4a68-abd2-0ed1a1da0ede
31522024-11-26T05:35:12.557ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:964 id = RouterId { vni: Vni(12480612), kind: System }
31532024-11-26T05:35:12.557ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:964 id = RouterId { vni: Vni(12480612), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
31542024-11-26T05:35:12.557ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 2a0063fb-163a-47be-951b-5ff819a91241 propolis_id = 18c3679d-4ace-4a68-abd2-0ed1a1da0ede state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-26T05:35:12.557965718Z }, migration_in: None, migration_out: None }
31552024-11-26T05:35:12.581ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 2a0063fb-163a-47be-951b-5ff819a91241 propolis_id = 18c3679d-4ace-4a68-abd2-0ed1a1da0ede state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-26T05:35:12.557965718Z }, migration_in: None, migration_out: None }
31562024-11-26T05:35:12.583ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:969 instance_id = 2a0063fb-163a-47be-951b-5ff819a91241 propolis_id = 18c3679d-4ace-4a68-abd2-0ed1a1da0ede
31572024-11-26T05:35:13.049ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62562
31582024-11-26T05:35:13.050ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62562 req_id = e013b042-9162-47e4-b584-63b1e046e597 response_code = 200 uri = /vpc-routes
31592024-11-26T05:35:13.098ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8 values = ExternalIpGatewayMap { mappings: {} }
31602024-11-26T05:35:13.098ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1231 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8
31612024-11-26T05:35:13.098ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62562 req_id = 8b5fd262-5e4d-410a-be02-fe53f74c72dd response_code = 204 uri = /eip-gateways
31622024-11-26T05:35:13.116ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 220 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62562 req_id = e8e1319f-64bd-4ae4-aecd-a918ba2fb407 response_code = 204 uri = /vpc-routes
31632024-11-26T05:35:13.226ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:62692
31642024-11-26T05:35:13.226ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:62692 req_id = 765d025c-5b16-4ca0-a2d2-c5537231bff9 response_code = 200 uri = /baseboard
31652024-11-26T05:35:13.255ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47927
31662024-11-26T05:35:13.255ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47927 req_id = 5c5c500c-3da3-410e-81f3-a130fbf54721 response_code = 200 uri = /v2p
31672024-11-26T05:35:13.609ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41383
31682024-11-26T05:35:13.609ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41383 req_id = 338a4561-5502-46ee-8021-d1afe10a0366 response_code = 200 uri = /v2p
31692024-11-26T05:35:13.689ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51610
31702024-11-26T05:35:13.690ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51610 req_id = 3484edb1-6768-44c7-bcb3-73c84efd7d8a response_code = 200 uri = /vpc-routes
31712024-11-26T05:35:13.703ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8 values = ExternalIpGatewayMap { mappings: {} }
31722024-11-26T05:35:13.703ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51610 req_id = c2d0a0c4-6902-4d76-bf82-618aa1c69ff4 response_code = 204 uri = /eip-gateways
31732024-11-26T05:35:13.712ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 167 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51610 req_id = a09463dc-0cc5-4eba-bd70-07396174403b response_code = 204 uri = /vpc-routes
31742024-11-26T05:35:14.373ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56533
31752024-11-26T05:35:14.373ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56533 req_id = 1f0bd5e9-8a4e-4e1f-a40e-3fc48fa71142 response_code = 200 uri = /vpc-routes
31762024-11-26T05:35:14.424ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 797da6fd-f74f-4d1b-bf7c-cab1c0adf4e8 values = ExternalIpGatewayMap { mappings: {} }
31772024-11-26T05:35:14.424ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56533 req_id = 6867a1ed-e402-487d-8154-26d6bc617b28 response_code = 204 uri = /eip-gateways
31782024-11-26T05:35:14.433ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 172 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56533 req_id = 9b8068c4-2c19-469d-9a6b-4b6dc0555552 response_code = 204 uri = /vpc-routes